Oct 30 21:52:54.440679 ip-10-0-137-4 systemd[1]: Starting Kubernetes Kubelet... Oct 30 21:52:54.887275 ip-10-0-137-4 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 21:52:54.887275 ip-10-0-137-4 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 21:52:54.887275 ip-10-0-137-4 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 21:52:54.887275 ip-10-0-137-4 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 21:52:54.890922 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.890824 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:52:54.890922 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.890922 2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:52:54.890922 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.890926 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:52:54.891047 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.890930 2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:52:54.891047 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.890944 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:52:54.891047 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.890947 2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:52:54.891047 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.890950 2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:52:54.891047 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.890953 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:52:54.891047 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.890956 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:52:54.891047 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.890958 2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:52:54.891047 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.890962 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:52:54.891047 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.890964 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:52:54.891047 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.890967 2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:52:54.891047 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.890989 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:52:54.891047 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.890992 2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:52:54.891047 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.890994 2577 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:52:54.891047 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.890997 2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:52:54.891047 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.890999 2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:52:54.891047 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891002 2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:52:54.891047 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891005 2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:52:54.891047 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891009 2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:52:54.891047 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891013 2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:52:54.891514 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891018 2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:52:54.891514 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891022 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:52:54.891514 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891026 2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:52:54.891514 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891029 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:52:54.891514 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891032 2577 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:52:54.891514 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891041 2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:52:54.891514 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891044 2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:52:54.891514 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891046 2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:52:54.891514 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891049 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:52:54.891514 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891052 2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:52:54.891514 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891055 2577 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:52:54.891514 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891058 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:52:54.891514 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891061 2577 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:52:54.891514 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891064 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:52:54.891514 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891066 2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:52:54.891514 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891069 2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:52:54.891514 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891071 2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:52:54.891514 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891074 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:52:54.891514 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891077 2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:52:54.891514 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891080 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:52:54.891993 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891082 2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:52:54.891993 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891084 2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:52:54.891993 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891087 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:52:54.891993 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891090 2577 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:52:54.891993 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891092 2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:52:54.891993 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891095 2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:52:54.891993 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891097 2577 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:52:54.891993 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891100 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:52:54.891993 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891102 2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:52:54.891993 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891105 2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:52:54.891993 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891108 2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:52:54.891993 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891111 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:52:54.891993 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891115 2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:52:54.891993 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891118 2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:52:54.891993 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891121 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:52:54.891993 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891123 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:52:54.891993 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891128 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:52:54.891993 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891130 2577 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:52:54.891993 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891133 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:52:54.892465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891135 2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:52:54.892465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891138 2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:52:54.892465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891140 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:52:54.892465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891143 2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:52:54.892465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891145 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:52:54.892465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891148 2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:52:54.892465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891151 2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:52:54.892465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891154 2577 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:52:54.892465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891156 2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:52:54.892465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891159 2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:52:54.892465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891183 2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:52:54.892465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891187 2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:52:54.892465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891191 2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:52:54.892465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891194 2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:52:54.892465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891197 2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:52:54.892465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891200 2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:52:54.892465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891203 2577 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:52:54.892465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891205 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:52:54.892465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891208 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:52:54.892465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891210 2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:52:54.892936 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891213 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:52:54.892936 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891216 2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:52:54.892936 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891219 2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:52:54.892936 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891222 2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:52:54.892936 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891224 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:52:54.892936 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891228 2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:52:54.892936 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891231 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:52:54.892936 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891234 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:52:54.892936 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891236 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:52:54.892936 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891239 2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:52:54.892936 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891242 2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:52:54.892936 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891245 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:52:54.892936 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891248 2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:52:54.892936 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891250 2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:52:54.892936 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891253 2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:52:54.892936 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891256 2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:52:54.892936 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891258 2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:52:54.892936 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891261 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:52:54.892936 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891263 2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:52:54.892936 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891266 2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:52:54.893435 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891270 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:52:54.893435 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891272 2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:52:54.893435 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891275 2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:52:54.893435 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891278 2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:52:54.893435 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.891280 2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:52:54.893435 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892117 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:52:54.893435 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892124 2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:52:54.893435 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892127 2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:52:54.893435 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892130 2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:52:54.893435 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892133 2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:52:54.893435 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892136 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:52:54.893435 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892139 2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:52:54.893435 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892141 2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:52:54.893435 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892144 2577 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:52:54.893435 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892147 2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:52:54.893435 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892149 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:52:54.893435 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892152 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:52:54.893435 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892155 2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:52:54.893435 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892158 2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:52:54.893435 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892161 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:52:54.893906 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892164 2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:52:54.893906 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892180 2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:52:54.893906 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892182 2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:52:54.893906 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892185 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:52:54.893906 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892188 2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:52:54.893906 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892190 2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:52:54.893906 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892193 2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:52:54.893906 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892195 2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:52:54.893906 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892198 2577 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:52:54.893906 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892201 2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:52:54.893906 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892204 2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:52:54.893906 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892206 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:52:54.893906 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892209 2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:52:54.893906 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892212 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:52:54.893906 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892215 2577 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:52:54.893906 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892218 2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:52:54.893906 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892220 2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:52:54.893906 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892223 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:52:54.893906 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892226 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:52:54.893906 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892228 2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:52:54.894479 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892231 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:52:54.894479 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892233 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:52:54.894479 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892235 2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:52:54.894479 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892238 2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:52:54.894479 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892241 2577 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:52:54.894479 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892243 2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:52:54.894479 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892245 2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:52:54.894479 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892248 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:52:54.894479 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892250 2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:52:54.894479 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892253 2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:52:54.894479 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892255 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:52:54.894479 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892258 2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:52:54.894479 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892265 2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:52:54.894479 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892267 2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:52:54.894479 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892270 2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:52:54.894479 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892273 2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:52:54.894479 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892275 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:52:54.894479 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892277 2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:52:54.894479 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892280 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:52:54.894479 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892282 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:52:54.894961 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892285 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:52:54.894961 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892287 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:52:54.894961 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892290 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:52:54.894961 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892293 2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:52:54.894961 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892296 2577 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:52:54.894961 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892298 2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:52:54.894961 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892301 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:52:54.894961 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892304 2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:52:54.894961 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892307 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:52:54.894961 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892310 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:52:54.894961 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892312 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:52:54.894961 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892315 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:52:54.894961 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892318 2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:52:54.894961 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892320 2577 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:52:54.894961 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892325 2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:52:54.894961 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892329 2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:52:54.894961 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892332 2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:52:54.894961 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892335 2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:52:54.894961 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892338 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:52:54.895465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892340 2577 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:52:54.895465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892342 2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:52:54.895465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892345 2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:52:54.895465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892347 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:52:54.895465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892351 2577 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:52:54.895465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892353 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:52:54.895465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892358 2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:52:54.895465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892362 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:52:54.895465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892365 2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:52:54.895465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892367 2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:52:54.895465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892370 2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:52:54.895465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892372 2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:52:54.895465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892375 2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:52:54.895465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892394 2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:52:54.895465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892398 2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:52:54.895465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892402 2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:52:54.895465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892405 2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:52:54.895465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892409 2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:52:54.895465 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892417 2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:52:54.895921 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892420 2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:52:54.895921 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892422 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:52:54.895921 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892425 2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:52:54.895921 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892428 2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:52:54.895921 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892431 2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:52:54.895921 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892433 2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:52:54.895921 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892436 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:52:54.895921 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892439 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:52:54.895921 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892441 2577 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:52:54.895921 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892444 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:52:54.895921 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892447 2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:52:54.895921 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892449 2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:52:54.895921 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892453 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:52:54.895921 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892985 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:52:54.895921 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892991 2577 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:52:54.895921 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892994 2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:52:54.895921 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892996 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:52:54.895921 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.892999 2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:52:54.895921 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893002 2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:52:54.896374 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893005 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:52:54.896374 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893008 2577 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:52:54.896374 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893011 2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:52:54.896374 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893014 2577 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:52:54.896374 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893016 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:52:54.896374 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893019 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:52:54.896374 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893022 2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:52:54.896374 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893025 2577 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:52:54.896374 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893027 2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:52:54.896374 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893030 2577 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:52:54.896374 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893033 2577 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:52:54.896374 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893035 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:52:54.896374 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893039 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:52:54.896374 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893041 2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:52:54.896374 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893044 2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:52:54.896374 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893046 2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:52:54.896374 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893048 2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:52:54.896374 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893051 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:52:54.896374 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893053 2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:52:54.896374 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893055 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:52:54.896857 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893058 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:52:54.896857 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893061 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:52:54.896857 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893063 2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:52:54.896857 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893066 2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:52:54.896857 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893068 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:52:54.896857 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893070 2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:52:54.896857 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893073 2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:52:54.896857 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893075 2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:52:54.896857 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893078 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:52:54.896857 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893080 2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:52:54.896857 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893082 2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:52:54.896857 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893085 2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:52:54.896857 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893087 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:52:54.896857 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893090 2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:52:54.896857 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893092 2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:52:54.896857 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893095 2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:52:54.896857 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893097 2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:52:54.896857 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893100 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:52:54.896857 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893103 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:52:54.896857 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893105 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:52:54.897334 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893109 2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:52:54.897334 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893113 2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:52:54.897334 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893117 2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:52:54.897334 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893120 2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:52:54.897334 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893123 2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:52:54.897334 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893126 2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:52:54.897334 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893128 2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:52:54.897334 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893131 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:52:54.897334 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893133 2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:52:54.897334 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893136 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:52:54.897334 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893138 2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:52:54.897334 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893141 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:52:54.897334 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893143 2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:52:54.897334 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893146 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:52:54.897334 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893148 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:52:54.897334 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893150 2577 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:52:54.897334 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893153 2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:52:54.897334 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893155 2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:52:54.897334 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893158 2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:52:54.897804 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893160 2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:52:54.897804 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893163 2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:52:54.897804 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893165 2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:52:54.897804 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893167 2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:52:54.897804 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893170 2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:52:54.897804 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893172 2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:52:54.897804 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893175 2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:52:54.897804 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893180 2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:52:54.897804 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893185 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:52:54.897804 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893188 2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:52:54.897804 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893190 2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:52:54.897804 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893193 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:52:54.897804 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893196 2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:52:54.897804 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893198 2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:52:54.897804 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893201 2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:52:54.897804 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893203 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:52:54.897804 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893206 2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:52:54.897804 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893209 2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:52:54.897804 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893212 2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:52:54.898256 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893215 2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:52:54.898256 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893217 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:52:54.898256 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893220 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:52:54.898256 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893222 2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:52:54.898256 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893225 2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:52:54.898256 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893227 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:52:54.898256 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893230 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:52:54.898256 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893233 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:52:54.898256 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893235 2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:52:54.898256 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893238 2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:52:54.898256 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893240 2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:52:54.898256 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893243 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:52:54.898256 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893245 2577 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:52:54.898256 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893250 2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:52:54.898256 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893254 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:52:54.898256 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893257 2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:52:54.898256 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893260 2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:52:54.898256 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893262 2577 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:52:54.898256 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893265 2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893268 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893270 2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.893275 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894341 2577 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894356 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894364 2577 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894369 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894373 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894389 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894394 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894399 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894402 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894405 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894409 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894412 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894416 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894420 2577 flags.go:64] FLAG: --cgroup-root="" Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894423 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894427 2577 flags.go:64] FLAG: --client-ca-file="" Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894430 2577 flags.go:64] FLAG: --cloud-provider="external" Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894433 2577 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894438 2577 flags.go:64] FLAG: --cluster-domain="" Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894441 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 21:52:54.898731 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894444 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894448 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894451 2577 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894455 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894459 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894462 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894466 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894469 2577 flags.go:64] FLAG: --contention-profiling="false" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894472 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894475 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894478 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894482 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894487 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894491 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894494 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894496 2577 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894500 2577 flags.go:64] FLAG: --enable-server="true" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894503 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894507 2577 flags.go:64] FLAG: --event-burst="100" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894512 2577 flags.go:64] FLAG: --event-qps="50" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894515 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894518 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894522 2577 flags.go:64] FLAG: --eviction-hard="" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894527 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 21:52:54.899320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894530 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 21:52:54.899982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894533 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 21:52:54.899982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894536 2577 flags.go:64] FLAG: --eviction-soft="" Oct 30 21:52:54.899982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894539 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 21:52:54.899982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894542 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 21:52:54.899982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894545 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 21:52:54.899982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894548 2577 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 21:52:54.899982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894551 2577 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 21:52:54.899982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894554 2577 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 21:52:54.899982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894557 2577 flags.go:64] FLAG: --feature-gates="" Oct 30 21:52:54.899982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894561 2577 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 21:52:54.899982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894565 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 21:52:54.899982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894568 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 21:52:54.899982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894572 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 21:52:54.899982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894575 2577 flags.go:64] FLAG: --healthz-port="10248" Oct 30 21:52:54.899982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894578 2577 flags.go:64] FLAG: --help="false" Oct 30 21:52:54.899982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894582 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:52:54.899982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894585 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 21:52:54.899982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894589 2577 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 21:52:54.899982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894592 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 21:52:54.899982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894595 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 21:52:54.899982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894599 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 21:52:54.899982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894602 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 21:52:54.899982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894605 2577 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894608 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894611 2577 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894614 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894618 2577 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894621 2577 flags.go:64] FLAG: --kube-reserved="" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894624 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894627 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894630 2577 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894633 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894636 2577 flags.go:64] FLAG: --lock-file="" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894639 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894642 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894645 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894651 2577 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894653 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894656 2577 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894659 2577 flags.go:64] FLAG: --logging-format="text" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894662 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894666 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894668 2577 flags.go:64] FLAG: --manifest-url="" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894672 2577 flags.go:64] FLAG: --manifest-url-header="" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894677 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894680 2577 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894683 2577 flags.go:64] FLAG: --max-pods="110" Oct 30 21:52:54.900560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894686 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894689 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894692 2577 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894695 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894698 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894701 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894705 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894713 2577 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894716 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894719 2577 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894722 2577 flags.go:64] FLAG: --pod-cidr="" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894727 2577 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894729 2577 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894732 2577 flags.go:64] FLAG: --pods-per-core="0" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894735 2577 flags.go:64] FLAG: --port="10250" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894738 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894741 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-085c58790d2f3ece0" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894744 2577 flags.go:64] FLAG: --qos-reserved="" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894747 2577 flags.go:64] FLAG: --read-only-port="10255" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894751 2577 flags.go:64] FLAG: --register-node="true" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894754 2577 flags.go:64] FLAG: --register-with-taints="" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894757 2577 flags.go:64] FLAG: --registry-burst="10" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894760 2577 flags.go:64] FLAG: --registry-qps="5" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894764 2577 flags.go:64] FLAG: --reserved-cpus="" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894767 2577 flags.go:64] FLAG: --reserved-memory="" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894771 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 21:52:54.901129 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894774 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894777 2577 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894780 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894784 2577 flags.go:64] FLAG: --runonce="false" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894787 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894790 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894793 2577 flags.go:64] FLAG: --seccomp-default="false" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894796 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894798 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894802 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894805 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894808 2577 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894811 2577 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894814 2577 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894817 2577 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894820 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894824 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894828 2577 flags.go:64] FLAG: --system-cgroups="" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894831 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894837 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894839 2577 flags.go:64] FLAG: --tls-cert-file="" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894842 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894847 2577 flags.go:64] FLAG: --tls-min-version="" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894850 2577 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894853 2577 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 21:52:54.901757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894857 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 21:52:54.902328 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894860 2577 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 21:52:54.902328 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894863 2577 flags.go:64] FLAG: --v="2" Oct 30 21:52:54.902328 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894868 2577 flags.go:64] FLAG: --version="false" Oct 30 21:52:54.902328 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894872 2577 flags.go:64] FLAG: --vmodule="" Oct 30 21:52:54.902328 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894876 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 21:52:54.902328 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.894880 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 21:52:54.902328 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895053 2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:52:54.902328 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895058 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:52:54.902328 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895061 2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:52:54.902328 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895064 2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:52:54.902328 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895067 2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:52:54.902328 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895069 2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:52:54.902328 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895072 2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:52:54.902328 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895075 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:52:54.902328 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895078 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:52:54.902328 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895081 2577 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:52:54.902328 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895083 2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:52:54.902328 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895086 2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:52:54.902328 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895089 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:52:54.902328 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895092 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:52:54.902328 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895095 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:52:54.902910 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895098 2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:52:54.902910 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895101 2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:52:54.902910 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895106 2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:52:54.902910 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895108 2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:52:54.902910 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895111 2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:52:54.902910 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895113 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:52:54.902910 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895116 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:52:54.902910 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895119 2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:52:54.902910 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895121 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:52:54.902910 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895124 2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:52:54.902910 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895128 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:52:54.902910 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895130 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:52:54.902910 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895133 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:52:54.902910 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895136 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:52:54.902910 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895138 2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:52:54.902910 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895141 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:52:54.902910 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895144 2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:52:54.902910 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895148 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:52:54.902910 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895152 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:52:54.903434 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895155 2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:52:54.903434 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895158 2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:52:54.903434 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895160 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:52:54.903434 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895163 2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:52:54.903434 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895168 2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:52:54.903434 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895172 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:52:54.903434 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895175 2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:52:54.903434 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895178 2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:52:54.903434 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895181 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:52:54.903434 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895183 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:52:54.903434 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895186 2577 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:52:54.903434 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895189 2577 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:52:54.903434 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895192 2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:52:54.903434 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895195 2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:52:54.903434 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895197 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:52:54.903434 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895202 2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:52:54.903434 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895204 2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:52:54.903434 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895207 2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:52:54.903434 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895210 2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:52:54.903434 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895213 2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:52:54.903924 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895215 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:52:54.903924 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895218 2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:52:54.903924 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895220 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:52:54.903924 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895224 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:52:54.903924 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895227 2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:52:54.903924 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895229 2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:52:54.903924 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895232 2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:52:54.903924 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895234 2577 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:52:54.903924 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895237 2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:52:54.903924 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895239 2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:52:54.903924 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895242 2577 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:52:54.903924 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895245 2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:52:54.903924 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895247 2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:52:54.903924 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895250 2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:52:54.903924 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895252 2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:52:54.903924 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895255 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:52:54.903924 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895258 2577 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:52:54.903924 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895260 2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:52:54.903924 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895263 2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:52:54.904390 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895266 2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:52:54.904390 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895268 2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:52:54.904390 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895271 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:52:54.904390 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895273 2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:52:54.904390 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895276 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:52:54.904390 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895279 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:52:54.904390 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895281 2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:52:54.904390 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895285 2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:52:54.904390 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895288 2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:52:54.904390 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895291 2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:52:54.904390 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895294 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:52:54.904390 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895297 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:52:54.904390 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895299 2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:52:54.904390 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895302 2577 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:52:54.904390 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895304 2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:52:54.904390 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895307 2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:52:54.904390 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895311 2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:52:54.904390 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895313 2577 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:52:54.904390 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895316 2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:52:54.904390 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895319 2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:52:54.904861 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895321 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:52:54.904861 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895324 2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:52:54.904861 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895326 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:52:54.904861 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895329 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:52:54.904861 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895331 2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:52:54.904861 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895334 2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:52:54.904861 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895337 2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:52:54.904861 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895339 2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:52:54.904861 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895342 2577 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:52:54.904861 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895344 2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:52:54.904861 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895347 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:52:54.904861 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895349 2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:52:54.904861 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895352 2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:52:54.904861 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.895391 2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 21:52:54.904861 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895431 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:52:54.904861 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895436 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:52:54.905234 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895439 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:52:54.905234 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895442 2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:52:54.905234 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895445 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:52:54.905234 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895449 2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:52:54.905234 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895455 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:52:54.905234 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895459 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:52:54.905234 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895462 2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:52:54.905234 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895465 2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:52:54.905234 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895468 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:52:54.905234 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895471 2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:52:54.905234 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895475 2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:52:54.905234 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895479 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:52:54.905234 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895482 2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:52:54.905234 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895486 2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:52:54.905234 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895489 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:52:54.905234 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895491 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:52:54.905234 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895494 2577 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:52:54.905234 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895497 2577 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:52:54.905234 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895500 2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:52:54.905758 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895502 2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:52:54.905758 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895505 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:52:54.905758 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895508 2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:52:54.905758 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895511 2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:52:54.905758 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895514 2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:52:54.905758 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895517 2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:52:54.905758 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895519 2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:52:54.905758 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895522 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:52:54.905758 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895525 2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:52:54.905758 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895527 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:52:54.905758 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895530 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:52:54.905758 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895532 2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:52:54.905758 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895535 2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:52:54.905758 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895538 2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:52:54.905758 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895540 2577 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:52:54.905758 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895543 2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:52:54.905758 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895546 2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:52:54.905758 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895549 2577 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:52:54.905758 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895552 2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:52:54.905758 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895555 2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:52:54.906217 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895558 2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:52:54.906217 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895560 2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:52:54.906217 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895563 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:52:54.906217 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895566 2577 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:52:54.906217 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895569 2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:52:54.906217 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895571 2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:52:54.906217 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895575 2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:52:54.906217 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895578 2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:52:54.906217 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895580 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:52:54.906217 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895583 2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:52:54.906217 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895587 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:52:54.906217 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895589 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:52:54.906217 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895592 2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:52:54.906217 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895594 2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:52:54.906217 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895597 2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:52:54.906217 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895600 2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:52:54.906217 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895603 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:52:54.906217 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895605 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:52:54.906217 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895608 2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:52:54.906217 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895611 2577 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:52:54.906679 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895613 2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:52:54.906679 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895616 2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:52:54.906679 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895619 2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:52:54.906679 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895621 2577 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:52:54.906679 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895624 2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:52:54.906679 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895627 2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:52:54.906679 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895629 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:52:54.906679 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895632 2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:52:54.906679 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895635 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:52:54.906679 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895637 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:52:54.906679 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895640 2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:52:54.906679 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895643 2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:52:54.906679 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895646 2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:52:54.906679 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895648 2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:52:54.906679 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895651 2577 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:52:54.906679 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895653 2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:52:54.906679 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895656 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:52:54.906679 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895658 2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:52:54.906679 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895663 2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:52:54.906679 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895665 2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:52:54.907240 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895668 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:52:54.907240 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895671 2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:52:54.907240 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895673 2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:52:54.907240 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895676 2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:52:54.907240 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895678 2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:52:54.907240 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895681 2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:52:54.907240 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895684 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:52:54.907240 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895687 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:52:54.907240 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895689 2577 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:52:54.907240 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895692 2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:52:54.907240 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895695 2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:52:54.907240 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895697 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:52:54.907240 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895700 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:52:54.907240 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895703 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:52:54.907240 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895705 2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:52:54.907240 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895708 2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:52:54.907240 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895711 2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:52:54.907240 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895714 2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:52:54.907240 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895717 2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:52:54.907709 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895719 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:52:54.907709 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895722 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:52:54.907709 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895724 2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:52:54.907709 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895727 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:52:54.907709 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895729 2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:52:54.907709 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.895733 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:52:54.907709 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.903036 2577 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 21:52:54.907709 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.903055 2577 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 21:52:54.907709 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.903072 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 21:52:54.907709 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.903076 2577 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 21:52:54.907709 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903136 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:52:54.907709 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903142 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:52:54.907709 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903146 2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:52:54.907709 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903149 2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:52:54.907709 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903152 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:52:54.907709 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903155 2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:52:54.907709 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903158 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:52:54.907709 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903161 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:52:54.907709 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903163 2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:52:54.908229 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903166 2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:52:54.908229 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903169 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:52:54.908229 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903172 2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:52:54.908229 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903175 2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:52:54.908229 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903177 2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:52:54.908229 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903181 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:52:54.908229 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903184 2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:52:54.908229 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903186 2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:52:54.908229 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903189 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:52:54.908229 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903192 2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:52:54.908229 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903195 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:52:54.908229 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903197 2577 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:52:54.908229 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903200 2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:52:54.908229 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903202 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:52:54.908229 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903205 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:52:54.908229 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903208 2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:52:54.908229 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903210 2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:52:54.908229 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903213 2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:52:54.908229 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903215 2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:52:54.908229 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903218 2577 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:52:54.908822 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903221 2577 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:52:54.908822 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903224 2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:52:54.908822 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903227 2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:52:54.908822 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903229 2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:52:54.908822 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903232 2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:52:54.908822 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903235 2577 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:52:54.908822 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903238 2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:52:54.908822 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903240 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:52:54.908822 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903243 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:52:54.908822 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903245 2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:52:54.908822 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903248 2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:52:54.908822 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903250 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:52:54.908822 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903253 2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:52:54.908822 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903255 2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:52:54.908822 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903258 2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:52:54.908822 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903261 2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:52:54.908822 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903263 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:52:54.908822 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903266 2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:52:54.908822 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903270 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:52:54.908822 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903273 2577 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:52:54.909330 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903275 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:52:54.909330 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903279 2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:52:54.909330 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903283 2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:52:54.909330 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903286 2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:52:54.909330 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903289 2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:52:54.909330 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903291 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:52:54.909330 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903294 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:52:54.909330 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903296 2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:52:54.909330 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903299 2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:52:54.909330 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903302 2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:52:54.909330 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903304 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:52:54.909330 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903306 2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:52:54.909330 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903310 2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:52:54.909330 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903313 2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:52:54.909330 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903315 2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:52:54.909330 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903318 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:52:54.909330 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903321 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:52:54.909330 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903324 2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:52:54.909330 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903326 2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:52:54.909807 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903329 2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:52:54.909807 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903332 2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:52:54.909807 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903334 2577 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:52:54.909807 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903350 2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:52:54.909807 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903354 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:52:54.909807 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903358 2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:52:54.909807 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903361 2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:52:54.909807 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903364 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:52:54.909807 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903367 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:52:54.909807 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903370 2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:52:54.909807 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903372 2577 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:52:54.909807 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903375 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:52:54.909807 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903393 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:52:54.909807 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903397 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:52:54.909807 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903401 2577 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:52:54.909807 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903405 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:52:54.909807 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903408 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:52:54.909807 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903411 2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:52:54.909807 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903413 2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:52:54.909807 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903416 2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:52:54.910510 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903419 2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:52:54.910510 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903421 2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:52:54.910510 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903424 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:52:54.910510 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903427 2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:52:54.910510 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903430 2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:52:54.910510 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903434 2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:52:54.910510 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903437 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:52:54.910510 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903440 2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:52:54.910510 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903443 2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:52:54.910510 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903446 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:52:54.910510 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903449 2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:52:54.910510 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903452 2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:52:54.910510 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903454 2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:52:54.910510 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903459 2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:52:54.910510 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903463 2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:52:54.910510 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903466 2577 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:52:54.910510 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903469 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:52:54.910510 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903471 2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:52:54.910995 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.903502 2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 21:52:54.910995 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903651 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:52:54.910995 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903656 2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:52:54.910995 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903659 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:52:54.910995 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903662 2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:52:54.910995 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903664 2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:52:54.910995 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903667 2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:52:54.910995 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903670 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:52:54.910995 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903673 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:52:54.910995 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903675 2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:52:54.910995 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903678 2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:52:54.910995 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903681 2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:52:54.910995 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903683 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:52:54.910995 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903686 2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:52:54.910995 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903688 2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:52:54.910995 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903691 2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:52:54.911561 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903694 2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:52:54.911561 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903696 2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:52:54.911561 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903699 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:52:54.911561 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903702 2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:52:54.911561 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903705 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:52:54.911561 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903708 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:52:54.911561 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903711 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:52:54.911561 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903714 2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:52:54.911561 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903716 2577 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:52:54.911561 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903719 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:52:54.911561 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903722 2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:52:54.911561 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903724 2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:52:54.911561 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903727 2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:52:54.911561 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903729 2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:52:54.911561 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903732 2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:52:54.911561 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903735 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:52:54.911561 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903737 2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:52:54.911561 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903740 2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:52:54.911561 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903742 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:52:54.911561 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903745 2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:52:54.912321 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903748 2577 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:52:54.912321 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903750 2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:52:54.912321 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903752 2577 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:52:54.912321 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903755 2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:52:54.912321 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903758 2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:52:54.912321 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903760 2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:52:54.912321 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903763 2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:52:54.912321 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903767 2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:52:54.912321 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903771 2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:52:54.912321 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903774 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:52:54.912321 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903777 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:52:54.912321 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903780 2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:52:54.912321 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903782 2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:52:54.912321 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903785 2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:52:54.912321 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903787 2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:52:54.912321 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903790 2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:52:54.912321 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903793 2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:52:54.912321 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903796 2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:52:54.912321 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903798 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:52:54.912946 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903801 2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:52:54.912946 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903803 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:52:54.912946 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903806 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:52:54.912946 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903808 2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:52:54.912946 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903811 2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:52:54.912946 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903813 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:52:54.912946 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903815 2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:52:54.912946 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903818 2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:52:54.912946 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903820 2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:52:54.912946 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903823 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:52:54.912946 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903825 2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:52:54.912946 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903828 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:52:54.912946 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903831 2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:52:54.912946 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903833 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:52:54.912946 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903836 2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:52:54.912946 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903838 2577 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:52:54.912946 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903841 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:52:54.912946 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903844 2577 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:52:54.912946 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903847 2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:52:54.912946 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903849 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:52:54.913474 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903852 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:52:54.913474 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903855 2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:52:54.913474 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903857 2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:52:54.913474 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903860 2577 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:52:54.913474 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903863 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:52:54.913474 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903865 2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:52:54.913474 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903868 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:52:54.913474 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903871 2577 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:52:54.913474 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903873 2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:52:54.913474 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903876 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:52:54.913474 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903878 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:52:54.913474 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903881 2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:52:54.913474 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903884 2577 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:52:54.913474 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903886 2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:52:54.913474 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903889 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:52:54.913474 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903891 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:52:54.913474 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903894 2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:52:54.913474 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903896 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:52:54.913474 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903899 2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:52:54.913474 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903901 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:52:54.913986 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903904 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:52:54.913986 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903906 2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:52:54.913986 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903909 2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:52:54.913986 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903911 2577 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:52:54.913986 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903914 2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:52:54.913986 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903917 2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:52:54.913986 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903920 2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:52:54.913986 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903923 2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:52:54.913986 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903927 2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:52:54.913986 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903930 2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:52:54.913986 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903933 2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:52:54.913986 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903937 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:52:54.913986 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.903959 2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 21:52:54.913986 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903992 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:52:54.913986 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.903997 2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:52:54.914338 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904000 2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:52:54.914338 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904003 2577 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:52:54.914338 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904006 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:52:54.914338 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904009 2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:52:54.914338 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904012 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:52:54.914338 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904015 2577 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:52:54.914338 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904018 2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:52:54.914338 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904020 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:52:54.914338 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904023 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:52:54.914338 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904025 2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:52:54.914338 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904028 2577 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:52:54.914338 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904030 2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:52:54.914338 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904033 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:52:54.914338 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904035 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:52:54.914338 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904038 2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:52:54.914338 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904041 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:52:54.914338 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904043 2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:52:54.914338 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904046 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:52:54.914338 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904048 2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:52:54.914338 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904051 2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:52:54.915009 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904053 2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:52:54.915009 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904056 2577 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:52:54.915009 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904058 2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:52:54.915009 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904061 2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:52:54.915009 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904063 2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:52:54.915009 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904067 2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:52:54.915009 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904070 2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:52:54.915009 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904073 2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:52:54.915009 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904076 2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:52:54.915009 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904080 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:52:54.915009 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904084 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:52:54.915009 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904086 2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:52:54.915009 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904089 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:52:54.915009 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904093 2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:52:54.915009 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904095 2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:52:54.915009 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904098 2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:52:54.915009 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904104 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:52:54.915009 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904107 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:52:54.915009 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904109 2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:52:54.915593 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904112 2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:52:54.915593 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904114 2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:52:54.915593 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904117 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:52:54.915593 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904119 2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:52:54.915593 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904122 2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:52:54.915593 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904124 2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:52:54.915593 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904127 2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:52:54.915593 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904129 2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:52:54.915593 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904132 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:52:54.915593 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904135 2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:52:54.915593 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904137 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:52:54.915593 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904139 2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:52:54.915593 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904142 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:52:54.915593 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904144 2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:52:54.915593 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904147 2577 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:52:54.915593 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904149 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:52:54.915593 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904151 2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:52:54.915593 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904154 2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:52:54.915593 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904157 2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:52:54.916079 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904159 2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:52:54.916079 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904162 2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:52:54.916079 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904164 2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:52:54.916079 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904166 2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:52:54.916079 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904181 2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:52:54.916079 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904184 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:52:54.916079 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904186 2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:52:54.916079 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904188 2577 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:52:54.916079 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904191 2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:52:54.916079 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904193 2577 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:52:54.916079 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904198 2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:52:54.916079 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904200 2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:52:54.916079 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904203 2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:52:54.916079 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904205 2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:52:54.916079 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904209 2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:52:54.916079 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904213 2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:52:54.916079 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904216 2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:52:54.916079 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904219 2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:52:54.916079 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904221 2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:52:54.916675 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904223 2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:52:54.916675 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904226 2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:52:54.916675 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904228 2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:52:54.916675 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904231 2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:52:54.916675 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904234 2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:52:54.916675 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904236 2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:52:54.916675 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904239 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:52:54.916675 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904241 2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:52:54.916675 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904244 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:52:54.916675 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904246 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:52:54.916675 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904249 2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:52:54.916675 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904251 2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:52:54.916675 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904253 2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:52:54.916675 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904256 2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:52:54.916675 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904258 2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:52:54.916675 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904261 2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:52:54.916675 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904263 2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:52:54.916675 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904265 2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:52:54.916675 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904271 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:52:54.917136 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904273 2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:52:54.917136 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904276 2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:52:54.917136 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904278 2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:52:54.917136 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904281 2577 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:52:54.917136 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904285 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:52:54.917136 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904288 2577 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:52:54.917136 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904290 2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:52:54.917136 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:54.904294 2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:52:54.917136 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.904352 2577 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 21:52:54.917136 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.906929 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Oct 30 21:52:54.917136 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.908053 2577 server.go:1014] "Starting client certificate rotation" Oct 30 21:52:54.917136 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.908186 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 21:52:54.917136 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.908245 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 21:52:54.917136 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.910276 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 21:52:54.917136 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.916284 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 21:52:54.925019 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.925002 2577 log.go:25] "Validated CRI v1 runtime API" Oct 30 21:52:54.929251 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.929234 2577 log.go:25] "Validated CRI v1 image API" Oct 30 21:52:54.930196 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.930165 2577 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 21:52:54.936351 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.936329 2577 fs.go:135] Filesystem UUIDs: map[79c19ff3-9b2a-4ac8-933c-44bc71cbd872:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a2025e27-464a-4c64-bce3-6350b6ecc480:/dev/nvme0n1p4] Oct 30 21:52:54.936449 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.936349 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Oct 30 21:52:54.942334 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.942205 2577 manager.go:217] Machine: {Timestamp:2026-10-30 21:52:54.940721123 +0000 UTC m=+0.384269233 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3183022 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e7805f08a27c4c9835f030cffbe4d SystemUUID:ec2e7805-f08a-27c4-c983-5f030cffbe4d BootID:690afed8-6836-4034-a2bb-ffbde2a562ac Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ff:59:0c:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ff:59:0c:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:17:89:9a:56:d4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 21:52:54.942334 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.942328 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 21:52:54.942474 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.942426 2577 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 21:52:54.944439 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.944423 2577 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 21:52:54.945879 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.945851 2577 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 21:52:54.946063 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.945886 2577 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-4.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 21:52:54.946152 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.946067 2577 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 21:52:54.946152 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.946080 2577 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 21:52:54.946152 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.946130 2577 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 21:52:54.946250 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.946156 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 21:52:54.947516 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.947499 2577 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 21:52:54.952257 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.952239 2577 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 21:52:54.952475 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.952462 2577 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 21:52:54.952538 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.952509 2577 kubelet.go:493] "Attempting to sync node with API server" Oct 30 21:52:54.952538 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.952524 2577 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 21:52:54.952625 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.952545 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 21:52:54.952625 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.952561 2577 kubelet.go:405] "Adding apiserver pod source" Oct 30 21:52:54.952625 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.952574 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 21:52:54.952947 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.952933 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 21:52:54.955803 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.955782 2577 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 21:52:54.963002 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.962961 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 21:52:54.963941 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.963928 2577 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 21:52:54.963999 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.963959 2577 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 21:52:54.964121 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.964109 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 21:52:54.964163 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.964125 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 21:52:54.964163 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.964132 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 21:52:54.964163 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.964138 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 21:52:54.964163 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.964144 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 21:52:54.964163 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.964149 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 21:52:54.964865 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.964857 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 21:52:54.964900 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.964866 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 21:52:54.964900 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.964874 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 21:52:54.964900 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.964880 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 21:52:54.964900 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.964888 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 21:52:54.964900 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.964898 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 21:52:54.965514 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.965505 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 21:52:54.965514 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.965514 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 21:52:54.967762 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.967741 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jrhlh" Oct 30 21:52:54.969631 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.969618 2577 server.go:1263] "Started kubelet" Oct 30 21:52:54.969752 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.969727 2577 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 21:52:54.970065 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.970022 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 21:52:54.970107 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.970087 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 21:52:54.970359 ip-10-0-137-4 systemd[1]: Started Kubernetes Kubelet. Oct 30 21:52:54.970888 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.970410 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-4.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 30 21:52:54.971577 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.971555 2577 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 21:52:54.972990 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.972978 2577 server.go:317] "Adding debug handlers to kubelet server" Oct 30 21:52:54.979084 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:54.979049 2577 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Oct 30 21:52:54.979214 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.979199 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jrhlh" Oct 30 21:52:54.981002 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:54.980979 2577 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Oct 30 21:52:54.981278 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:54.981254 2577 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-4.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Oct 30 21:52:54.982316 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:54.981164 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-4.us-east-2.compute.internal.18e36d3a93407613 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-4.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-4.us-east-2.compute.internal,},FirstTimestamp:2026-10-30 21:52:54.969595411 +0000 UTC m=+0.413143521,LastTimestamp:2026-10-30 21:52:54.969595411 +0000 UTC m=+0.413143521,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-4.us-east-2.compute.internal,}" Oct 30 21:52:54.983660 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.983639 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 21:52:54.985023 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.985007 2577 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 21:52:54.985127 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:54.985112 2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-4.us-east-2.compute.internal\" not found" Oct 30 21:52:54.985767 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.985739 2577 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 21:52:54.985852 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.985761 2577 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 21:52:54.985852 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.985740 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 21:52:54.985944 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.985890 2577 reconstruct.go:97] "Volume reconstruction finished" Oct 30 21:52:54.985944 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.985899 2577 reconciler.go:29] "Reconciler: start to sync state" Oct 30 21:52:54.986116 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.986103 2577 factory.go:55] Registering systemd factory Oct 30 21:52:54.986153 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.986120 2577 factory.go:223] Registration of the systemd container factory successfully Oct 30 21:52:54.986337 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.986323 2577 factory.go:153] Registering CRI-O factory Oct 30 21:52:54.986393 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.986341 2577 factory.go:223] Registration of the crio container factory successfully Oct 30 21:52:54.986433 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.986425 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 21:52:54.986465 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.986441 2577 factory.go:103] Registering Raw factory Oct 30 21:52:54.986465 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.986453 2577 manager.go:1199] Started watching for new ooms in manager Oct 30 21:52:54.987609 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.987578 2577 manager.go:319] Starting recovery of all containers Oct 30 21:52:54.988026 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:54.987860 2577 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-4.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Oct 30 21:52:54.994198 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.994172 2577 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:52:54.995053 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.995018 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 21:52:54.999935 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:54.999506 2577 manager.go:324] Recovery completed Oct 30 21:52:55.005317 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.005300 2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:52:55.009138 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.009119 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 21:52:55.009228 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.009151 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 21:52:55.009228 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.009162 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 21:52:55.009795 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.009779 2577 cpu_manager.go:226] "Starting" policy="none" Oct 30 21:52:55.009795 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.009794 2577 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 21:52:55.009884 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.009802 2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:52:55.009884 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.009814 2577 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 21:52:55.010632 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.010613 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 21:52:55.010705 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.010644 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 21:52:55.010705 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.010654 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 21:52:55.012000 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.011986 2577 policy_none.go:50] "Start" Oct 30 21:52:55.012050 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.012006 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 21:52:55.012050 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.012020 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 21:52:55.014233 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.014221 2577 policy_none.go:44] "Start" Oct 30 21:52:55.070170 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.047186 2577 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 21:52:55.070170 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.051746 2577 manager.go:341] "Starting Device Plugin manager" Oct 30 21:52:55.070170 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:55.051775 2577 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 21:52:55.070170 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.051784 2577 server.go:87] "Starting device plugin registration server" Oct 30 21:52:55.070170 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.052011 2577 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 21:52:55.070170 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.052020 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 21:52:55.070170 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.052134 2577 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 21:52:55.070170 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.052220 2577 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 21:52:55.070170 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.052227 2577 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 21:52:55.070170 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:55.052777 2577 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 21:52:55.070170 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:55.052825 2577 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-4.us-east-2.compute.internal\" not found" Oct 30 21:52:55.070170 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.063638 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 21:52:55.070170 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.063663 2577 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 21:52:55.070170 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.063682 2577 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 21:52:55.070170 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:55.063712 2577 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Oct 30 21:52:55.070170 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.067687 2577 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:52:55.154345 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.154250 2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:52:55.155359 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.155342 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 21:52:55.155475 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.155398 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 21:52:55.155475 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.155416 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 21:52:55.155475 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.155451 2577 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:52:55.163873 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.163851 2577 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal"] Oct 30 21:52:55.163942 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.163911 2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:52:55.164828 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.164810 2577 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:52:55.164885 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:55.164839 2577 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-4.us-east-2.compute.internal\": node \"ip-10-0-137-4.us-east-2.compute.internal\" not found" Oct 30 21:52:55.165835 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.165819 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 21:52:55.165905 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.165847 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 21:52:55.165905 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.165858 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 21:52:55.168144 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.168131 2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:52:55.168325 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.168312 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:52:55.168360 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.168344 2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:52:55.169011 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.168995 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 21:52:55.169011 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.169004 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 21:52:55.169151 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.169023 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 21:52:55.169151 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.169028 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 21:52:55.169151 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.169036 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 21:52:55.169151 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.169042 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 21:52:55.171188 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.171169 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:52:55.171291 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.171208 2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:52:55.172039 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.172023 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 21:52:55.172120 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.172055 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 21:52:55.172120 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.172071 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 21:52:55.184740 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:55.184718 2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-4.us-east-2.compute.internal\" not found" Oct 30 21:52:55.187077 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.187057 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ce9e46bc8cc07006aa910618f31ad4ad-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal\" (UID: \"ce9e46bc8cc07006aa910618f31ad4ad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:52:55.187178 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.187083 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce9e46bc8cc07006aa910618f31ad4ad-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal\" (UID: \"ce9e46bc8cc07006aa910618f31ad4ad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:52:55.187178 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.187115 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/217839645ba686b08e18edb27afa5bea-config\") pod \"kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal\" (UID: \"217839645ba686b08e18edb27afa5bea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:52:55.189914 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:55.189896 2577 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-4.us-east-2.compute.internal\" not found" node="ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:52:55.191883 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:55.191868 2577 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-4.us-east-2.compute.internal\" not found" node="ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:52:55.285094 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:55.285058 2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-4.us-east-2.compute.internal\" not found" Oct 30 21:52:55.287872 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.287839 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ce9e46bc8cc07006aa910618f31ad4ad-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal\" (UID: \"ce9e46bc8cc07006aa910618f31ad4ad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:52:55.287992 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.287879 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce9e46bc8cc07006aa910618f31ad4ad-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal\" (UID: \"ce9e46bc8cc07006aa910618f31ad4ad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:52:55.287992 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.287897 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/217839645ba686b08e18edb27afa5bea-config\") pod \"kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal\" (UID: \"217839645ba686b08e18edb27afa5bea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:52:55.287992 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.287926 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce9e46bc8cc07006aa910618f31ad4ad-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal\" (UID: \"ce9e46bc8cc07006aa910618f31ad4ad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:52:55.287992 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.287936 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ce9e46bc8cc07006aa910618f31ad4ad-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal\" (UID: \"ce9e46bc8cc07006aa910618f31ad4ad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:52:55.287992 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.287970 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/217839645ba686b08e18edb27afa5bea-config\") pod \"kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal\" (UID: \"217839645ba686b08e18edb27afa5bea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:52:55.386119 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:55.386085 2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-4.us-east-2.compute.internal\" not found" Oct 30 21:52:55.486804 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:55.486745 2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-4.us-east-2.compute.internal\" not found" Oct 30 21:52:55.495066 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.495047 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:52:55.497200 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.497181 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:52:55.587658 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:55.587623 2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-4.us-east-2.compute.internal\" not found" Oct 30 21:52:55.688165 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:55.688129 2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-4.us-east-2.compute.internal\" not found" Oct 30 21:52:55.788712 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:55.788644 2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-4.us-east-2.compute.internal\" not found" Oct 30 21:52:55.889073 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:55.889033 2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-4.us-east-2.compute.internal\" not found" Oct 30 21:52:55.907779 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.907748 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Oct 30 21:52:55.907936 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.907914 2577 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 30 21:52:55.907989 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.907947 2577 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 30 21:52:55.986781 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.986713 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 21:47:55 +0000 UTC" deadline="2028-06-12 17:36:40.196462358 +0000 UTC" Oct 30 21:52:55.986781 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:55.986770 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14179h43m44.209695038s" Oct 30 21:52:55.989930 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:55.989903 2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-4.us-east-2.compute.internal\" not found" Oct 30 21:52:56.030567 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.030536 2577 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:52:56.085566 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.085490 2577 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:52:56.100956 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.100932 2577 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 21:52:56.103141 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.103125 2577 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:52:56.114931 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.114913 2577 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 21:52:56.161482 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:56.161450 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod217839645ba686b08e18edb27afa5bea.slice/crio-918bc16854f8b256806e858af35b666017637fc2a51c4538e8a603ab83020f5e WatchSource:0}: Error finding container 918bc16854f8b256806e858af35b666017637fc2a51c4538e8a603ab83020f5e: Status 404 returned error can't find the container with id 918bc16854f8b256806e858af35b666017637fc2a51c4538e8a603ab83020f5e Oct 30 21:52:56.161899 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:56.161880 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce9e46bc8cc07006aa910618f31ad4ad.slice/crio-df0c845c843ba4846071f06ed65ee59bbe7b2dbe9485a7bddd8eb5c6ee64e311 WatchSource:0}: Error finding container df0c845c843ba4846071f06ed65ee59bbe7b2dbe9485a7bddd8eb5c6ee64e311: Status 404 returned error can't find the container with id df0c845c843ba4846071f06ed65ee59bbe7b2dbe9485a7bddd8eb5c6ee64e311 Oct 30 21:52:56.167880 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.167856 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 21:52:56.412661 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.412624 2577 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:52:56.953763 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.953719 2577 apiserver.go:52] "Watching apiserver" Oct 30 21:52:56.964536 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.964487 2577 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 21:52:56.965115 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.965090 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-dzt7m","kube-system/konnectivity-agent-mrg22","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal","openshift-multus/multus-additional-cni-plugins-hkqj8","kube-system/global-pull-secret-syncer-kczg2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb","openshift-dns/node-resolver-x5d7s","openshift-multus/network-metrics-daemon-ktz7g","openshift-ovn-kubernetes/ovnkube-node-b9xpx","kube-system/kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal","openshift-image-registry/node-ca-7zg8j","openshift-multus/multus-srvpr","openshift-network-operator/iptables-alerter-nwd9g","openshift-cluster-node-tuning-operator/tuned-wrp44"] Oct 30 21:52:56.968101 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.968075 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:56.971224 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.971206 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mrg22" Oct 30 21:52:56.973286 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.973267 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 21:52:56.973534 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.973514 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 21:52:56.973633 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.973564 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 21:52:56.973891 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.973866 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-srvpr" Oct 30 21:52:56.975019 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.974994 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 21:52:56.975238 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.975223 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 21:52:56.975312 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.975287 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 21:52:56.975472 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.975378 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pzcl5\"" Oct 30 21:52:56.976122 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.975850 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7zg8j" Oct 30 21:52:56.977247 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.977228 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-7pfmv\"" Oct 30 21:52:56.979143 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.978811 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x5d7s" Oct 30 21:52:56.980005 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.979984 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 21:52:56.980196 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.980174 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 21:52:56.980975 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.980955 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:52:56.983598 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.983577 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 21:52:56.983785 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.983764 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 21:52:56.983877 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.983816 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 21:52:56.983941 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.983880 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-hgb4n\"" Oct 30 21:52:56.983941 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.983904 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 21:52:56.984071 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.983974 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ddnf5\"" Oct 30 21:52:56.984071 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.983990 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:52:56.984071 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.983999 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 21:52:56.984071 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.984062 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 21:52:56.984275 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.984088 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 21:52:56.984275 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:56.984079 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzt7m" podUID="363de559-91e1-406d-bdec-36438ab7a186" Oct 30 21:52:56.985290 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.985261 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Oct 30 21:52:56.986167 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.986146 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:52:56.986289 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:56.986213 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktz7g" podUID="e28f054c-44b5-4b39-9813-a547c1b41f04" Oct 30 21:52:56.986511 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.986491 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 21:52:56.987061 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.986643 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 21:52:56.987061 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.986705 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 21:52:56.987061 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.986808 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 21:52:56.987061 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.986923 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 21:52:56.987061 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.986972 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q26ql\"" Oct 30 21:52:56.987061 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.986987 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4xh5g\"" Oct 30 21:52:56.988570 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.988549 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:52:56.988729 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:56.988619 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kczg2" podUID="0081a009-4575-4b35-bf6b-6d12dd90067b" Oct 30 21:52:56.991133 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.991114 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:52:56.993882 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.993856 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nwd9g" Oct 30 21:52:56.996340 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.996320 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:56.999016 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.998866 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:52:56.999016 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.998907 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktv45\" (UniqueName: \"kubernetes.io/projected/6f4b3be4-a694-497b-9fc5-ae54afc372d5-kube-api-access-ktv45\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:56.999016 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.998928 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-cni-bin\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:56.999016 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.998952 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs\") pod \"network-metrics-daemon-ktz7g\" (UID: \"e28f054c-44b5-4b39-9813-a547c1b41f04\") " pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:52:56.999016 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.998990 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9gzz\" (UniqueName: \"kubernetes.io/projected/e28f054c-44b5-4b39-9813-a547c1b41f04-kube-api-access-q9gzz\") pod \"network-metrics-daemon-ktz7g\" (UID: \"e28f054c-44b5-4b39-9813-a547c1b41f04\") " pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:52:56.999371 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999042 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-run-netns\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:56.999371 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999081 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:56.999371 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999108 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-kubelet\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:56.999371 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999167 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-system-cni-dir\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:56.999371 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999221 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck7bh\" (UniqueName: \"kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh\") pod \"network-check-target-dzt7m\" (UID: \"363de559-91e1-406d-bdec-36438ab7a186\") " pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:52:56.999371 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999244 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0081a009-4575-4b35-bf6b-6d12dd90067b-kubelet-config\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:52:56.999371 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999264 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-run-systemd\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:56.999371 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999295 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-socket-dir-parent\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:56.999371 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999323 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-var-lib-cni-bin\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:56.999371 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999357 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-etc-kubernetes\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:56.999799 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999447 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhzxg\" (UniqueName: \"kubernetes.io/projected/30d5a352-fc59-4709-9d83-0a756367d9e5-kube-api-access-hhzxg\") pod \"node-ca-7zg8j\" (UID: \"30d5a352-fc59-4709-9d83-0a756367d9e5\") " pod="openshift-image-registry/node-ca-7zg8j" Oct 30 21:52:56.999799 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999495 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-node-log\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:56.999799 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999511 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6f4b3be4-a694-497b-9fc5-ae54afc372d5-ovnkube-config\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:56.999799 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999526 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/30d5a352-fc59-4709-9d83-0a756367d9e5-serviceca\") pod \"node-ca-7zg8j\" (UID: \"30d5a352-fc59-4709-9d83-0a756367d9e5\") " pod="openshift-image-registry/node-ca-7zg8j" Oct 30 21:52:56.999799 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999541 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30d5a352-fc59-4709-9d83-0a756367d9e5-host\") pod \"node-ca-7zg8j\" (UID: \"30d5a352-fc59-4709-9d83-0a756367d9e5\") " pod="openshift-image-registry/node-ca-7zg8j" Oct 30 21:52:56.999799 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999556 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-cni-netd\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:56.999799 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999571 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsccl\" (UniqueName: \"kubernetes.io/projected/1928dc59-9826-41df-8599-fce8ce310d74-kube-api-access-wsccl\") pod \"node-resolver-x5d7s\" (UID: \"1928dc59-9826-41df-8599-fce8ce310d74\") " pod="openshift-dns/node-resolver-x5d7s" Oct 30 21:52:56.999799 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999621 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-var-lib-cni-multus\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:56.999799 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999653 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-var-lib-kubelet\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:56.999799 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999709 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl2xm\" (UniqueName: \"kubernetes.io/projected/eb862971-cdab-42db-8255-f8fee7a7df41-kube-api-access-dl2xm\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:52:56.999799 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999761 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1928dc59-9826-41df-8599-fce8ce310d74-tmp-dir\") pod \"node-resolver-x5d7s\" (UID: \"1928dc59-9826-41df-8599-fce8ce310d74\") " pod="openshift-dns/node-resolver-x5d7s" Oct 30 21:52:57.000135 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999856 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-systemd-units\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.000135 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999885 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-etc-openvswitch\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.000135 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999928 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-hostroot\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.000135 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999952 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-etc-selinux\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:52:57.000135 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:56.999984 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-run-netns\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.000135 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.000011 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-daemon-config\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.000135 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.000074 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj5j4\" (UniqueName: \"kubernetes.io/projected/39ebed07-3b7e-4027-93b0-f9c2b83802ab-kube-api-access-kj5j4\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.000135 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.000098 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-cnibin\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.000135 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.000130 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.000421 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.000182 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-registration-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:52:57.000421 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.000215 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1928dc59-9826-41df-8599-fce8ce310d74-hosts-file\") pod \"node-resolver-x5d7s\" (UID: \"1928dc59-9826-41df-8599-fce8ce310d74\") " pod="openshift-dns/node-resolver-x5d7s" Oct 30 21:52:57.000421 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.000255 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-conf-dir\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.000421 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.000292 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-socket-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:52:57.000597 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.000444 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6f4b3be4-a694-497b-9fc5-ae54afc372d5-env-overrides\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.000597 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.000498 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6f4b3be4-a694-497b-9fc5-ae54afc372d5-ovnkube-script-lib\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.000597 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.000555 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:52:57.000749 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.000608 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-run-ovn\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.000749 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.000666 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-log-socket\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.000749 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.000705 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-device-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:52:57.000905 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.000749 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0081a009-4575-4b35-bf6b-6d12dd90067b-dbus\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:52:57.000905 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.000779 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dcb86fdd-20cd-45b3-8533-a6900b903f13-konnectivity-ca\") pod \"konnectivity-agent-mrg22\" (UID: \"dcb86fdd-20cd-45b3-8533-a6900b903f13\") " pod="kube-system/konnectivity-agent-mrg22" Oct 30 21:52:57.000905 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.000814 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-run-openvswitch\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.000905 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.000834 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f4b3be4-a694-497b-9fc5-ae54afc372d5-ovn-node-metrics-cert\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.000905 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.000886 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-cni-dir\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.001058 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.000914 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/39ebed07-3b7e-4027-93b0-f9c2b83802ab-cni-binary-copy\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.001058 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.000968 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-slash\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.001058 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.000998 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-var-lib-openvswitch\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.001058 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.001027 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-run-multus-certs\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.001192 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.001082 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-sys-fs\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:52:57.001192 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.001108 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dcb86fdd-20cd-45b3-8533-a6900b903f13-agent-certs\") pod \"konnectivity-agent-mrg22\" (UID: \"dcb86fdd-20cd-45b3-8533-a6900b903f13\") " pod="kube-system/konnectivity-agent-mrg22" Oct 30 21:52:57.001192 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.001131 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-run-k8s-cni-cncf-io\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.006548 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.006386 2577 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 21:52:57.020278 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.020253 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rjpnp" Oct 30 21:52:57.034191 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.034154 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rjpnp" Oct 30 21:52:57.069244 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.069187 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal" event={"ID":"217839645ba686b08e18edb27afa5bea","Type":"ContainerStarted","Data":"918bc16854f8b256806e858af35b666017637fc2a51c4538e8a603ab83020f5e"} Oct 30 21:52:57.073272 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.073239 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" event={"ID":"ce9e46bc8cc07006aa910618f31ad4ad","Type":"ContainerStarted","Data":"df0c845c843ba4846071f06ed65ee59bbe7b2dbe9485a7bddd8eb5c6ee64e311"} Oct 30 21:52:57.074591 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.074570 2577 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:52:57.081361 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.081339 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 21:52:57.081625 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.081548 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 21:52:57.081625 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.081564 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 21:52:57.081625 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.081603 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 21:52:57.081625 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.081602 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 21:52:57.082061 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.082040 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kxljf\"" Oct 30 21:52:57.082135 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.082087 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gpwbs\"" Oct 30 21:52:57.082174 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.082132 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 21:52:57.082218 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.082202 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-scccg\"" Oct 30 21:52:57.082357 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.082343 2577 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:52:57.082440 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.082377 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 21:52:57.087364 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.087344 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 21:52:57.102370 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102340 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhzxg\" (UniqueName: \"kubernetes.io/projected/30d5a352-fc59-4709-9d83-0a756367d9e5-kube-api-access-hhzxg\") pod \"node-ca-7zg8j\" (UID: \"30d5a352-fc59-4709-9d83-0a756367d9e5\") " pod="openshift-image-registry/node-ca-7zg8j" Oct 30 21:52:57.102542 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102384 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-sysctl-d\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.102542 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102430 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-node-log\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.102542 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102460 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6f4b3be4-a694-497b-9fc5-ae54afc372d5-ovnkube-config\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.102542 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102477 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/30d5a352-fc59-4709-9d83-0a756367d9e5-serviceca\") pod \"node-ca-7zg8j\" (UID: \"30d5a352-fc59-4709-9d83-0a756367d9e5\") " pod="openshift-image-registry/node-ca-7zg8j" Oct 30 21:52:57.102542 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102503 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/82584512-72fe-4964-a8c3-7cacc053025e-cni-binary-copy\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:52:57.102542 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102527 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30d5a352-fc59-4709-9d83-0a756367d9e5-host\") pod \"node-ca-7zg8j\" (UID: \"30d5a352-fc59-4709-9d83-0a756367d9e5\") " pod="openshift-image-registry/node-ca-7zg8j" Oct 30 21:52:57.102911 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102551 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-cni-netd\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.102911 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102576 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsccl\" (UniqueName: \"kubernetes.io/projected/1928dc59-9826-41df-8599-fce8ce310d74-kube-api-access-wsccl\") pod \"node-resolver-x5d7s\" (UID: \"1928dc59-9826-41df-8599-fce8ce310d74\") " pod="openshift-dns/node-resolver-x5d7s" Oct 30 21:52:57.102911 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102603 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-var-lib-cni-multus\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.102911 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102637 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-var-lib-kubelet\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.102911 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102662 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl2xm\" (UniqueName: \"kubernetes.io/projected/eb862971-cdab-42db-8255-f8fee7a7df41-kube-api-access-dl2xm\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:52:57.102911 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102688 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/82584512-72fe-4964-a8c3-7cacc053025e-cnibin\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:52:57.102911 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102712 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1928dc59-9826-41df-8599-fce8ce310d74-tmp-dir\") pod \"node-resolver-x5d7s\" (UID: \"1928dc59-9826-41df-8599-fce8ce310d74\") " pod="openshift-dns/node-resolver-x5d7s" Oct 30 21:52:57.102911 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102736 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-systemd-units\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.102911 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102762 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-etc-openvswitch\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.102911 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102785 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-hostroot\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.102911 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102810 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-etc-selinux\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:52:57.102911 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102855 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-var-lib-kubelet\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.102911 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102878 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6774e634-30d8-4808-9c87-fe25db7fcb9d-tmp\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.102911 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102910 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znz47\" (UniqueName: \"kubernetes.io/projected/6774e634-30d8-4808-9c87-fe25db7fcb9d-kube-api-access-znz47\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.103664 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102938 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-run-netns\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.103664 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102965 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-daemon-config\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.103664 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.102981 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj5j4\" (UniqueName: \"kubernetes.io/projected/39ebed07-3b7e-4027-93b0-f9c2b83802ab-kube-api-access-kj5j4\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.103664 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103000 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbcsw\" (UniqueName: \"kubernetes.io/projected/44e85fdf-12c8-4aaf-8485-4b1ba16ed02f-kube-api-access-qbcsw\") pod \"iptables-alerter-nwd9g\" (UID: \"44e85fdf-12c8-4aaf-8485-4b1ba16ed02f\") " pod="openshift-network-operator/iptables-alerter-nwd9g" Oct 30 21:52:57.103664 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103025 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-kubernetes\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.103664 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103047 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-sysctl-conf\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.103664 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103081 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-cnibin\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.103664 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103107 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-modprobe-d\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.103664 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103131 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.103664 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-registration-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:52:57.103664 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103174 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nlgb\" (UniqueName: \"kubernetes.io/projected/82584512-72fe-4964-a8c3-7cacc053025e-kube-api-access-4nlgb\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:52:57.103664 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103198 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1928dc59-9826-41df-8599-fce8ce310d74-hosts-file\") pod \"node-resolver-x5d7s\" (UID: \"1928dc59-9826-41df-8599-fce8ce310d74\") " pod="openshift-dns/node-resolver-x5d7s" Oct 30 21:52:57.103664 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103221 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-conf-dir\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.103664 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103240 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/82584512-72fe-4964-a8c3-7cacc053025e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:52:57.103664 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103256 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-sysconfig\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.103664 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103281 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-run\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.103664 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103297 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-socket-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:52:57.104649 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103314 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6f4b3be4-a694-497b-9fc5-ae54afc372d5-env-overrides\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.104649 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103330 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6f4b3be4-a694-497b-9fc5-ae54afc372d5-ovnkube-script-lib\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.104649 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103346 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:52:57.104649 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103370 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44e85fdf-12c8-4aaf-8485-4b1ba16ed02f-host-slash\") pod \"iptables-alerter-nwd9g\" (UID: \"44e85fdf-12c8-4aaf-8485-4b1ba16ed02f\") " pod="openshift-network-operator/iptables-alerter-nwd9g" Oct 30 21:52:57.104649 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-run-ovn\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.104649 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103405 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-log-socket\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.104649 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-device-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:52:57.104649 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103455 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82584512-72fe-4964-a8c3-7cacc053025e-system-cni-dir\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:52:57.104649 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103510 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0081a009-4575-4b35-bf6b-6d12dd90067b-dbus\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:52:57.104649 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103511 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-run-netns\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.104649 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103537 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dcb86fdd-20cd-45b3-8533-a6900b903f13-konnectivity-ca\") pod \"konnectivity-agent-mrg22\" (UID: \"dcb86fdd-20cd-45b3-8533-a6900b903f13\") " pod="kube-system/konnectivity-agent-mrg22" Oct 30 21:52:57.104649 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103515 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1928dc59-9826-41df-8599-fce8ce310d74-hosts-file\") pod \"node-resolver-x5d7s\" (UID: \"1928dc59-9826-41df-8599-fce8ce310d74\") " pod="openshift-dns/node-resolver-x5d7s" Oct 30 21:52:57.104649 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103567 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-run-openvswitch\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.104649 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103933 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-conf-dir\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.104649 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.103996 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f4b3be4-a694-497b-9fc5-ae54afc372d5-ovn-node-metrics-cert\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.104649 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104030 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-cni-dir\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.104649 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104043 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-etc-selinux\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:52:57.105736 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104062 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/39ebed07-3b7e-4027-93b0-f9c2b83802ab-cni-binary-copy\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.105736 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104091 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44e85fdf-12c8-4aaf-8485-4b1ba16ed02f-iptables-alerter-script\") pod \"iptables-alerter-nwd9g\" (UID: \"44e85fdf-12c8-4aaf-8485-4b1ba16ed02f\") " pod="openshift-network-operator/iptables-alerter-nwd9g" Oct 30 21:52:57.105736 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104097 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-registration-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:52:57.105736 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104117 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6f4b3be4-a694-497b-9fc5-ae54afc372d5-env-overrides\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.105736 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104127 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-systemd\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.105736 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104172 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-daemon-config\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.105736 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104178 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-slash\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.105736 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104204 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-log-socket\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.105736 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104219 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-slash\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.105736 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-var-lib-openvswitch\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.105736 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104236 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-run-openvswitch\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.105736 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104255 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-run-multus-certs\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.105736 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104302 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-sys-fs\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:52:57.105736 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104333 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/82584512-72fe-4964-a8c3-7cacc053025e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:52:57.105736 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104340 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-socket-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:52:57.105736 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104389 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-device-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:52:57.105736 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104379 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-sys\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.106610 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104390 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-var-lib-openvswitch\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.106610 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104426 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dcb86fdd-20cd-45b3-8533-a6900b903f13-agent-certs\") pod \"konnectivity-agent-mrg22\" (UID: \"dcb86fdd-20cd-45b3-8533-a6900b903f13\") " pod="kube-system/konnectivity-agent-mrg22" Oct 30 21:52:57.106610 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104434 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-node-log\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.106610 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104454 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-run-k8s-cni-cncf-io\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.106610 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104477 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-run-multus-certs\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.106610 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104506 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:52:57.106610 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104529 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-sys-fs\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:52:57.106610 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104536 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktv45\" (UniqueName: \"kubernetes.io/projected/6f4b3be4-a694-497b-9fc5-ae54afc372d5-kube-api-access-ktv45\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.106610 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104566 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-cni-bin\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.106610 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104595 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs\") pod \"network-metrics-daemon-ktz7g\" (UID: \"e28f054c-44b5-4b39-9813-a547c1b41f04\") " pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:52:57.106610 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104624 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9gzz\" (UniqueName: \"kubernetes.io/projected/e28f054c-44b5-4b39-9813-a547c1b41f04-kube-api-access-q9gzz\") pod \"network-metrics-daemon-ktz7g\" (UID: \"e28f054c-44b5-4b39-9813-a547c1b41f04\") " pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:52:57.106610 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104678 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-run-netns\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.106610 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104683 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0081a009-4575-4b35-bf6b-6d12dd90067b-dbus\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:52:57.106610 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104798 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.106610 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104820 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-lib-modules\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.106610 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104839 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-host\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.106610 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104855 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dcb86fdd-20cd-45b3-8533-a6900b903f13-konnectivity-ca\") pod \"konnectivity-agent-mrg22\" (UID: \"dcb86fdd-20cd-45b3-8533-a6900b903f13\") " pod="kube-system/konnectivity-agent-mrg22" Oct 30 21:52:57.107338 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104871 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-tuned\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.107338 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104900 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-kubelet\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.107338 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104914 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-run-ovn\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.107338 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104925 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-system-cni-dir\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.107338 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104927 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/30d5a352-fc59-4709-9d83-0a756367d9e5-serviceca\") pod \"node-ca-7zg8j\" (UID: \"30d5a352-fc59-4709-9d83-0a756367d9e5\") " pod="openshift-image-registry/node-ca-7zg8j" Oct 30 21:52:57.107338 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104955 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck7bh\" (UniqueName: \"kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh\") pod \"network-check-target-dzt7m\" (UID: \"363de559-91e1-406d-bdec-36438ab7a186\") " pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:52:57.107338 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104961 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:52:57.107338 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104977 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/82584512-72fe-4964-a8c3-7cacc053025e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:52:57.107338 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104999 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0081a009-4575-4b35-bf6b-6d12dd90067b-kubelet-config\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:52:57.107338 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105016 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-run-systemd\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.107338 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105018 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.107338 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105033 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-socket-dir-parent\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.107338 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105051 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-var-lib-cni-bin\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.107338 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105076 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-etc-kubernetes\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.107338 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105063 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-cnibin\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.107338 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105139 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-etc-kubernetes\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.107338 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105154 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6f4b3be4-a694-497b-9fc5-ae54afc372d5-ovnkube-config\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.108014 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105182 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.108014 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105198 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30d5a352-fc59-4709-9d83-0a756367d9e5-host\") pod \"node-ca-7zg8j\" (UID: \"30d5a352-fc59-4709-9d83-0a756367d9e5\") " pod="openshift-image-registry/node-ca-7zg8j" Oct 30 21:52:57.108014 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105242 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-kubelet\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.108014 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105266 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-cni-bin\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.108014 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105283 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-system-cni-dir\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.108014 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105293 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0081a009-4575-4b35-bf6b-6d12dd90067b-kubelet-config\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:52:57.108014 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105331 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-var-lib-cni-multus\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.108014 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105373 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-var-lib-kubelet\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.108014 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105014 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-systemd-units\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.108014 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105480 2577 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 21:52:57.108014 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.104977 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-hostroot\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.108014 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:57.105558 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 21:52:57.108014 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105596 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1928dc59-9826-41df-8599-fce8ce310d74-tmp-dir\") pod \"node-resolver-x5d7s\" (UID: \"1928dc59-9826-41df-8599-fce8ce310d74\") " pod="openshift-dns/node-resolver-x5d7s" Oct 30 21:52:57.108014 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105616 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-run-systemd\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.108014 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105655 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-etc-openvswitch\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.108014 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105658 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-socket-dir-parent\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.108014 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:57.105682 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:52:57.108014 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105709 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-var-lib-cni-bin\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.108014 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:57.105746 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs podName:e28f054c-44b5-4b39-9813-a547c1b41f04 nodeName:}" failed. No retries permitted until 2026-10-30 21:52:57.605726846 +0000 UTC m=+3.049274962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs") pod "network-metrics-daemon-ktz7g" (UID: "e28f054c-44b5-4b39-9813-a547c1b41f04") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:52:57.108781 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105750 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-run-netns\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.108781 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:57.105833 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret podName:0081a009-4575-4b35-bf6b-6d12dd90067b nodeName:}" failed. No retries permitted until 2026-10-30 21:52:57.605817476 +0000 UTC m=+3.049365596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret") pod "global-pull-secret-syncer-kczg2" (UID: "0081a009-4575-4b35-bf6b-6d12dd90067b") : object "kube-system"/"original-pull-secret" not registered Oct 30 21:52:57.108781 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.105874 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-cni-dir\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.108781 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.106351 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/39ebed07-3b7e-4027-93b0-f9c2b83802ab-cni-binary-copy\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.108781 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.106582 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-cni-netd\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.108781 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.106582 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-run-k8s-cni-cncf-io\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.108781 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.106689 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6f4b3be4-a694-497b-9fc5-ae54afc372d5-ovnkube-script-lib\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.109707 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.109670 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f4b3be4-a694-497b-9fc5-ae54afc372d5-ovn-node-metrics-cert\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.109838 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.109818 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dcb86fdd-20cd-45b3-8533-a6900b903f13-agent-certs\") pod \"konnectivity-agent-mrg22\" (UID: \"dcb86fdd-20cd-45b3-8533-a6900b903f13\") " pod="kube-system/konnectivity-agent-mrg22" Oct 30 21:52:57.116509 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:57.116487 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 21:52:57.116622 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:57.116513 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 21:52:57.116622 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:57.116526 2577 projected.go:196] Error preparing data for projected volume kube-api-access-ck7bh for pod openshift-network-diagnostics/network-check-target-dzt7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:52:57.116622 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:57.116586 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh podName:363de559-91e1-406d-bdec-36438ab7a186 nodeName:}" failed. No retries permitted until 2026-10-30 21:52:57.616569233 +0000 UTC m=+3.060117347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ck7bh" (UniqueName: "kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh") pod "network-check-target-dzt7m" (UID: "363de559-91e1-406d-bdec-36438ab7a186") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:52:57.118046 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.117928 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj5j4\" (UniqueName: \"kubernetes.io/projected/39ebed07-3b7e-4027-93b0-f9c2b83802ab-kube-api-access-kj5j4\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.118046 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.117507 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhzxg\" (UniqueName: \"kubernetes.io/projected/30d5a352-fc59-4709-9d83-0a756367d9e5-kube-api-access-hhzxg\") pod \"node-ca-7zg8j\" (UID: \"30d5a352-fc59-4709-9d83-0a756367d9e5\") " pod="openshift-image-registry/node-ca-7zg8j" Oct 30 21:52:57.118829 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.118804 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl2xm\" (UniqueName: \"kubernetes.io/projected/eb862971-cdab-42db-8255-f8fee7a7df41-kube-api-access-dl2xm\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:52:57.120220 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.120196 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsccl\" (UniqueName: \"kubernetes.io/projected/1928dc59-9826-41df-8599-fce8ce310d74-kube-api-access-wsccl\") pod \"node-resolver-x5d7s\" (UID: \"1928dc59-9826-41df-8599-fce8ce310d74\") " pod="openshift-dns/node-resolver-x5d7s" Oct 30 21:52:57.120788 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.120768 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktv45\" (UniqueName: \"kubernetes.io/projected/6f4b3be4-a694-497b-9fc5-ae54afc372d5-kube-api-access-ktv45\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.121679 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.121648 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9gzz\" (UniqueName: \"kubernetes.io/projected/e28f054c-44b5-4b39-9813-a547c1b41f04-kube-api-access-q9gzz\") pod \"network-metrics-daemon-ktz7g\" (UID: \"e28f054c-44b5-4b39-9813-a547c1b41f04\") " pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:52:57.205705 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.205612 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44e85fdf-12c8-4aaf-8485-4b1ba16ed02f-iptables-alerter-script\") pod \"iptables-alerter-nwd9g\" (UID: \"44e85fdf-12c8-4aaf-8485-4b1ba16ed02f\") " pod="openshift-network-operator/iptables-alerter-nwd9g" Oct 30 21:52:57.205705 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.205661 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-systemd\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.205705 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.205690 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/82584512-72fe-4964-a8c3-7cacc053025e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:52:57.205992 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.205730 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-sys\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.205992 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.205791 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-lib-modules\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.205992 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.205814 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-host\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.205992 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.205836 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-tuned\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.205992 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.205873 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/82584512-72fe-4964-a8c3-7cacc053025e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:52:57.205992 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.205882 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/82584512-72fe-4964-a8c3-7cacc053025e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:52:57.205992 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.205905 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-sysctl-d\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.205992 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.205934 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/82584512-72fe-4964-a8c3-7cacc053025e-cni-binary-copy\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:52:57.205992 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.205969 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/82584512-72fe-4964-a8c3-7cacc053025e-cnibin\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:52:57.205992 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.205975 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-host\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.206529 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.205999 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-var-lib-kubelet\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.206529 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206022 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-sys\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.206529 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206023 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6774e634-30d8-4808-9c87-fe25db7fcb9d-tmp\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.206529 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206057 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znz47\" (UniqueName: \"kubernetes.io/projected/6774e634-30d8-4808-9c87-fe25db7fcb9d-kube-api-access-znz47\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.206529 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206084 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbcsw\" (UniqueName: \"kubernetes.io/projected/44e85fdf-12c8-4aaf-8485-4b1ba16ed02f-kube-api-access-qbcsw\") pod \"iptables-alerter-nwd9g\" (UID: \"44e85fdf-12c8-4aaf-8485-4b1ba16ed02f\") " pod="openshift-network-operator/iptables-alerter-nwd9g" Oct 30 21:52:57.206529 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206109 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-kubernetes\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.206529 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206131 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-sysctl-conf\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.206529 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206156 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-modprobe-d\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.206529 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206202 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nlgb\" (UniqueName: \"kubernetes.io/projected/82584512-72fe-4964-a8c3-7cacc053025e-kube-api-access-4nlgb\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:52:57.206529 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206231 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/82584512-72fe-4964-a8c3-7cacc053025e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:52:57.206529 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206258 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-sysconfig\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.206529 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206282 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-run\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.206529 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44e85fdf-12c8-4aaf-8485-4b1ba16ed02f-host-slash\") pod \"iptables-alerter-nwd9g\" (UID: \"44e85fdf-12c8-4aaf-8485-4b1ba16ed02f\") " pod="openshift-network-operator/iptables-alerter-nwd9g" Oct 30 21:52:57.206529 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206341 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82584512-72fe-4964-a8c3-7cacc053025e-system-cni-dir\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:52:57.206529 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206431 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44e85fdf-12c8-4aaf-8485-4b1ba16ed02f-iptables-alerter-script\") pod \"iptables-alerter-nwd9g\" (UID: \"44e85fdf-12c8-4aaf-8485-4b1ba16ed02f\") " pod="openshift-network-operator/iptables-alerter-nwd9g" Oct 30 21:52:57.206529 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206489 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-sysctl-conf\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.207288 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206558 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-run\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.207288 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206555 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-modprobe-d\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.207288 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206718 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-lib-modules\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.207288 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206755 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-kubernetes\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.207288 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206809 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44e85fdf-12c8-4aaf-8485-4b1ba16ed02f-host-slash\") pod \"iptables-alerter-nwd9g\" (UID: \"44e85fdf-12c8-4aaf-8485-4b1ba16ed02f\") " pod="openshift-network-operator/iptables-alerter-nwd9g" Oct 30 21:52:57.207288 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.205938 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-systemd\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.207288 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206863 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/82584512-72fe-4964-a8c3-7cacc053025e-cnibin\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:52:57.207288 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206874 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-sysctl-d\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.207288 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206911 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82584512-72fe-4964-a8c3-7cacc053025e-system-cni-dir\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:52:57.207288 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206917 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-var-lib-kubelet\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.207288 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206443 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-sysconfig\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.207288 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.206958 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/82584512-72fe-4964-a8c3-7cacc053025e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:52:57.207913 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.207402 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/82584512-72fe-4964-a8c3-7cacc053025e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:52:57.207913 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.207473 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/82584512-72fe-4964-a8c3-7cacc053025e-cni-binary-copy\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:52:57.208790 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.208730 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6774e634-30d8-4808-9c87-fe25db7fcb9d-tmp\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.209360 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.209335 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-tuned\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.220114 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.220075 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znz47\" (UniqueName: \"kubernetes.io/projected/6774e634-30d8-4808-9c87-fe25db7fcb9d-kube-api-access-znz47\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.220257 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.220165 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nlgb\" (UniqueName: \"kubernetes.io/projected/82584512-72fe-4964-a8c3-7cacc053025e-kube-api-access-4nlgb\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:52:57.221730 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.221701 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbcsw\" (UniqueName: \"kubernetes.io/projected/44e85fdf-12c8-4aaf-8485-4b1ba16ed02f-kube-api-access-qbcsw\") pod \"iptables-alerter-nwd9g\" (UID: \"44e85fdf-12c8-4aaf-8485-4b1ba16ed02f\") " pod="openshift-network-operator/iptables-alerter-nwd9g" Oct 30 21:52:57.304473 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.304430 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:52:57.306670 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.306574 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mrg22" Oct 30 21:52:57.315062 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.315039 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-srvpr" Oct 30 21:52:57.315998 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:57.315963 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4b3be4_a694_497b_9fc5_ae54afc372d5.slice/crio-1dbacc5e0626c219b587e2ed0d7b2c71ac618315dcdf1ac652101d32df14d80e WatchSource:0}: Error finding container 1dbacc5e0626c219b587e2ed0d7b2c71ac618315dcdf1ac652101d32df14d80e: Status 404 returned error can't find the container with id 1dbacc5e0626c219b587e2ed0d7b2c71ac618315dcdf1ac652101d32df14d80e Oct 30 21:52:57.319292 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.319273 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7zg8j" Oct 30 21:52:57.327932 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.327912 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x5d7s" Oct 30 21:52:57.328034 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:57.327983 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39ebed07_3b7e_4027_93b0_f9c2b83802ab.slice/crio-d21ca8a2e4610ec3ff50284a7b5a726afe9968c8dd47ff4c50de8f5c4c1fbdbc WatchSource:0}: Error finding container d21ca8a2e4610ec3ff50284a7b5a726afe9968c8dd47ff4c50de8f5c4c1fbdbc: Status 404 returned error can't find the container with id d21ca8a2e4610ec3ff50284a7b5a726afe9968c8dd47ff4c50de8f5c4c1fbdbc Oct 30 21:52:57.340616 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.340593 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:52:57.341868 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:57.341847 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1928dc59_9826_41df_8599_fce8ce310d74.slice/crio-3acde190332b0365d41b1cd26eb49dce20d00b7a1036d5b6431082a68643cc5d WatchSource:0}: Error finding container 3acde190332b0365d41b1cd26eb49dce20d00b7a1036d5b6431082a68643cc5d: Status 404 returned error can't find the container with id 3acde190332b0365d41b1cd26eb49dce20d00b7a1036d5b6431082a68643cc5d Oct 30 21:52:57.350703 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:57.350676 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb862971_cdab_42db_8255_f8fee7a7df41.slice/crio-d3cf138f480a2cff618e17f3afcee190b839c43aaecf340fdbd7fb21b4192f6d WatchSource:0}: Error finding container d3cf138f480a2cff618e17f3afcee190b839c43aaecf340fdbd7fb21b4192f6d: Status 404 returned error can't find the container with id d3cf138f480a2cff618e17f3afcee190b839c43aaecf340fdbd7fb21b4192f6d Oct 30 21:52:57.356758 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.356737 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:52:57.360272 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.360252 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nwd9g" Oct 30 21:52:57.362794 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.362775 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:52:57.371395 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:57.371368 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82584512_72fe_4964_a8c3_7cacc053025e.slice/crio-6c76fa37209e2350624583e28aec434bd559baee3479c76793a882b4a46bbca7 WatchSource:0}: Error finding container 6c76fa37209e2350624583e28aec434bd559baee3479c76793a882b4a46bbca7: Status 404 returned error can't find the container with id 6c76fa37209e2350624583e28aec434bd559baee3479c76793a882b4a46bbca7 Oct 30 21:52:57.372533 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:57.372496 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44e85fdf_12c8_4aaf_8485_4b1ba16ed02f.slice/crio-0565bccc9dc62fed50c4e5d3477f1f54e303103455e94f46f6efa12a17dc9be7 WatchSource:0}: Error finding container 0565bccc9dc62fed50c4e5d3477f1f54e303103455e94f46f6efa12a17dc9be7: Status 404 returned error can't find the container with id 0565bccc9dc62fed50c4e5d3477f1f54e303103455e94f46f6efa12a17dc9be7 Oct 30 21:52:57.376477 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:52:57.376274 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6774e634_30d8_4808_9c87_fe25db7fcb9d.slice/crio-2634cba9becd9f6cd77f12e44f845f8d6453126e1cda2f843cc78e1a5ec44ade WatchSource:0}: Error finding container 2634cba9becd9f6cd77f12e44f845f8d6453126e1cda2f843cc78e1a5ec44ade: Status 404 returned error can't find the container with id 2634cba9becd9f6cd77f12e44f845f8d6453126e1cda2f843cc78e1a5ec44ade Oct 30 21:52:57.609392 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.609311 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs\") pod \"network-metrics-daemon-ktz7g\" (UID: \"e28f054c-44b5-4b39-9813-a547c1b41f04\") " pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:52:57.609593 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.609436 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:52:57.609593 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:57.609512 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:52:57.609593 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:57.609548 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 21:52:57.609747 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:57.609602 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs podName:e28f054c-44b5-4b39-9813-a547c1b41f04 nodeName:}" failed. No retries permitted until 2026-10-30 21:52:58.609580286 +0000 UTC m=+4.053128402 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs") pod "network-metrics-daemon-ktz7g" (UID: "e28f054c-44b5-4b39-9813-a547c1b41f04") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:52:57.609747 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:57.609624 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret podName:0081a009-4575-4b35-bf6b-6d12dd90067b nodeName:}" failed. No retries permitted until 2026-10-30 21:52:58.609614583 +0000 UTC m=+4.053162688 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret") pod "global-pull-secret-syncer-kczg2" (UID: "0081a009-4575-4b35-bf6b-6d12dd90067b") : object "kube-system"/"original-pull-secret" not registered Oct 30 21:52:57.709988 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:57.709953 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck7bh\" (UniqueName: \"kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh\") pod \"network-check-target-dzt7m\" (UID: \"363de559-91e1-406d-bdec-36438ab7a186\") " pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:52:57.710181 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:57.710102 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 21:52:57.710181 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:57.710117 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 21:52:57.710181 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:57.710135 2577 projected.go:196] Error preparing data for projected volume kube-api-access-ck7bh for pod openshift-network-diagnostics/network-check-target-dzt7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:52:57.710350 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:57.710191 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh podName:363de559-91e1-406d-bdec-36438ab7a186 nodeName:}" failed. No retries permitted until 2026-10-30 21:52:58.710176715 +0000 UTC m=+4.153724830 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ck7bh" (UniqueName: "kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh") pod "network-check-target-dzt7m" (UID: "363de559-91e1-406d-bdec-36438ab7a186") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:52:58.037400 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:58.037259 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:47:57 +0000 UTC" deadline="2028-05-29 09:16:38.235487749 +0000 UTC" Oct 30 21:52:58.037400 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:58.037330 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13835h23m40.198162295s" Oct 30 21:52:58.064222 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:58.064186 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:52:58.064394 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:58.064340 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzt7m" podUID="363de559-91e1-406d-bdec-36438ab7a186" Oct 30 21:52:58.089786 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:58.089671 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" event={"ID":"eb862971-cdab-42db-8255-f8fee7a7df41","Type":"ContainerStarted","Data":"d3cf138f480a2cff618e17f3afcee190b839c43aaecf340fdbd7fb21b4192f6d"} Oct 30 21:52:58.097049 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:58.096830 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x5d7s" event={"ID":"1928dc59-9826-41df-8599-fce8ce310d74","Type":"ContainerStarted","Data":"3acde190332b0365d41b1cd26eb49dce20d00b7a1036d5b6431082a68643cc5d"} Oct 30 21:52:58.122108 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:58.118742 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7zg8j" event={"ID":"30d5a352-fc59-4709-9d83-0a756367d9e5","Type":"ContainerStarted","Data":"d7b0ef0b3bd16b1ade507eac99d469db31033e84fec8439a6c64c82b1bfe873a"} Oct 30 21:52:58.122108 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:58.120836 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-srvpr" event={"ID":"39ebed07-3b7e-4027-93b0-f9c2b83802ab","Type":"ContainerStarted","Data":"d21ca8a2e4610ec3ff50284a7b5a726afe9968c8dd47ff4c50de8f5c4c1fbdbc"} Oct 30 21:52:58.123131 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:58.123032 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" event={"ID":"6f4b3be4-a694-497b-9fc5-ae54afc372d5","Type":"ContainerStarted","Data":"1dbacc5e0626c219b587e2ed0d7b2c71ac618315dcdf1ac652101d32df14d80e"} Oct 30 21:52:58.128380 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:58.128347 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nwd9g" event={"ID":"44e85fdf-12c8-4aaf-8485-4b1ba16ed02f","Type":"ContainerStarted","Data":"0565bccc9dc62fed50c4e5d3477f1f54e303103455e94f46f6efa12a17dc9be7"} Oct 30 21:52:58.137599 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:58.137470 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkqj8" event={"ID":"82584512-72fe-4964-a8c3-7cacc053025e","Type":"ContainerStarted","Data":"6c76fa37209e2350624583e28aec434bd559baee3479c76793a882b4a46bbca7"} Oct 30 21:52:58.142781 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:58.142707 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mrg22" event={"ID":"dcb86fdd-20cd-45b3-8533-a6900b903f13","Type":"ContainerStarted","Data":"68326a8e59007b1a4742760879e1a4f15547f57bb6e4fa1e9a6b298af3ce76ad"} Oct 30 21:52:58.151004 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:58.147424 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wrp44" event={"ID":"6774e634-30d8-4808-9c87-fe25db7fcb9d","Type":"ContainerStarted","Data":"2634cba9becd9f6cd77f12e44f845f8d6453126e1cda2f843cc78e1a5ec44ade"} Oct 30 21:52:58.627819 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:58.627534 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:52:58.627999 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:58.627853 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs\") pod \"network-metrics-daemon-ktz7g\" (UID: \"e28f054c-44b5-4b39-9813-a547c1b41f04\") " pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:52:58.628062 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:58.628019 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:52:58.628122 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:58.628105 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs podName:e28f054c-44b5-4b39-9813-a547c1b41f04 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:00.628084041 +0000 UTC m=+6.071632145 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs") pod "network-metrics-daemon-ktz7g" (UID: "e28f054c-44b5-4b39-9813-a547c1b41f04") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:52:58.628574 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:58.628551 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 21:52:58.628666 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:58.628620 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret podName:0081a009-4575-4b35-bf6b-6d12dd90067b nodeName:}" failed. No retries permitted until 2026-10-30 21:53:00.628602196 +0000 UTC m=+6.072150302 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret") pod "global-pull-secret-syncer-kczg2" (UID: "0081a009-4575-4b35-bf6b-6d12dd90067b") : object "kube-system"/"original-pull-secret" not registered Oct 30 21:52:58.729395 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:58.728655 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck7bh\" (UniqueName: \"kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh\") pod \"network-check-target-dzt7m\" (UID: \"363de559-91e1-406d-bdec-36438ab7a186\") " pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:52:58.729395 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:58.728852 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 21:52:58.729395 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:58.728871 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 21:52:58.729395 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:58.728885 2577 projected.go:196] Error preparing data for projected volume kube-api-access-ck7bh for pod openshift-network-diagnostics/network-check-target-dzt7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:52:58.729395 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:58.728950 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh podName:363de559-91e1-406d-bdec-36438ab7a186 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:00.728930598 +0000 UTC m=+6.172478715 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ck7bh" (UniqueName: "kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh") pod "network-check-target-dzt7m" (UID: "363de559-91e1-406d-bdec-36438ab7a186") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:52:59.038294 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:59.038197 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:47:57 +0000 UTC" deadline="2028-07-23 09:42:42.18459772 +0000 UTC" Oct 30 21:52:59.038294 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:59.038245 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15155h49m43.146358546s" Oct 30 21:52:59.067269 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:59.067237 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:52:59.067461 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:59.067379 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktz7g" podUID="e28f054c-44b5-4b39-9813-a547c1b41f04" Oct 30 21:52:59.067656 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:59.067634 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:52:59.067778 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:52:59.067756 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kczg2" podUID="0081a009-4575-4b35-bf6b-6d12dd90067b" Oct 30 21:52:59.170691 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:59.169690 2577 generic.go:356] "Generic (PLEG): container finished" podID="ce9e46bc8cc07006aa910618f31ad4ad" containerID="92a43dc466fb2ad28b085ead3bafc93ca827e0328933d4ab563dcfe64460bf34" exitCode=0 Oct 30 21:52:59.170691 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:59.169796 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" event={"ID":"ce9e46bc8cc07006aa910618f31ad4ad","Type":"ContainerDied","Data":"92a43dc466fb2ad28b085ead3bafc93ca827e0328933d4ab563dcfe64460bf34"} Oct 30 21:52:59.191031 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:52:59.190993 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal" event={"ID":"217839645ba686b08e18edb27afa5bea","Type":"ContainerStarted","Data":"39d6a93d975147d6f4224a499bb2dd605bb478690690535c0dd7d70ad4fe13eb"} Oct 30 21:53:00.064863 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:00.064827 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:53:00.065413 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:00.064963 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzt7m" podUID="363de559-91e1-406d-bdec-36438ab7a186" Oct 30 21:53:00.243350 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:00.243249 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" event={"ID":"ce9e46bc8cc07006aa910618f31ad4ad","Type":"ContainerStarted","Data":"9256783d723064c55603f599e42b88af5ab51c4a4f459858f2c2ab877b6ea078"} Oct 30 21:53:00.262196 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:00.261985 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal" podStartSLOduration=4.261964338 podStartE2EDuration="4.261964338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:52:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:52:59.22819011 +0000 UTC m=+4.671738236" watchObservedRunningTime="2026-10-30 21:53:00.261964338 +0000 UTC m=+5.705512456" Oct 30 21:53:00.645536 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:00.644749 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:53:00.645536 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:00.644805 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs\") pod \"network-metrics-daemon-ktz7g\" (UID: \"e28f054c-44b5-4b39-9813-a547c1b41f04\") " pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:53:00.645536 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:00.644932 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:53:00.645536 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:00.644998 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs podName:e28f054c-44b5-4b39-9813-a547c1b41f04 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:04.644978406 +0000 UTC m=+10.088526513 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs") pod "network-metrics-daemon-ktz7g" (UID: "e28f054c-44b5-4b39-9813-a547c1b41f04") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:53:00.645536 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:00.645414 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 21:53:00.645536 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:00.645484 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret podName:0081a009-4575-4b35-bf6b-6d12dd90067b nodeName:}" failed. No retries permitted until 2026-10-30 21:53:04.645453637 +0000 UTC m=+10.089001737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret") pod "global-pull-secret-syncer-kczg2" (UID: "0081a009-4575-4b35-bf6b-6d12dd90067b") : object "kube-system"/"original-pull-secret" not registered Oct 30 21:53:00.746054 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:00.745346 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck7bh\" (UniqueName: \"kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh\") pod \"network-check-target-dzt7m\" (UID: \"363de559-91e1-406d-bdec-36438ab7a186\") " pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:53:00.746054 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:00.745562 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 21:53:00.746054 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:00.745584 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 21:53:00.746054 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:00.745598 2577 projected.go:196] Error preparing data for projected volume kube-api-access-ck7bh for pod openshift-network-diagnostics/network-check-target-dzt7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:53:00.746054 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:00.745661 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh podName:363de559-91e1-406d-bdec-36438ab7a186 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:04.745642368 +0000 UTC m=+10.189190475 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ck7bh" (UniqueName: "kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh") pod "network-check-target-dzt7m" (UID: "363de559-91e1-406d-bdec-36438ab7a186") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:53:01.067863 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:01.064886 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:53:01.067863 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:01.065030 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kczg2" podUID="0081a009-4575-4b35-bf6b-6d12dd90067b" Oct 30 21:53:01.067863 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:01.065315 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:53:01.067863 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:01.065394 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktz7g" podUID="e28f054c-44b5-4b39-9813-a547c1b41f04" Oct 30 21:53:01.255813 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:01.254647 2577 generic.go:356] "Generic (PLEG): container finished" podID="82584512-72fe-4964-a8c3-7cacc053025e" containerID="6b7afe0515b965b5f2b0f4eabd4eb60d42eec7540390fd8c5bc091aea2b7df31" exitCode=0 Oct 30 21:53:01.255813 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:01.255520 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkqj8" event={"ID":"82584512-72fe-4964-a8c3-7cacc053025e","Type":"ContainerDied","Data":"6b7afe0515b965b5f2b0f4eabd4eb60d42eec7540390fd8c5bc091aea2b7df31"} Oct 30 21:53:01.284623 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:01.284552 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" podStartSLOduration=5.2845277920000004 podStartE2EDuration="5.284527792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:52:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:00.263436032 +0000 UTC m=+5.706984171" watchObservedRunningTime="2026-10-30 21:53:01.284527792 +0000 UTC m=+6.728075916" Oct 30 21:53:02.064745 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:02.064706 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:53:02.064959 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:02.064854 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzt7m" podUID="363de559-91e1-406d-bdec-36438ab7a186" Oct 30 21:53:02.263776 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:02.263726 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mrg22" event={"ID":"dcb86fdd-20cd-45b3-8533-a6900b903f13","Type":"ContainerStarted","Data":"5f380b22f421bbf14e4e4638553bc0b0af91129f522ebcceb183f3922b314921"} Oct 30 21:53:02.291674 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:02.291592 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mrg22" podStartSLOduration=3.11981986 podStartE2EDuration="7.291568216s" totalImagesPullingTime="4.171748356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:02.289321271 +0000 UTC m=+7.732869397" watchObservedRunningTime="2026-10-30 21:53:02.291568216 +0000 UTC m=+7.735116345" Oct 30 21:53:03.065670 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:03.065623 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:53:03.065865 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:03.065789 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kczg2" podUID="0081a009-4575-4b35-bf6b-6d12dd90067b" Oct 30 21:53:03.066464 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:03.066382 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:53:03.066587 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:03.066558 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktz7g" podUID="e28f054c-44b5-4b39-9813-a547c1b41f04" Oct 30 21:53:03.272588 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:03.272550 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7zg8j" event={"ID":"30d5a352-fc59-4709-9d83-0a756367d9e5","Type":"ContainerStarted","Data":"4e0adc3345a920b54ba4411a5f891c8cf881a09689f697b8db900a27d4907357"} Oct 30 21:53:04.064652 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:04.064441 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:53:04.064652 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:04.064567 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzt7m" podUID="363de559-91e1-406d-bdec-36438ab7a186" Oct 30 21:53:04.279221 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:04.279188 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" event={"ID":"eb862971-cdab-42db-8255-f8fee7a7df41","Type":"ContainerStarted","Data":"f29d970718db1c7923d720ff76d1dc7876039ffaa4240db12287105a15f68ed3"} Oct 30 21:53:04.683636 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:04.682786 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:53:04.683636 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:04.682848 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs\") pod \"network-metrics-daemon-ktz7g\" (UID: \"e28f054c-44b5-4b39-9813-a547c1b41f04\") " pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:53:04.683636 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:04.682993 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:53:04.683636 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:04.683061 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs podName:e28f054c-44b5-4b39-9813-a547c1b41f04 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:12.683043158 +0000 UTC m=+18.126591276 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs") pod "network-metrics-daemon-ktz7g" (UID: "e28f054c-44b5-4b39-9813-a547c1b41f04") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:53:04.683636 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:04.683534 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 21:53:04.683636 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:04.683598 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret podName:0081a009-4575-4b35-bf6b-6d12dd90067b nodeName:}" failed. No retries permitted until 2026-10-30 21:53:12.683581705 +0000 UTC m=+18.127129807 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret") pod "global-pull-secret-syncer-kczg2" (UID: "0081a009-4575-4b35-bf6b-6d12dd90067b") : object "kube-system"/"original-pull-secret" not registered Oct 30 21:53:04.784424 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:04.783609 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck7bh\" (UniqueName: \"kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh\") pod \"network-check-target-dzt7m\" (UID: \"363de559-91e1-406d-bdec-36438ab7a186\") " pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:53:04.784424 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:04.783805 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 21:53:04.784424 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:04.783827 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 21:53:04.784424 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:04.783845 2577 projected.go:196] Error preparing data for projected volume kube-api-access-ck7bh for pod openshift-network-diagnostics/network-check-target-dzt7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:53:04.784424 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:04.783915 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh podName:363de559-91e1-406d-bdec-36438ab7a186 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:12.783893983 +0000 UTC m=+18.227442104 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ck7bh" (UniqueName: "kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh") pod "network-check-target-dzt7m" (UID: "363de559-91e1-406d-bdec-36438ab7a186") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:53:05.068529 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:05.067271 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:53:05.068529 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:05.067415 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktz7g" podUID="e28f054c-44b5-4b39-9813-a547c1b41f04" Oct 30 21:53:05.068529 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:05.067495 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:53:05.068529 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:05.067570 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kczg2" podUID="0081a009-4575-4b35-bf6b-6d12dd90067b" Oct 30 21:53:05.950053 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:05.950022 2577 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 21:53:06.063766 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:06.063449 2577 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T21:53:05.950050273Z","UUID":"5fb8dc4f-e379-4fa2-9a98-e20900943989","Handler":null,"Name":"","Endpoint":""} Oct 30 21:53:06.063959 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:06.063939 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:53:06.064079 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:06.064057 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzt7m" podUID="363de559-91e1-406d-bdec-36438ab7a186" Oct 30 21:53:06.065743 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:06.065365 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 21:53:06.065743 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:06.065411 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 21:53:06.286290 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:06.286248 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" event={"ID":"eb862971-cdab-42db-8255-f8fee7a7df41","Type":"ContainerStarted","Data":"0e94c9c954ec34fdafa6fa5527e6a767fc666b3299c8bf59814a9244445760d6"} Oct 30 21:53:06.287996 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:06.287943 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x5d7s" event={"ID":"1928dc59-9826-41df-8599-fce8ce310d74","Type":"ContainerStarted","Data":"b25966d7c36cde94624b3891c7d9d03636c2afa426c89169455c1c36d8fb3e64"} Oct 30 21:53:06.289607 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:06.289567 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-srvpr" event={"ID":"39ebed07-3b7e-4027-93b0-f9c2b83802ab","Type":"ContainerStarted","Data":"ba87f3b01767b5227c0c6c2c3ebd56a83e0764aa1243567fe429a823f551072f"} Oct 30 21:53:06.291710 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:06.291680 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkqj8" event={"ID":"82584512-72fe-4964-a8c3-7cacc053025e","Type":"ContainerStarted","Data":"ba5e81616f92d2ce067ad24c2aa1ce695bd155233f932e938d58ca391fac60ad"} Oct 30 21:53:06.308298 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:06.308237 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7zg8j" podStartSLOduration=5.789687504 podStartE2EDuration="11.308223173s" totalImagesPullingTime="5.518535669s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:03.291173554 +0000 UTC m=+8.734721679" watchObservedRunningTime="2026-10-30 21:53:06.308223173 +0000 UTC m=+11.751771293" Oct 30 21:53:06.308931 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:06.308893 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-x5d7s" podStartSLOduration=1.666536406 podStartE2EDuration="10.308878404s" totalImagesPullingTime="8.642341998s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:52:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:06.308621761 +0000 UTC m=+11.752169880" watchObservedRunningTime="2026-10-30 21:53:06.308878404 +0000 UTC m=+11.752426524" Oct 30 21:53:06.368954 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:06.368892 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-srvpr" podStartSLOduration=3.393937672 podStartE2EDuration="11.368874882s" totalImagesPullingTime="7.97493721s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:06.368424255 +0000 UTC m=+11.811972375" watchObservedRunningTime="2026-10-30 21:53:06.368874882 +0000 UTC m=+11.812423001" Oct 30 21:53:06.513540 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:06.513507 2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mrg22" Oct 30 21:53:06.514359 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:06.514331 2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mrg22" Oct 30 21:53:07.064081 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:07.064052 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:53:07.064621 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:07.064187 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktz7g" podUID="e28f054c-44b5-4b39-9813-a547c1b41f04" Oct 30 21:53:07.064621 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:07.064521 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:53:07.064739 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:07.064622 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kczg2" podUID="0081a009-4575-4b35-bf6b-6d12dd90067b" Oct 30 21:53:07.296953 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:07.296872 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" event={"ID":"eb862971-cdab-42db-8255-f8fee7a7df41","Type":"ContainerStarted","Data":"33a635dbd845764e99ee938b8c93683fb64f520423f5a0fb1fac7ef3536ba1dc"} Oct 30 21:53:07.298917 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:07.298889 2577 generic.go:356] "Generic (PLEG): container finished" podID="82584512-72fe-4964-a8c3-7cacc053025e" containerID="ba5e81616f92d2ce067ad24c2aa1ce695bd155233f932e938d58ca391fac60ad" exitCode=0 Oct 30 21:53:07.299061 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:07.298999 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkqj8" event={"ID":"82584512-72fe-4964-a8c3-7cacc053025e","Type":"ContainerDied","Data":"ba5e81616f92d2ce067ad24c2aa1ce695bd155233f932e938d58ca391fac60ad"} Oct 30 21:53:07.299508 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:07.299398 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mrg22" Oct 30 21:53:07.299671 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:07.299610 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mrg22" Oct 30 21:53:07.323097 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:07.323037 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" podStartSLOduration=2.086296872 podStartE2EDuration="11.323018826s" totalImagesPullingTime="9.236721954s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:52:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:07.320228296 +0000 UTC m=+12.763776417" watchObservedRunningTime="2026-10-30 21:53:07.323018826 +0000 UTC m=+12.766566948" Oct 30 21:53:08.064502 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:08.064463 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:53:08.065030 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:08.064578 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzt7m" podUID="363de559-91e1-406d-bdec-36438ab7a186" Oct 30 21:53:08.286908 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:08.286845 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x5d7s_1928dc59-9826-41df-8599-fce8ce310d74/dns-node-resolver/0.log" Oct 30 21:53:08.302944 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:08.302906 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wrp44" event={"ID":"6774e634-30d8-4808-9c87-fe25db7fcb9d","Type":"ContainerStarted","Data":"e2ae6b4f188de363fd2280b1c3b49d000910f99f05cf8609af7f21b99c948345"} Oct 30 21:53:08.304978 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:08.304398 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nwd9g" event={"ID":"44e85fdf-12c8-4aaf-8485-4b1ba16ed02f","Type":"ContainerStarted","Data":"65e9683137258a2f8a81658d62683e985c8858a2c7f9a27a8083bdefc627af37"} Oct 30 21:53:08.323204 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:08.323125 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wrp44" podStartSLOduration=1.500498641 podStartE2EDuration="12.323109575s" totalImagesPullingTime="10.822610934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:52:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:08.322261536 +0000 UTC m=+13.765809656" watchObservedRunningTime="2026-10-30 21:53:08.323109575 +0000 UTC m=+13.766657704" Oct 30 21:53:08.339965 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:08.339913 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nwd9g" podStartSLOduration=3.902800892 podStartE2EDuration="12.339894678s" totalImagesPullingTime="8.437093786s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:52:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:08.339722416 +0000 UTC m=+13.783270531" watchObservedRunningTime="2026-10-30 21:53:08.339894678 +0000 UTC m=+13.783442797" Oct 30 21:53:08.848259 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:08.848229 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7zg8j_30d5a352-fc59-4709-9d83-0a756367d9e5/node-ca/0.log" Oct 30 21:53:09.064511 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:09.064057 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:53:09.064511 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:09.064089 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:53:09.064511 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:09.064189 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kczg2" podUID="0081a009-4575-4b35-bf6b-6d12dd90067b" Oct 30 21:53:09.064511 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:09.064339 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktz7g" podUID="e28f054c-44b5-4b39-9813-a547c1b41f04" Oct 30 21:53:09.309255 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:09.309217 2577 generic.go:356] "Generic (PLEG): container finished" podID="82584512-72fe-4964-a8c3-7cacc053025e" containerID="304ec0081553b8b2a277cbc82887f2cf398e467948d992bb3e7e75fd5346eb65" exitCode=0 Oct 30 21:53:09.309464 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:09.309325 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkqj8" event={"ID":"82584512-72fe-4964-a8c3-7cacc053025e","Type":"ContainerDied","Data":"304ec0081553b8b2a277cbc82887f2cf398e467948d992bb3e7e75fd5346eb65"} Oct 30 21:53:10.064160 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:10.063973 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:53:10.064262 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:10.064246 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzt7m" podUID="363de559-91e1-406d-bdec-36438ab7a186" Oct 30 21:53:10.316622 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:10.314465 2577 generic.go:356] "Generic (PLEG): container finished" podID="82584512-72fe-4964-a8c3-7cacc053025e" containerID="4f30c43513e8461e70a4a7f220a8d40ec7db7259c3fadc6ddece2aa7d64561ed" exitCode=0 Oct 30 21:53:10.316622 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:10.314512 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkqj8" event={"ID":"82584512-72fe-4964-a8c3-7cacc053025e","Type":"ContainerDied","Data":"4f30c43513e8461e70a4a7f220a8d40ec7db7259c3fadc6ddece2aa7d64561ed"} Oct 30 21:53:10.936890 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:10.936849 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mrg22_dcb86fdd-20cd-45b3-8533-a6900b903f13/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:11.063940 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:11.063904 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:53:11.064115 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:11.064037 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kczg2" podUID="0081a009-4575-4b35-bf6b-6d12dd90067b" Oct 30 21:53:11.064453 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:11.064414 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:53:11.064548 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:11.064531 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktz7g" podUID="e28f054c-44b5-4b39-9813-a547c1b41f04" Oct 30 21:53:11.110605 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:11.110561 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mrg22_dcb86fdd-20cd-45b3-8533-a6900b903f13/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:11.522578 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:11.522540 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mrg22_dcb86fdd-20cd-45b3-8533-a6900b903f13/konnectivity-agent/0.log" limit=1024 Oct 30 21:53:12.064870 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:12.064834 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:53:12.065039 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:12.064936 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzt7m" podUID="363de559-91e1-406d-bdec-36438ab7a186" Oct 30 21:53:12.743558 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:12.743525 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:53:12.743903 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:12.743564 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs\") pod \"network-metrics-daemon-ktz7g\" (UID: \"e28f054c-44b5-4b39-9813-a547c1b41f04\") " pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:53:12.743903 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:12.743683 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:53:12.743903 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:12.743737 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs podName:e28f054c-44b5-4b39-9813-a547c1b41f04 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:28.743724363 +0000 UTC m=+34.187272472 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs") pod "network-metrics-daemon-ktz7g" (UID: "e28f054c-44b5-4b39-9813-a547c1b41f04") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:53:12.743903 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:12.743683 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 21:53:12.743903 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:12.743809 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret podName:0081a009-4575-4b35-bf6b-6d12dd90067b nodeName:}" failed. No retries permitted until 2026-10-30 21:53:28.743796416 +0000 UTC m=+34.187344523 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret") pod "global-pull-secret-syncer-kczg2" (UID: "0081a009-4575-4b35-bf6b-6d12dd90067b") : object "kube-system"/"original-pull-secret" not registered Oct 30 21:53:12.844552 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:12.844531 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck7bh\" (UniqueName: \"kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh\") pod \"network-check-target-dzt7m\" (UID: \"363de559-91e1-406d-bdec-36438ab7a186\") " pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:53:12.844670 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:12.844657 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 21:53:12.844720 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:12.844672 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 21:53:12.844720 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:12.844681 2577 projected.go:196] Error preparing data for projected volume kube-api-access-ck7bh for pod openshift-network-diagnostics/network-check-target-dzt7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:53:12.844790 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:12.844721 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh podName:363de559-91e1-406d-bdec-36438ab7a186 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:28.844709756 +0000 UTC m=+34.288257853 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ck7bh" (UniqueName: "kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh") pod "network-check-target-dzt7m" (UID: "363de559-91e1-406d-bdec-36438ab7a186") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:53:13.063915 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:13.063840 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:53:13.064036 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:13.063976 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktz7g" podUID="e28f054c-44b5-4b39-9813-a547c1b41f04" Oct 30 21:53:13.064036 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:13.064019 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:53:13.064124 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:13.064107 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kczg2" podUID="0081a009-4575-4b35-bf6b-6d12dd90067b" Oct 30 21:53:13.323156 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:13.323080 2577 generic.go:356] "Generic (PLEG): container finished" podID="82584512-72fe-4964-a8c3-7cacc053025e" containerID="dc6a403b99cb5be2666f8615cd3dcbbd3ee296c15b4c404bc9fe342ed0ae15cd" exitCode=0 Oct 30 21:53:13.323292 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:13.323170 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkqj8" event={"ID":"82584512-72fe-4964-a8c3-7cacc053025e","Type":"ContainerDied","Data":"dc6a403b99cb5be2666f8615cd3dcbbd3ee296c15b4c404bc9fe342ed0ae15cd"} Oct 30 21:53:13.326251 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:13.326230 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" event={"ID":"6f4b3be4-a694-497b-9fc5-ae54afc372d5","Type":"ContainerStarted","Data":"7898ca52cff323d09be4eca962bfaf69b0d09c9e03f96e8c1416d49365cd471b"} Oct 30 21:53:13.326342 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:13.326307 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" event={"ID":"6f4b3be4-a694-497b-9fc5-ae54afc372d5","Type":"ContainerStarted","Data":"d5ca7c69e1c8406c06f067aebff1eefd9c61264edc90015cc047e6c2526ec88b"} Oct 30 21:53:13.326410 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:13.326357 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" event={"ID":"6f4b3be4-a694-497b-9fc5-ae54afc372d5","Type":"ContainerStarted","Data":"559e3c5c69f4869b29543c2a40ed8a8583be59cd16e93f17712cc7fdac8ed16b"} Oct 30 21:53:13.326460 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:13.326422 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" event={"ID":"6f4b3be4-a694-497b-9fc5-ae54afc372d5","Type":"ContainerStarted","Data":"f10ff13a4499f89a5e6298c969774eafd95cf70e4e991c11c5ce6ddbcdd233df"} Oct 30 21:53:13.326520 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:13.326474 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" event={"ID":"6f4b3be4-a694-497b-9fc5-ae54afc372d5","Type":"ContainerStarted","Data":"6cf4c2a0dda0f900068d31b0797fa11a05dd5d2b714735b250956028571cc941"} Oct 30 21:53:13.326570 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:13.326520 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" event={"ID":"6f4b3be4-a694-497b-9fc5-ae54afc372d5","Type":"ContainerStarted","Data":"108c76ec3f25a37d3546236f8a2828885c0ff261f1ac0522582a562813fcc1e4"} Oct 30 21:53:14.064763 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:14.064736 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:53:14.065268 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:14.064823 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzt7m" podUID="363de559-91e1-406d-bdec-36438ab7a186" Oct 30 21:53:14.330776 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:14.330698 2577 generic.go:356] "Generic (PLEG): container finished" podID="82584512-72fe-4964-a8c3-7cacc053025e" containerID="6c9d28164189b87056a62a73a3a7bda230d2312e3b35d5b25008881012320468" exitCode=0 Oct 30 21:53:14.330776 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:14.330742 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkqj8" event={"ID":"82584512-72fe-4964-a8c3-7cacc053025e","Type":"ContainerDied","Data":"6c9d28164189b87056a62a73a3a7bda230d2312e3b35d5b25008881012320468"} Oct 30 21:53:15.065537 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:15.065507 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:53:15.066045 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:15.065644 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktz7g" podUID="e28f054c-44b5-4b39-9813-a547c1b41f04" Oct 30 21:53:15.066045 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:15.065662 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:53:15.066045 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:15.065775 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kczg2" podUID="0081a009-4575-4b35-bf6b-6d12dd90067b" Oct 30 21:53:15.335707 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:15.335617 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" event={"ID":"6f4b3be4-a694-497b-9fc5-ae54afc372d5","Type":"ContainerStarted","Data":"cec905f675389547777b042249e54c3b9c99fa8896bd9169751ba58bf7edfa3d"} Oct 30 21:53:15.338695 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:15.338666 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkqj8" event={"ID":"82584512-72fe-4964-a8c3-7cacc053025e","Type":"ContainerStarted","Data":"066cadce170e4fe9ca5769e3db0d567b5831899b07c9666e1549418b7f36fd2e"} Oct 30 21:53:15.365796 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:15.365743 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hkqj8" podStartSLOduration=7.759584985 podStartE2EDuration="19.365728399s" totalImagesPullingTime="11.606143414s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:52:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:15.365578655 +0000 UTC m=+20.809126774" watchObservedRunningTime="2026-10-30 21:53:15.365728399 +0000 UTC m=+20.809276519" Oct 30 21:53:16.064257 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:16.064218 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:53:16.064456 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:16.064337 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzt7m" podUID="363de559-91e1-406d-bdec-36438ab7a186" Oct 30 21:53:17.066275 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:17.066246 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:53:17.066815 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:17.066452 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kczg2" podUID="0081a009-4575-4b35-bf6b-6d12dd90067b" Oct 30 21:53:17.066815 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:17.066504 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:53:17.066815 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:17.066640 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktz7g" podUID="e28f054c-44b5-4b39-9813-a547c1b41f04" Oct 30 21:53:17.345747 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:17.345475 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" event={"ID":"6f4b3be4-a694-497b-9fc5-ae54afc372d5","Type":"ContainerStarted","Data":"5991bda429f7ecbb5de6d46c28dfa9692e77e570f477c9c147923856424bd16b"} Oct 30 21:53:17.345882 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:17.345806 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:53:17.345882 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:17.345866 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:53:17.361152 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:17.361123 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:53:17.380588 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:17.380543 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" podStartSLOduration=7.135018513 podStartE2EDuration="22.38053072s" totalImagesPullingTime="15.245512207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:17.379097105 +0000 UTC m=+22.822645224" watchObservedRunningTime="2026-10-30 21:53:17.38053072 +0000 UTC m=+22.824078839" Oct 30 21:53:18.064395 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:18.064358 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:53:18.064573 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:18.064475 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzt7m" podUID="363de559-91e1-406d-bdec-36438ab7a186" Oct 30 21:53:18.347763 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:18.347690 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:53:18.362215 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:18.362190 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:53:19.064216 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:19.064185 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:53:19.064216 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:19.064211 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:53:19.064505 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:19.064308 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kczg2" podUID="0081a009-4575-4b35-bf6b-6d12dd90067b" Oct 30 21:53:19.064505 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:19.064438 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktz7g" podUID="e28f054c-44b5-4b39-9813-a547c1b41f04" Oct 30 21:53:20.064585 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:20.064554 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:53:20.065041 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:20.064663 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzt7m" podUID="363de559-91e1-406d-bdec-36438ab7a186" Oct 30 21:53:21.064487 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:21.064452 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:53:21.064624 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:21.064578 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktz7g" podUID="e28f054c-44b5-4b39-9813-a547c1b41f04" Oct 30 21:53:21.064624 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:21.064619 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:53:21.064930 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:21.064698 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kczg2" podUID="0081a009-4575-4b35-bf6b-6d12dd90067b" Oct 30 21:53:22.064391 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:22.064361 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:53:22.064588 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:22.064471 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzt7m" podUID="363de559-91e1-406d-bdec-36438ab7a186" Oct 30 21:53:23.063870 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:23.063834 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:53:23.064341 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:23.063948 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktz7g" podUID="e28f054c-44b5-4b39-9813-a547c1b41f04" Oct 30 21:53:23.064341 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:23.064008 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:53:23.064341 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:23.064121 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kczg2" podUID="0081a009-4575-4b35-bf6b-6d12dd90067b" Oct 30 21:53:24.064812 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:24.064778 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:53:24.065217 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:24.064877 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzt7m" podUID="363de559-91e1-406d-bdec-36438ab7a186" Oct 30 21:53:25.065057 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:25.065017 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:53:25.065506 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:25.065100 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kczg2" podUID="0081a009-4575-4b35-bf6b-6d12dd90067b" Oct 30 21:53:25.065506 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:25.065151 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:53:25.065506 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:25.065202 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktz7g" podUID="e28f054c-44b5-4b39-9813-a547c1b41f04" Oct 30 21:53:26.064802 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:26.064768 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:53:26.065000 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:26.064868 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzt7m" podUID="363de559-91e1-406d-bdec-36438ab7a186" Oct 30 21:53:26.951359 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:26.951278 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kczg2"] Oct 30 21:53:26.951754 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:26.951432 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:53:26.951754 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:26.951525 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kczg2" podUID="0081a009-4575-4b35-bf6b-6d12dd90067b" Oct 30 21:53:26.954620 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:26.954588 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dzt7m"] Oct 30 21:53:26.954738 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:26.954729 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:53:26.954871 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:26.954845 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzt7m" podUID="363de559-91e1-406d-bdec-36438ab7a186" Oct 30 21:53:26.955450 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:26.955425 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ktz7g"] Oct 30 21:53:26.955553 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:26.955543 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:53:26.955682 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:26.955654 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktz7g" podUID="e28f054c-44b5-4b39-9813-a547c1b41f04" Oct 30 21:53:28.753695 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:28.753521 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:53:28.753695 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:28.753702 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs\") pod \"network-metrics-daemon-ktz7g\" (UID: \"e28f054c-44b5-4b39-9813-a547c1b41f04\") " pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:53:28.754138 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:28.753669 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 21:53:28.754138 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:28.753807 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:53:28.754138 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:28.753818 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret podName:0081a009-4575-4b35-bf6b-6d12dd90067b nodeName:}" failed. No retries permitted until 2026-10-30 21:54:00.753802588 +0000 UTC m=+66.197350703 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret") pod "global-pull-secret-syncer-kczg2" (UID: "0081a009-4575-4b35-bf6b-6d12dd90067b") : object "kube-system"/"original-pull-secret" not registered Oct 30 21:53:28.754138 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:28.753846 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs podName:e28f054c-44b5-4b39-9813-a547c1b41f04 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:00.753834617 +0000 UTC m=+66.197382720 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs") pod "network-metrics-daemon-ktz7g" (UID: "e28f054c-44b5-4b39-9813-a547c1b41f04") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 21:53:28.854374 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:28.854342 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck7bh\" (UniqueName: \"kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh\") pod \"network-check-target-dzt7m\" (UID: \"363de559-91e1-406d-bdec-36438ab7a186\") " pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:53:28.854540 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:28.854465 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 21:53:28.854540 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:28.854478 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 21:53:28.854540 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:28.854487 2577 projected.go:196] Error preparing data for projected volume kube-api-access-ck7bh for pod openshift-network-diagnostics/network-check-target-dzt7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:53:28.854540 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:28.854532 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh podName:363de559-91e1-406d-bdec-36438ab7a186 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:00.854521602 +0000 UTC m=+66.298069701 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ck7bh" (UniqueName: "kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh") pod "network-check-target-dzt7m" (UID: "363de559-91e1-406d-bdec-36438ab7a186") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 21:53:29.064124 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:29.064050 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:53:29.064258 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:29.064061 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:53:29.064258 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:29.064145 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dzt7m" podUID="363de559-91e1-406d-bdec-36438ab7a186" Oct 30 21:53:29.064258 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:29.064216 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktz7g" podUID="e28f054c-44b5-4b39-9813-a547c1b41f04" Oct 30 21:53:29.064258 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:29.064063 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:53:29.064376 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:53:29.064285 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kczg2" podUID="0081a009-4575-4b35-bf6b-6d12dd90067b" Oct 30 21:53:29.276356 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:29.276332 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x5d7s_1928dc59-9826-41df-8599-fce8ce310d74/dns-node-resolver/0.log" Oct 30 21:53:30.075842 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:30.075814 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7zg8j_30d5a352-fc59-4709-9d83-0a756367d9e5/node-ca/0.log" Oct 30 21:53:30.821397 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:30.821340 2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeReady" Oct 30 21:53:30.821545 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:30.821494 2577 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Oct 30 21:53:30.872643 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:30.871308 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dv6jp"] Oct 30 21:53:30.893277 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:30.893238 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kb8fl"] Oct 30 21:53:30.893480 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:30.893416 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dv6jp" Oct 30 21:53:30.899359 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:30.899330 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 21:53:30.900040 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:30.899778 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l9jfx\"" Oct 30 21:53:30.900040 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:30.899864 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 21:53:30.911187 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:30.911167 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dv6jp"] Oct 30 21:53:30.911281 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:30.911208 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kb8fl"] Oct 30 21:53:30.911323 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:30.911279 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kb8fl" Oct 30 21:53:30.911323 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:30.911316 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-flp69"] Oct 30 21:53:30.924941 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:30.924920 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-flp69"] Oct 30 21:53:30.925030 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:30.925021 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:53:30.999910 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:30.999809 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 21:53:31.000093 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:30.999920 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 21:53:31.000093 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.000075 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 21:53:31.000093 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.000085 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 21:53:31.000093 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.000075 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 21:53:31.000249 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.000116 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-whw8p\"" Oct 30 21:53:31.000249 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.000126 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 21:53:31.000249 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.000191 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 21:53:31.000332 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.000259 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-sr8tx\"" Oct 30 21:53:31.064501 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.064475 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:53:31.064612 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.064475 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:53:31.064612 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.064594 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:53:31.071174 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.071155 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5nv7\" (UniqueName: \"kubernetes.io/projected/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-kube-api-access-n5nv7\") pod \"dns-default-dv6jp\" (UID: \"e94c0ad7-2799-48e6-ba5c-a10053ffe98d\") " pod="openshift-dns/dns-default-dv6jp" Oct 30 21:53:31.071255 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.071183 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjr2s\" (UniqueName: \"kubernetes.io/projected/a0a75c4a-f43c-4b77-992c-3d060b81b889-kube-api-access-bjr2s\") pod \"ingress-canary-kb8fl\" (UID: \"a0a75c4a-f43c-4b77-992c-3d060b81b889\") " pod="openshift-ingress-canary/ingress-canary-kb8fl" Oct 30 21:53:31.071255 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.071207 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-data-volume\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:53:31.071255 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.071241 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbjcs\" (UniqueName: \"kubernetes.io/projected/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-kube-api-access-qbjcs\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:53:31.071390 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.071264 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-metrics-tls\") pod \"dns-default-dv6jp\" (UID: \"e94c0ad7-2799-48e6-ba5c-a10053ffe98d\") " pod="openshift-dns/dns-default-dv6jp" Oct 30 21:53:31.071390 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.071287 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-config-volume\") pod \"dns-default-dv6jp\" (UID: \"e94c0ad7-2799-48e6-ba5c-a10053ffe98d\") " pod="openshift-dns/dns-default-dv6jp" Oct 30 21:53:31.071390 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.071324 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0a75c4a-f43c-4b77-992c-3d060b81b889-cert\") pod \"ingress-canary-kb8fl\" (UID: \"a0a75c4a-f43c-4b77-992c-3d060b81b889\") " pod="openshift-ingress-canary/ingress-canary-kb8fl" Oct 30 21:53:31.071390 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.071351 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-crio-socket\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:53:31.071510 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.071410 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-tmp-dir\") pod \"dns-default-dv6jp\" (UID: \"e94c0ad7-2799-48e6-ba5c-a10053ffe98d\") " pod="openshift-dns/dns-default-dv6jp" Oct 30 21:53:31.071510 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.071451 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:53:31.071510 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.071480 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:53:31.101170 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.101146 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 21:53:31.101170 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.101166 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 21:53:31.101575 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.101217 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-lttxg\"" Oct 30 21:53:31.101575 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.101245 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lpdnh\"" Oct 30 21:53:31.101575 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.101269 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 21:53:31.101575 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.101308 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 21:53:31.101575 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.101427 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-bwmbw\"" Oct 30 21:53:31.172779 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.172743 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5nv7\" (UniqueName: \"kubernetes.io/projected/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-kube-api-access-n5nv7\") pod \"dns-default-dv6jp\" (UID: \"e94c0ad7-2799-48e6-ba5c-a10053ffe98d\") " pod="openshift-dns/dns-default-dv6jp" Oct 30 21:53:31.172779 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.172780 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjr2s\" (UniqueName: \"kubernetes.io/projected/a0a75c4a-f43c-4b77-992c-3d060b81b889-kube-api-access-bjr2s\") pod \"ingress-canary-kb8fl\" (UID: \"a0a75c4a-f43c-4b77-992c-3d060b81b889\") " pod="openshift-ingress-canary/ingress-canary-kb8fl" Oct 30 21:53:31.173018 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.172805 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-data-volume\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:53:31.173018 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.172838 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbjcs\" (UniqueName: \"kubernetes.io/projected/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-kube-api-access-qbjcs\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:53:31.173018 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.172861 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-metrics-tls\") pod \"dns-default-dv6jp\" (UID: \"e94c0ad7-2799-48e6-ba5c-a10053ffe98d\") " pod="openshift-dns/dns-default-dv6jp" Oct 30 21:53:31.173018 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.172884 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-config-volume\") pod \"dns-default-dv6jp\" (UID: \"e94c0ad7-2799-48e6-ba5c-a10053ffe98d\") " pod="openshift-dns/dns-default-dv6jp" Oct 30 21:53:31.173018 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.172903 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0a75c4a-f43c-4b77-992c-3d060b81b889-cert\") pod \"ingress-canary-kb8fl\" (UID: \"a0a75c4a-f43c-4b77-992c-3d060b81b889\") " pod="openshift-ingress-canary/ingress-canary-kb8fl" Oct 30 21:53:31.173018 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.172928 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-crio-socket\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:53:31.173018 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.172953 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-tmp-dir\") pod \"dns-default-dv6jp\" (UID: \"e94c0ad7-2799-48e6-ba5c-a10053ffe98d\") " pod="openshift-dns/dns-default-dv6jp" Oct 30 21:53:31.173018 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.172990 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:53:31.173018 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.173016 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:53:31.173403 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.173345 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-crio-socket\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:53:31.173738 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.173713 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-data-volume\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:53:31.173811 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.173714 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-config-volume\") pod \"dns-default-dv6jp\" (UID: \"e94c0ad7-2799-48e6-ba5c-a10053ffe98d\") " pod="openshift-dns/dns-default-dv6jp" Oct 30 21:53:31.173868 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.173847 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-tmp-dir\") pod \"dns-default-dv6jp\" (UID: \"e94c0ad7-2799-48e6-ba5c-a10053ffe98d\") " pod="openshift-dns/dns-default-dv6jp" Oct 30 21:53:31.174097 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.174073 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:53:31.176933 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.176909 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:53:31.177032 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.176913 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-metrics-tls\") pod \"dns-default-dv6jp\" (UID: \"e94c0ad7-2799-48e6-ba5c-a10053ffe98d\") " pod="openshift-dns/dns-default-dv6jp" Oct 30 21:53:31.177032 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.176941 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0a75c4a-f43c-4b77-992c-3d060b81b889-cert\") pod \"ingress-canary-kb8fl\" (UID: \"a0a75c4a-f43c-4b77-992c-3d060b81b889\") " pod="openshift-ingress-canary/ingress-canary-kb8fl" Oct 30 21:53:31.184839 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.184818 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbjcs\" (UniqueName: \"kubernetes.io/projected/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-kube-api-access-qbjcs\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:53:31.185125 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.185102 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5nv7\" (UniqueName: \"kubernetes.io/projected/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-kube-api-access-n5nv7\") pod \"dns-default-dv6jp\" (UID: \"e94c0ad7-2799-48e6-ba5c-a10053ffe98d\") " pod="openshift-dns/dns-default-dv6jp" Oct 30 21:53:31.185192 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.185177 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjr2s\" (UniqueName: \"kubernetes.io/projected/a0a75c4a-f43c-4b77-992c-3d060b81b889-kube-api-access-bjr2s\") pod \"ingress-canary-kb8fl\" (UID: \"a0a75c4a-f43c-4b77-992c-3d060b81b889\") " pod="openshift-ingress-canary/ingress-canary-kb8fl" Oct 30 21:53:31.232070 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.232031 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dv6jp" Oct 30 21:53:31.249679 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.249651 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kb8fl" Oct 30 21:53:31.294500 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.294473 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:53:31.410175 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.410143 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-97866b9c9-24hdt"] Oct 30 21:53:31.427142 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.427108 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97866b9c9-24hdt"] Oct 30 21:53:31.427282 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.427250 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:31.431173 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.431147 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Oct 30 21:53:31.431452 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.431409 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Oct 30 21:53:31.431560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.431512 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nn8xr\"" Oct 30 21:53:31.431625 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.431601 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Oct 30 21:53:31.431710 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.431694 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Oct 30 21:53:31.432027 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.432013 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Oct 30 21:53:31.432088 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.432074 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Oct 30 21:53:31.432125 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.432103 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Oct 30 21:53:31.576960 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.576846 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-console-config\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:31.576960 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.576896 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96b85972-43b4-4ebf-9d98-73905b20aba8-tmp\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:31.577264 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.576964 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96b85972-43b4-4ebf-9d98-73905b20aba8-console-oauth-config\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:31.577264 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.576994 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npnjz\" (UniqueName: \"kubernetes.io/projected/96b85972-43b4-4ebf-9d98-73905b20aba8-kube-api-access-npnjz\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:31.577264 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.577058 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96b85972-43b4-4ebf-9d98-73905b20aba8-console-serving-cert\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:31.577264 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.577093 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-oauth-serving-cert\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:31.577264 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.577135 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-service-ca\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:31.605884 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.605851 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dv6jp"] Oct 30 21:53:31.607956 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.607911 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-flp69"] Oct 30 21:53:31.608785 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.608765 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kb8fl"] Oct 30 21:53:31.611280 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:53:31.611243 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode94c0ad7_2799_48e6_ba5c_a10053ffe98d.slice/crio-802240bbc87bffcbbf05e620a1a43ab3132e9487562d3be55aef05261496102e WatchSource:0}: Error finding container 802240bbc87bffcbbf05e620a1a43ab3132e9487562d3be55aef05261496102e: Status 404 returned error can't find the container with id 802240bbc87bffcbbf05e620a1a43ab3132e9487562d3be55aef05261496102e Oct 30 21:53:31.611570 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:53:31.611534 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a20bfb0_c6c5_4ebe_9d78_15cc550cdbad.slice/crio-7ef47aa9c6a96d58f868ed7c81e423e3b5e9305aa2b7d6febad1aafaaa4e1805 WatchSource:0}: Error finding container 7ef47aa9c6a96d58f868ed7c81e423e3b5e9305aa2b7d6febad1aafaaa4e1805: Status 404 returned error can't find the container with id 7ef47aa9c6a96d58f868ed7c81e423e3b5e9305aa2b7d6febad1aafaaa4e1805 Oct 30 21:53:31.612343 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:53:31.612318 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0a75c4a_f43c_4b77_992c_3d060b81b889.slice/crio-051ed441a8b3bbaae88b54bed89515c0fd9196684c8dfb00e39eb26d3dc292c1 WatchSource:0}: Error finding container 051ed441a8b3bbaae88b54bed89515c0fd9196684c8dfb00e39eb26d3dc292c1: Status 404 returned error can't find the container with id 051ed441a8b3bbaae88b54bed89515c0fd9196684c8dfb00e39eb26d3dc292c1 Oct 30 21:53:31.677859 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.677696 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96b85972-43b4-4ebf-9d98-73905b20aba8-console-serving-cert\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:31.677995 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.677869 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-oauth-serving-cert\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:31.677995 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.677895 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-service-ca\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:31.677995 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.677929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-console-config\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:31.677995 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.677945 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96b85972-43b4-4ebf-9d98-73905b20aba8-tmp\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:31.677995 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.677991 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96b85972-43b4-4ebf-9d98-73905b20aba8-console-oauth-config\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:31.678260 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.678016 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npnjz\" (UniqueName: \"kubernetes.io/projected/96b85972-43b4-4ebf-9d98-73905b20aba8-kube-api-access-npnjz\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:31.678545 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.678517 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96b85972-43b4-4ebf-9d98-73905b20aba8-tmp\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:31.678770 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.678750 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-service-ca\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:31.678817 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.678777 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-oauth-serving-cert\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:31.678817 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.678805 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-console-config\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:31.680699 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.680678 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96b85972-43b4-4ebf-9d98-73905b20aba8-console-oauth-config\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:31.680844 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.680827 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96b85972-43b4-4ebf-9d98-73905b20aba8-console-serving-cert\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:31.690638 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.690615 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npnjz\" (UniqueName: \"kubernetes.io/projected/96b85972-43b4-4ebf-9d98-73905b20aba8-kube-api-access-npnjz\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:31.746058 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:31.746021 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:32.028050 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:32.028020 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97866b9c9-24hdt"] Oct 30 21:53:32.031455 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:53:32.031429 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96b85972_43b4_4ebf_9d98_73905b20aba8.slice/crio-67fd2197a77748088e6777d53039591a9625b4d237e2ba8859488fa008cccf6f WatchSource:0}: Error finding container 67fd2197a77748088e6777d53039591a9625b4d237e2ba8859488fa008cccf6f: Status 404 returned error can't find the container with id 67fd2197a77748088e6777d53039591a9625b4d237e2ba8859488fa008cccf6f Oct 30 21:53:32.382866 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:32.382824 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flp69" event={"ID":"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad","Type":"ContainerStarted","Data":"29e0eb9b2f766ed8299353d6a90bebae429ffe6a7dc459b726dbecdf21d444d1"} Oct 30 21:53:32.383754 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:32.382895 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flp69" event={"ID":"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad","Type":"ContainerStarted","Data":"7ef47aa9c6a96d58f868ed7c81e423e3b5e9305aa2b7d6febad1aafaaa4e1805"} Oct 30 21:53:32.384589 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:32.384523 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kb8fl" event={"ID":"a0a75c4a-f43c-4b77-992c-3d060b81b889","Type":"ContainerStarted","Data":"051ed441a8b3bbaae88b54bed89515c0fd9196684c8dfb00e39eb26d3dc292c1"} Oct 30 21:53:32.386042 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:32.386014 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97866b9c9-24hdt" event={"ID":"96b85972-43b4-4ebf-9d98-73905b20aba8","Type":"ContainerStarted","Data":"67fd2197a77748088e6777d53039591a9625b4d237e2ba8859488fa008cccf6f"} Oct 30 21:53:32.387238 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:32.387216 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dv6jp" event={"ID":"e94c0ad7-2799-48e6-ba5c-a10053ffe98d","Type":"ContainerStarted","Data":"802240bbc87bffcbbf05e620a1a43ab3132e9487562d3be55aef05261496102e"} Oct 30 21:53:33.393696 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:33.393660 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flp69" event={"ID":"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad","Type":"ContainerStarted","Data":"9a74bf14bd159d098af54e6839430b8e05d2e00a845d6c4ca6d8349b40a532dc"} Oct 30 21:53:34.399100 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:34.399059 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dv6jp" event={"ID":"e94c0ad7-2799-48e6-ba5c-a10053ffe98d","Type":"ContainerStarted","Data":"eb70de06dea3c2fb635f28e3f62c092b1c7c92f098b27b9ba6ab5ccaa26d86bf"} Oct 30 21:53:34.399497 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:34.399127 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dv6jp" event={"ID":"e94c0ad7-2799-48e6-ba5c-a10053ffe98d","Type":"ContainerStarted","Data":"1eb48d116a24890e5b44cf488043e1307145b2eadd6339142bedb1600733c6fe"} Oct 30 21:53:34.399924 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:34.399899 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dv6jp" Oct 30 21:53:34.421498 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:34.421429 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-dv6jp" podStartSLOduration=2.01807608 podStartE2EDuration="4.421415615s" totalImagesPullingTime="2.403339535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:34.420181837 +0000 UTC m=+39.863729953" watchObservedRunningTime="2026-10-30 21:53:34.421415615 +0000 UTC m=+39.864963732" Oct 30 21:53:35.319650 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.319578 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq"] Oct 30 21:53:35.349841 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.349815 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt"] Oct 30 21:53:35.349967 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.349931 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" Oct 30 21:53:35.358784 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.358499 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 30 21:53:35.358784 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.358560 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Oct 30 21:53:35.358784 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.358725 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 30 21:53:35.358983 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.358806 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Oct 30 21:53:35.358983 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.358854 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 30 21:53:35.358983 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.358936 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vplhc\"" Oct 30 21:53:35.379992 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.379966 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq"] Oct 30 21:53:35.380106 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.380007 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt"] Oct 30 21:53:35.380106 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.380030 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pqvnh"] Oct 30 21:53:35.380106 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.380053 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:53:35.405443 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.405419 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Oct 30 21:53:35.405443 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.405438 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qnh5q\"" Oct 30 21:53:35.405782 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.405459 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Oct 30 21:53:35.406347 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.406330 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.459101 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.459070 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 30 21:53:35.459283 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.459129 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Oct 30 21:53:35.459283 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.459149 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 30 21:53:35.459283 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.459160 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lfmrm\"" Oct 30 21:53:35.459283 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.459167 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 30 21:53:35.512538 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.512509 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acf30d7e-4114-4fe7-bf69-c6678b18c2af-metrics-client-ca\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.512662 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.512546 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:53:35.512662 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.512567 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/acf30d7e-4114-4fe7-bf69-c6678b18c2af-root\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.512662 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.512581 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-textfile\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.512662 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.512630 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.512779 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.512687 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-tv9dq\" (UID: \"fa3d72fd-de71-426f-8841-f6fdc58ddfb5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" Oct 30 21:53:35.512779 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.512710 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:53:35.512839 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.512818 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q76v\" (UniqueName: \"kubernetes.io/projected/acf30d7e-4114-4fe7-bf69-c6678b18c2af-kube-api-access-6q76v\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.512890 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.512877 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-wtmp\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.512918 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.512909 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-tls\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.513004 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.512991 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-tv9dq\" (UID: \"fa3d72fd-de71-426f-8841-f6fdc58ddfb5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" Oct 30 21:53:35.513037 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.513014 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:53:35.513037 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.513034 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-tv9dq\" (UID: \"fa3d72fd-de71-426f-8841-f6fdc58ddfb5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" Oct 30 21:53:35.513088 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.513050 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmxhd\" (UniqueName: \"kubernetes.io/projected/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-kube-api-access-mmxhd\") pod \"openshift-state-metrics-7bd7489957-tv9dq\" (UID: \"fa3d72fd-de71-426f-8841-f6fdc58ddfb5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" Oct 30 21:53:35.513088 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.513071 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gczjz\" (UniqueName: \"kubernetes.io/projected/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-api-access-gczjz\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:53:35.513146 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.513115 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acf30d7e-4114-4fe7-bf69-c6678b18c2af-sys\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.513204 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.513192 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:53:35.513237 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.513212 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:53:35.513237 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.513228 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-accelerators-collector-config\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.613706 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.613676 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q76v\" (UniqueName: \"kubernetes.io/projected/acf30d7e-4114-4fe7-bf69-c6678b18c2af-kube-api-access-6q76v\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.613863 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.613718 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-wtmp\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.613863 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.613751 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-tls\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.613863 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.613793 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-tv9dq\" (UID: \"fa3d72fd-de71-426f-8841-f6fdc58ddfb5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" Oct 30 21:53:35.613863 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.613813 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:53:35.613863 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.613838 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-tv9dq\" (UID: \"fa3d72fd-de71-426f-8841-f6fdc58ddfb5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" Oct 30 21:53:35.614108 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.613866 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmxhd\" (UniqueName: \"kubernetes.io/projected/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-kube-api-access-mmxhd\") pod \"openshift-state-metrics-7bd7489957-tv9dq\" (UID: \"fa3d72fd-de71-426f-8841-f6fdc58ddfb5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" Oct 30 21:53:35.614108 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.613866 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-wtmp\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.614108 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.613890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gczjz\" (UniqueName: \"kubernetes.io/projected/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-api-access-gczjz\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:53:35.614108 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.613918 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acf30d7e-4114-4fe7-bf69-c6678b18c2af-sys\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.614108 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.613968 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:53:35.614108 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.613996 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:53:35.614108 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.614018 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-accelerators-collector-config\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.614108 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.614049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acf30d7e-4114-4fe7-bf69-c6678b18c2af-metrics-client-ca\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.614108 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.614079 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:53:35.614108 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.614108 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/acf30d7e-4114-4fe7-bf69-c6678b18c2af-root\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.614610 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.614131 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-textfile\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.614610 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.614154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.614610 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.614210 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-tv9dq\" (UID: \"fa3d72fd-de71-426f-8841-f6fdc58ddfb5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" Oct 30 21:53:35.614610 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.614246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:53:35.614610 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.614549 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acf30d7e-4114-4fe7-bf69-c6678b18c2af-sys\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.614841 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.614749 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-tv9dq\" (UID: \"fa3d72fd-de71-426f-8841-f6fdc58ddfb5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" Oct 30 21:53:35.615704 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.615010 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:53:35.615704 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.615073 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/acf30d7e-4114-4fe7-bf69-c6678b18c2af-root\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.615704 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.615185 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:53:35.615704 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.615361 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-textfile\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.615704 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.615640 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acf30d7e-4114-4fe7-bf69-c6678b18c2af-metrics-client-ca\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.615704 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.615642 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-accelerators-collector-config\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.616182 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.615900 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:53:35.618878 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.618852 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-tv9dq\" (UID: \"fa3d72fd-de71-426f-8841-f6fdc58ddfb5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" Oct 30 21:53:35.619003 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.618859 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:53:35.619198 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.619171 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-tls\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.619269 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.619219 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.619314 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.619294 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-tv9dq\" (UID: \"fa3d72fd-de71-426f-8841-f6fdc58ddfb5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" Oct 30 21:53:35.619346 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.619301 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:53:35.626682 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.626663 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gczjz\" (UniqueName: \"kubernetes.io/projected/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-api-access-gczjz\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:53:35.627191 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.627168 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmxhd\" (UniqueName: \"kubernetes.io/projected/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-kube-api-access-mmxhd\") pod \"openshift-state-metrics-7bd7489957-tv9dq\" (UID: \"fa3d72fd-de71-426f-8841-f6fdc58ddfb5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" Oct 30 21:53:35.627556 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.627539 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q76v\" (UniqueName: \"kubernetes.io/projected/acf30d7e-4114-4fe7-bf69-c6678b18c2af-kube-api-access-6q76v\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:35.723420 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.723373 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" Oct 30 21:53:35.828946 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.828882 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:53:35.848051 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:35.848030 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:53:36.247029 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.246854 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq"] Oct 30 21:53:36.249942 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:53:36.249917 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa3d72fd_de71_426f_8841_f6fdc58ddfb5.slice/crio-fb039c423b1e77b2504bd0a21f55fc98d49047c675e9e637ab7357fd0be2bc09 WatchSource:0}: Error finding container fb039c423b1e77b2504bd0a21f55fc98d49047c675e9e637ab7357fd0be2bc09: Status 404 returned error can't find the container with id fb039c423b1e77b2504bd0a21f55fc98d49047c675e9e637ab7357fd0be2bc09 Oct 30 21:53:36.261178 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.261154 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt"] Oct 30 21:53:36.264366 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:53:36.264344 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7af64ff_9b50_4567_9016_b0cdd4ac7b15.slice/crio-41022de65bd978786a192e634be1208f27d858785e232582ff4afe7746615ea0 WatchSource:0}: Error finding container 41022de65bd978786a192e634be1208f27d858785e232582ff4afe7746615ea0: Status 404 returned error can't find the container with id 41022de65bd978786a192e634be1208f27d858785e232582ff4afe7746615ea0 Oct 30 21:53:36.376913 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.376890 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 21:53:36.415015 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.414986 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 21:53:36.415883 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.415051 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" event={"ID":"fa3d72fd-de71-426f-8841-f6fdc58ddfb5","Type":"ContainerStarted","Data":"2f4d0a4e878d153775371ed81e8979b0fdbf57fd1992e394243bc44faf103742"} Oct 30 21:53:36.415883 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.415092 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" event={"ID":"fa3d72fd-de71-426f-8841-f6fdc58ddfb5","Type":"ContainerStarted","Data":"fb039c423b1e77b2504bd0a21f55fc98d49047c675e9e637ab7357fd0be2bc09"} Oct 30 21:53:36.415883 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.415120 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" event={"ID":"a7af64ff-9b50-4567-9016-b0cdd4ac7b15","Type":"ContainerStarted","Data":"41022de65bd978786a192e634be1208f27d858785e232582ff4afe7746615ea0"} Oct 30 21:53:36.415883 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.415146 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flp69" event={"ID":"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad","Type":"ContainerStarted","Data":"86a29fb85469ee1b77f8160bb5a0fa32ed3b1606d16eea4f2df2ef615ab8fd44"} Oct 30 21:53:36.415883 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.415092 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.415883 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.415177 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kb8fl" event={"ID":"a0a75c4a-f43c-4b77-992c-3d060b81b889","Type":"ContainerStarted","Data":"52a00d1ca5a220ebbbcefa18bdd51b34a618f4147fc5006ee24a8dd7642314ef"} Oct 30 21:53:36.416445 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.416418 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97866b9c9-24hdt" event={"ID":"96b85972-43b4-4ebf-9d98-73905b20aba8","Type":"ContainerStarted","Data":"556132bf3e93067bbb1b7db654d63179b8125396b3d4730d659fd38578e75000"} Oct 30 21:53:36.417730 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.417705 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pqvnh" event={"ID":"acf30d7e-4114-4fe7-bf69-c6678b18c2af","Type":"ContainerStarted","Data":"cf38dc99f92c9e228ebf060b3455d9568001fd47b716bbfca7d11303873a3434"} Oct 30 21:53:36.419242 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.419226 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Oct 30 21:53:36.419324 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.419277 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Oct 30 21:53:36.419324 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.419288 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Oct 30 21:53:36.419437 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.419422 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Oct 30 21:53:36.419539 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.419432 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Oct 30 21:53:36.419539 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.419425 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Oct 30 21:53:36.419539 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.419461 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nqd4m\"" Oct 30 21:53:36.419539 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.419463 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Oct 30 21:53:36.419539 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.419476 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Oct 30 21:53:36.423680 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.423664 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Oct 30 21:53:36.432334 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.432294 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-flp69" podStartSLOduration=2.70156529 podStartE2EDuration="6.432282862s" totalImagesPullingTime="3.730717572s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:53:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:36.43125412 +0000 UTC m=+41.874802241" watchObservedRunningTime="2026-10-30 21:53:36.432282862 +0000 UTC m=+41.875830992" Oct 30 21:53:36.448495 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.448436 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kb8fl" podStartSLOduration=2.532742812 podStartE2EDuration="6.448419453s" totalImagesPullingTime="3.915676641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:36.448131633 +0000 UTC m=+41.891679754" watchObservedRunningTime="2026-10-30 21:53:36.448419453 +0000 UTC m=+41.891967629" Oct 30 21:53:36.503737 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.503636 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-97866b9c9-24hdt" podStartSLOduration=1.590817672 podStartE2EDuration="5.503619939s" totalImagesPullingTime="3.912802267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:36.47394607 +0000 UTC m=+41.917494194" watchObservedRunningTime="2026-10-30 21:53:36.503619939 +0000 UTC m=+41.947168101" Oct 30 21:53:36.522975 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.522943 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.523126 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.523083 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.523197 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.523140 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.523285 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.523266 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.523316 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.523294 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.523348 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.523319 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-web-config\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.523443 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.523425 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.523537 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.523519 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-config-out\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.523604 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.523583 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.523678 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.523661 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.523916 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.523897 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb9cn\" (UniqueName: \"kubernetes.io/projected/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-kube-api-access-hb9cn\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.523964 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.523950 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.524011 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.523999 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-config-volume\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.625373 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.625337 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-config-volume\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.625581 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.625434 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.625581 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.625454 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.625581 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.625471 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.625581 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.625515 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.625581 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.625534 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.626148 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.626124 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-web-config\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.626256 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.626172 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.626256 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.626195 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-config-out\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.626256 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.626223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.626256 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.626252 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.626429 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.626263 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.626429 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.626299 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb9cn\" (UniqueName: \"kubernetes.io/projected/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-kube-api-access-hb9cn\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.626429 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.626328 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.630778 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.629932 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-config-out\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.630778 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.630169 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.630778 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.630170 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.630778 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.630275 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.630778 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.630317 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.630778 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.630590 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.630778 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.630746 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.631040 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.630851 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-config-volume\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.634034 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.634007 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.634145 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.634128 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-web-config\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.634364 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.634337 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.643126 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.643097 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb9cn\" (UniqueName: \"kubernetes.io/projected/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-kube-api-access-hb9cn\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:36.821925 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:36.821853 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:53:37.132324 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.132284 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 21:53:37.137121 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:53:37.136890 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd24ddebb_3f30_4295_bc6c_1e8adf037cb9.slice/crio-f0a39f51aa230f8fd6257b67119920ef316b4edb5d0adde16ce696c264f41d14 WatchSource:0}: Error finding container f0a39f51aa230f8fd6257b67119920ef316b4edb5d0adde16ce696c264f41d14: Status 404 returned error can't find the container with id f0a39f51aa230f8fd6257b67119920ef316b4edb5d0adde16ce696c264f41d14 Oct 30 21:53:37.418852 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.418768 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-57888bcfc4-5g9tj"] Oct 30 21:53:37.448422 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.448111 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d24ddebb-3f30-4295-bc6c-1e8adf037cb9","Type":"ContainerStarted","Data":"f0a39f51aa230f8fd6257b67119920ef316b4edb5d0adde16ce696c264f41d14"} Oct 30 21:53:37.448422 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.448178 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" event={"ID":"fa3d72fd-de71-426f-8841-f6fdc58ddfb5","Type":"ContainerStarted","Data":"b67871b393ba1a9953d8e9eaf366731a6ca7ee924c613f339a6a4d1ef1b69422"} Oct 30 21:53:37.448422 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.448215 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-57888bcfc4-5g9tj"] Oct 30 21:53:37.448422 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.448223 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.456323 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.456289 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Oct 30 21:53:37.456513 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.456428 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Oct 30 21:53:37.456513 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.456472 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Oct 30 21:53:37.456513 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.456496 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Oct 30 21:53:37.457153 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.457134 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-czqxc\"" Oct 30 21:53:37.457153 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.457141 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9v7gcturvjje9\"" Oct 30 21:53:37.457346 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.457233 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Oct 30 21:53:37.543689 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.543655 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0268731b-5534-46e0-a079-4998617d8048-tmp\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.543841 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.543705 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.543841 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.543777 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.543841 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.543831 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0268731b-5534-46e0-a079-4998617d8048-metrics-client-ca\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.543987 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.543847 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-grpc-tls\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.543987 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.543870 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr48z\" (UniqueName: \"kubernetes.io/projected/0268731b-5534-46e0-a079-4998617d8048-kube-api-access-vr48z\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.543987 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.543911 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-tls\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.543987 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.543938 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.543987 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.543960 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.644948 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.644918 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-tls\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.644948 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.644953 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.645136 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.644978 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.645136 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.645005 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0268731b-5534-46e0-a079-4998617d8048-tmp\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.645136 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.645025 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.645136 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.645062 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.645136 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.645112 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0268731b-5534-46e0-a079-4998617d8048-metrics-client-ca\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.645136 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.645136 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-grpc-tls\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.645318 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.645163 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr48z\" (UniqueName: \"kubernetes.io/projected/0268731b-5534-46e0-a079-4998617d8048-kube-api-access-vr48z\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.646757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.646367 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0268731b-5534-46e0-a079-4998617d8048-tmp\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.646757 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.646750 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0268731b-5534-46e0-a079-4998617d8048-metrics-client-ca\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.649308 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.648995 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.649308 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.649278 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.649466 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.649356 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-grpc-tls\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.651287 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.650984 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.651287 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.651243 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-tls\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.652325 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.652306 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.660150 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.660114 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr48z\" (UniqueName: \"kubernetes.io/projected/0268731b-5534-46e0-a079-4998617d8048-kube-api-access-vr48z\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:37.897823 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:37.897790 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:38.227160 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:38.226801 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-57888bcfc4-5g9tj"] Oct 30 21:53:38.296281 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:53:38.296160 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0268731b_5534_46e0_a079_4998617d8048.slice/crio-6995b8917988447b3525b6e9d908a0bdd4721bd665e977ec45267eb4ac6a211a WatchSource:0}: Error finding container 6995b8917988447b3525b6e9d908a0bdd4721bd665e977ec45267eb4ac6a211a: Status 404 returned error can't find the container with id 6995b8917988447b3525b6e9d908a0bdd4721bd665e977ec45267eb4ac6a211a Oct 30 21:53:38.430971 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:38.430938 2577 generic.go:356] "Generic (PLEG): container finished" podID="acf30d7e-4114-4fe7-bf69-c6678b18c2af" containerID="705999e7e928b598ce280fba69a5f361f51ada6022e01f80d0c4f8aa99ca2bba" exitCode=0 Oct 30 21:53:38.431817 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:38.431035 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pqvnh" event={"ID":"acf30d7e-4114-4fe7-bf69-c6678b18c2af","Type":"ContainerDied","Data":"705999e7e928b598ce280fba69a5f361f51ada6022e01f80d0c4f8aa99ca2bba"} Oct 30 21:53:38.435501 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:38.435477 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" event={"ID":"fa3d72fd-de71-426f-8841-f6fdc58ddfb5","Type":"ContainerStarted","Data":"f82570fe8b06a76221fc1f5d04f3365b8ffabfaa1b2e07c7e58134c2eea8795c"} Oct 30 21:53:38.437746 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:38.437714 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" event={"ID":"a7af64ff-9b50-4567-9016-b0cdd4ac7b15","Type":"ContainerStarted","Data":"5fcfda67a4d9304b187809857e9e6f464720a8ba42de8f1db513ca957cc33d6d"} Oct 30 21:53:38.439765 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:38.439689 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" event={"ID":"0268731b-5534-46e0-a079-4998617d8048","Type":"ContainerStarted","Data":"6995b8917988447b3525b6e9d908a0bdd4721bd665e977ec45267eb4ac6a211a"} Oct 30 21:53:38.477977 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:38.477913 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" podStartSLOduration=1.967032046 podStartE2EDuration="3.477891264s" totalImagesPullingTime="1.510859218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:38.473990003 +0000 UTC m=+43.917538119" watchObservedRunningTime="2026-10-30 21:53:38.477891264 +0000 UTC m=+43.921439387" Oct 30 21:53:39.446903 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.446357 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pqvnh" event={"ID":"acf30d7e-4114-4fe7-bf69-c6678b18c2af","Type":"ContainerStarted","Data":"5689762e959c7a5ba4ba2ca3fd91a7f509e1d2b6c0ed0354f85dce862c72aab0"} Oct 30 21:53:39.446903 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.446450 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pqvnh" event={"ID":"acf30d7e-4114-4fe7-bf69-c6678b18c2af","Type":"ContainerStarted","Data":"bc94e59088a297615b899eedce2b2f8aaca11a7de98069460f2fcddbaf9cbaf9"} Oct 30 21:53:39.449268 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.448746 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" event={"ID":"a7af64ff-9b50-4567-9016-b0cdd4ac7b15","Type":"ContainerStarted","Data":"47a7a36eae7030a8769bceac8b2e5fd9d025459bc9c5e1383b5625f0a23b42ce"} Oct 30 21:53:39.449268 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.448797 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" event={"ID":"a7af64ff-9b50-4567-9016-b0cdd4ac7b15","Type":"ContainerStarted","Data":"0ff814cb59c215b27fe81a2a1794d56d89611f3ed0aaccf16f7c59a9f2506089"} Oct 30 21:53:39.450337 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.450317 2577 generic.go:356] "Generic (PLEG): container finished" podID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerID="c78978e7e8af877cc442f8a41d3c68b09513f0020b5a5a08bdb286fba12e22cd" exitCode=0 Oct 30 21:53:39.450461 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.450399 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d24ddebb-3f30-4295-bc6c-1e8adf037cb9","Type":"ContainerDied","Data":"c78978e7e8af877cc442f8a41d3c68b09513f0020b5a5a08bdb286fba12e22cd"} Oct 30 21:53:39.470454 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.470373 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pqvnh" podStartSLOduration=2.8403185669999997 podStartE2EDuration="4.470358469s" totalImagesPullingTime="1.532268492s" totalInitContainerRuntime="97.77141ms" isStatefulPod=true podCreationTimestamp="2026-10-30 21:53:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:39.468679672 +0000 UTC m=+44.912227829" watchObservedRunningTime="2026-10-30 21:53:39.470358469 +0000 UTC m=+44.913906598" Oct 30 21:53:39.491438 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.491352 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" podStartSLOduration=2.429598222 podStartE2EDuration="4.49133232s" totalImagesPullingTime="2.061734098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:39.490284535 +0000 UTC m=+44.933832668" watchObservedRunningTime="2026-10-30 21:53:39.49133232 +0000 UTC m=+44.934880440" Oct 30 21:53:39.684818 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.684778 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-67979d6695-hbngh"] Oct 30 21:53:39.688445 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.688420 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:53:39.692846 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.692789 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Oct 30 21:53:39.692846 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.692825 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Oct 30 21:53:39.698007 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.697617 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-67979d6695-hbngh"] Oct 30 21:53:39.724319 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.724273 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Oct 30 21:53:39.724319 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.724327 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qzlv4\"" Oct 30 21:53:39.724567 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.724419 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-98tjekdqudah9\"" Oct 30 21:53:39.724567 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.724418 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Oct 30 21:53:39.764900 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.764861 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ed8c71ed-0f37-4927-b52d-5966421f9978-audit-log\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:53:39.764900 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.764908 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ed8c71ed-0f37-4927-b52d-5966421f9978-secret-metrics-server-client-certs\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:53:39.765148 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.764933 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2qvr\" (UniqueName: \"kubernetes.io/projected/ed8c71ed-0f37-4927-b52d-5966421f9978-kube-api-access-n2qvr\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:53:39.765148 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.765032 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ed8c71ed-0f37-4927-b52d-5966421f9978-metrics-server-audit-profiles\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:53:39.765148 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.765106 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed8c71ed-0f37-4927-b52d-5966421f9978-client-ca-bundle\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:53:39.765294 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.765149 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ed8c71ed-0f37-4927-b52d-5966421f9978-secret-metrics-server-tls\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:53:39.765294 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.765234 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed8c71ed-0f37-4927-b52d-5966421f9978-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:53:39.865892 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.865854 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed8c71ed-0f37-4927-b52d-5966421f9978-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:53:39.866075 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.865931 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ed8c71ed-0f37-4927-b52d-5966421f9978-audit-log\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:53:39.866075 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.865956 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ed8c71ed-0f37-4927-b52d-5966421f9978-secret-metrics-server-client-certs\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:53:39.866075 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.865971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2qvr\" (UniqueName: \"kubernetes.io/projected/ed8c71ed-0f37-4927-b52d-5966421f9978-kube-api-access-n2qvr\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:53:39.866075 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.865997 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ed8c71ed-0f37-4927-b52d-5966421f9978-metrics-server-audit-profiles\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:53:39.866075 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.866040 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed8c71ed-0f37-4927-b52d-5966421f9978-client-ca-bundle\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:53:39.866299 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.866081 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ed8c71ed-0f37-4927-b52d-5966421f9978-secret-metrics-server-tls\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:53:39.866753 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.866722 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed8c71ed-0f37-4927-b52d-5966421f9978-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:53:39.866862 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.866759 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ed8c71ed-0f37-4927-b52d-5966421f9978-audit-log\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:53:39.867352 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.867328 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ed8c71ed-0f37-4927-b52d-5966421f9978-metrics-server-audit-profiles\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:53:39.869275 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.869236 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ed8c71ed-0f37-4927-b52d-5966421f9978-secret-metrics-server-tls\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:53:39.869395 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.869349 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed8c71ed-0f37-4927-b52d-5966421f9978-client-ca-bundle\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:53:39.869518 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.869497 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ed8c71ed-0f37-4927-b52d-5966421f9978-secret-metrics-server-client-certs\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:53:39.881109 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:39.881085 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2qvr\" (UniqueName: \"kubernetes.io/projected/ed8c71ed-0f37-4927-b52d-5966421f9978-kube-api-access-n2qvr\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:53:40.003832 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:40.003738 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:53:40.080986 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:40.080810 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-k7cl2"] Oct 30 21:53:40.086796 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:40.086768 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7cl2" Oct 30 21:53:40.096770 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:40.096202 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-k7cl2"] Oct 30 21:53:40.096770 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:40.096494 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-zt887\"" Oct 30 21:53:40.096770 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:40.096557 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Oct 30 21:53:40.169125 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:40.169088 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0b20b31-4338-40f4-82fb-55e7f9bafa3c-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-k7cl2\" (UID: \"a0b20b31-4338-40f4-82fb-55e7f9bafa3c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7cl2" Oct 30 21:53:40.169307 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:40.169184 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4cjk\" (UniqueName: \"kubernetes.io/projected/a0b20b31-4338-40f4-82fb-55e7f9bafa3c-kube-api-access-q4cjk\") pod \"monitoring-plugin-77f4f76594-k7cl2\" (UID: \"a0b20b31-4338-40f4-82fb-55e7f9bafa3c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7cl2" Oct 30 21:53:40.270343 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:40.270265 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0b20b31-4338-40f4-82fb-55e7f9bafa3c-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-k7cl2\" (UID: \"a0b20b31-4338-40f4-82fb-55e7f9bafa3c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7cl2" Oct 30 21:53:40.270517 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:40.270343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4cjk\" (UniqueName: \"kubernetes.io/projected/a0b20b31-4338-40f4-82fb-55e7f9bafa3c-kube-api-access-q4cjk\") pod \"monitoring-plugin-77f4f76594-k7cl2\" (UID: \"a0b20b31-4338-40f4-82fb-55e7f9bafa3c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7cl2" Oct 30 21:53:40.273911 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:40.273883 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0b20b31-4338-40f4-82fb-55e7f9bafa3c-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-k7cl2\" (UID: \"a0b20b31-4338-40f4-82fb-55e7f9bafa3c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7cl2" Oct 30 21:53:40.283099 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:40.283076 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4cjk\" (UniqueName: \"kubernetes.io/projected/a0b20b31-4338-40f4-82fb-55e7f9bafa3c-kube-api-access-q4cjk\") pod \"monitoring-plugin-77f4f76594-k7cl2\" (UID: \"a0b20b31-4338-40f4-82fb-55e7f9bafa3c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7cl2" Oct 30 21:53:40.301834 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:40.301753 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-67979d6695-hbngh"] Oct 30 21:53:40.310783 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:53:40.310752 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded8c71ed_0f37_4927_b52d_5966421f9978.slice/crio-a779abf5a29e7d6c15b2c0d08b0e6ec14e95428cec2d15f340fe0ad65861761c WatchSource:0}: Error finding container a779abf5a29e7d6c15b2c0d08b0e6ec14e95428cec2d15f340fe0ad65861761c: Status 404 returned error can't find the container with id a779abf5a29e7d6c15b2c0d08b0e6ec14e95428cec2d15f340fe0ad65861761c Oct 30 21:53:40.402985 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:40.402961 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7cl2" Oct 30 21:53:40.457688 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:40.456116 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-67979d6695-hbngh" event={"ID":"ed8c71ed-0f37-4927-b52d-5966421f9978","Type":"ContainerStarted","Data":"a779abf5a29e7d6c15b2c0d08b0e6ec14e95428cec2d15f340fe0ad65861761c"} Oct 30 21:53:40.458401 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:40.458148 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" event={"ID":"0268731b-5534-46e0-a079-4998617d8048","Type":"ContainerStarted","Data":"ae7bfc0e58393bb58a4225f333818a9adbf4d912013273c84f4dcd6691d01ea1"} Oct 30 21:53:40.458401 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:40.458198 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" event={"ID":"0268731b-5534-46e0-a079-4998617d8048","Type":"ContainerStarted","Data":"d56e398e27411602f810af9535dc0da31c5973a513edd434d860c253e659c8ff"} Oct 30 21:53:40.692508 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:40.692473 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-k7cl2"] Oct 30 21:53:40.696555 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:53:40.696526 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0b20b31_4338_40f4_82fb_55e7f9bafa3c.slice/crio-a719f05f4ed357bdc371bdbe7a3d6b52f868c64dfbd92cd53fcd7a2abc6a0917 WatchSource:0}: Error finding container a719f05f4ed357bdc371bdbe7a3d6b52f868c64dfbd92cd53fcd7a2abc6a0917: Status 404 returned error can't find the container with id a719f05f4ed357bdc371bdbe7a3d6b52f868c64dfbd92cd53fcd7a2abc6a0917 Oct 30 21:53:41.471555 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.471309 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d24ddebb-3f30-4295-bc6c-1e8adf037cb9","Type":"ContainerStarted","Data":"34199c2cc199efb1b1064ba2e7108967f351ad188b5bb9b4392256106088b4d7"} Oct 30 21:53:41.471851 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.471616 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d24ddebb-3f30-4295-bc6c-1e8adf037cb9","Type":"ContainerStarted","Data":"a6e19020732e2ef5fe8a5b92b1b7903f609e351465549904056976bee570d1d0"} Oct 30 21:53:41.471851 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.471669 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d24ddebb-3f30-4295-bc6c-1e8adf037cb9","Type":"ContainerStarted","Data":"9de38abea22a0d3a09e608a11e58aa0d2d798ee0ffd689901125214fdd2f786e"} Oct 30 21:53:41.471851 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.471709 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d24ddebb-3f30-4295-bc6c-1e8adf037cb9","Type":"ContainerStarted","Data":"d4667f4ebb55938df9156f226eb0ef7aae82dd5ed80113af453eebcb10f8c367"} Oct 30 21:53:41.471851 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.471748 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d24ddebb-3f30-4295-bc6c-1e8adf037cb9","Type":"ContainerStarted","Data":"7daf53af9532eeb059fdea4a0e58fc036de29c4560630f9e819efbf0fabe0d13"} Oct 30 21:53:41.473407 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.473341 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7cl2" event={"ID":"a0b20b31-4338-40f4-82fb-55e7f9bafa3c","Type":"ContainerStarted","Data":"a719f05f4ed357bdc371bdbe7a3d6b52f868c64dfbd92cd53fcd7a2abc6a0917"} Oct 30 21:53:41.477864 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.477818 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" event={"ID":"0268731b-5534-46e0-a079-4998617d8048","Type":"ContainerStarted","Data":"c6641ec769889f9d1d0fcfd9871a6720920447a098966ffa671a6f0a66d40f28"} Oct 30 21:53:41.477938 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.477884 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" event={"ID":"0268731b-5534-46e0-a079-4998617d8048","Type":"ContainerStarted","Data":"10f0dec52ca3136ee79e404792fa28d88bedd05963361f02db5889b7561a0f35"} Oct 30 21:53:41.684991 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.684959 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 30 21:53:41.689853 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.689780 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.695561 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.695536 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Oct 30 21:53:41.695696 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.695572 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Oct 30 21:53:41.695696 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.695573 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Oct 30 21:53:41.695954 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.695938 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Oct 30 21:53:41.696048 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.696035 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Oct 30 21:53:41.696048 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.696040 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Oct 30 21:53:41.696150 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.696077 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Oct 30 21:53:41.696150 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.696122 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Oct 30 21:53:41.696150 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.696127 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Oct 30 21:53:41.696287 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.696182 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Oct 30 21:53:41.696287 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.696245 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Oct 30 21:53:41.696676 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.696664 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5mpvw\"" Oct 30 21:53:41.696745 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.696704 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-49cblkfdffbbv\"" Oct 30 21:53:41.704342 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.704301 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Oct 30 21:53:41.704453 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.704443 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Oct 30 21:53:41.704552 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.704520 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Oct 30 21:53:41.711171 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.711148 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 30 21:53:41.750162 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.748445 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:41.750162 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.748544 2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:41.757192 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.757167 2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:41.788676 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.786771 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.788676 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.786811 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.788676 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.786850 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q97n\" (UniqueName: \"kubernetes.io/projected/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-kube-api-access-6q97n\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.788676 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.786895 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.788676 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.786924 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.788676 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.786946 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.788676 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.786971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.788676 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.787022 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.788676 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.787109 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.788676 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.787157 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.788676 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.787189 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.788676 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.787212 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.788676 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.787244 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.788676 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.787268 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.788676 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.787309 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-config\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.788676 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.787330 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-web-config\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.789253 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.787396 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.789253 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.787466 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.789253 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.787489 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.789253 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.787536 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-config-out\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.888493 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.888405 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.888493 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.888455 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.888493 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.888488 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.888711 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.888513 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.888711 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.888542 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-config\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.888711 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.888561 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-web-config\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.888711 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.888587 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.888711 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.888625 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.888711 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.888649 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.888711 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.888679 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-config-out\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.888711 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.888701 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.888982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.888722 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.888982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.888745 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q97n\" (UniqueName: \"kubernetes.io/projected/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-kube-api-access-6q97n\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.888982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.888770 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.888982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.888796 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.888982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.888819 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.888982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.888839 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.888982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.888861 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.888982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.888906 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.888982 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.888923 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.889775 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.889741 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.889902 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.889874 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.890343 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.890314 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.890614 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.890535 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.890614 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.890585 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.891906 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.891530 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.892666 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.892640 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.893180 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.893144 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.893754 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.893553 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-config-out\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.897555 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.897532 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-web-config\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.898108 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.897804 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-config\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.898108 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.897946 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.898108 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.898023 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.898108 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.898073 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.898816 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.898773 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.898816 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.898805 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.898949 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.898883 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.899580 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.899556 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.899679 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.899635 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:41.916571 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:41.916543 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q97n\" (UniqueName: \"kubernetes.io/projected/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-kube-api-access-6q97n\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:42.025403 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:42.025343 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:42.336625 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:42.336540 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 30 21:53:42.340083 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:53:42.340052 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ba3773_93d3_4b6b_b45d_a23ce6483e29.slice/crio-b14e234c177b9a6eae445efd4450f7527810442cb73501e6289dc1affd4fbb4c WatchSource:0}: Error finding container b14e234c177b9a6eae445efd4450f7527810442cb73501e6289dc1affd4fbb4c: Status 404 returned error can't find the container with id b14e234c177b9a6eae445efd4450f7527810442cb73501e6289dc1affd4fbb4c Oct 30 21:53:42.483489 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:42.483412 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-67979d6695-hbngh" event={"ID":"ed8c71ed-0f37-4927-b52d-5966421f9978","Type":"ContainerStarted","Data":"6578eb5ec0f01b2d1e944d631497b7f601284a38f3f3a83a5cca2eea40c5e06f"} Oct 30 21:53:42.485060 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:42.485029 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7cl2" event={"ID":"a0b20b31-4338-40f4-82fb-55e7f9bafa3c","Type":"ContainerStarted","Data":"0c3583d54eeb696a495ee2402e29c221ed12d39ea57b91a67141a299f480fc40"} Oct 30 21:53:42.485305 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:42.485187 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7cl2" Oct 30 21:53:42.486784 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:42.486762 2577 generic.go:356] "Generic (PLEG): container finished" podID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerID="6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22" exitCode=0 Oct 30 21:53:42.486887 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:42.486818 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9ba3773-93d3-4b6b-b45d-a23ce6483e29","Type":"ContainerDied","Data":"6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22"} Oct 30 21:53:42.486887 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:42.486881 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9ba3773-93d3-4b6b-b45d-a23ce6483e29","Type":"ContainerStarted","Data":"b14e234c177b9a6eae445efd4450f7527810442cb73501e6289dc1affd4fbb4c"} Oct 30 21:53:42.491069 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:42.491053 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7cl2" Oct 30 21:53:42.491459 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:42.491437 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" event={"ID":"0268731b-5534-46e0-a079-4998617d8048","Type":"ContainerStarted","Data":"4620ef17278b35d6e89e5e3e036ceccd0b98c7aea705ad9152d649f26f02e6da"} Oct 30 21:53:42.491552 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:42.491498 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" event={"ID":"0268731b-5534-46e0-a079-4998617d8048","Type":"ContainerStarted","Data":"d3adcec3c34f8253aa115f0765cb9675b2ef69046870fe7f3bcccf51503687e1"} Oct 30 21:53:42.491612 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:42.491559 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:42.496392 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:42.496360 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d24ddebb-3f30-4295-bc6c-1e8adf037cb9","Type":"ContainerStarted","Data":"a696b8eb58c851d4fd25fb75a70633bbb94b7f6b2a6c9e92e09bb55373213e38"} Oct 30 21:53:42.500138 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:42.500120 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:53:42.504458 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:42.504421 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-67979d6695-hbngh" podStartSLOduration=1.600862639 podStartE2EDuration="3.504409024s" totalImagesPullingTime="1.903546385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:42.503416161 +0000 UTC m=+47.946964281" watchObservedRunningTime="2026-10-30 21:53:42.504409024 +0000 UTC m=+47.947957142" Oct 30 21:53:42.574265 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:42.574213 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.916812178 podStartE2EDuration="6.574200098s" totalImagesPullingTime="3.642419366s" totalInitContainerRuntime="14.968554ms" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:42.572270311 +0000 UTC m=+48.015818451" watchObservedRunningTime="2026-10-30 21:53:42.574200098 +0000 UTC m=+48.017748218" Oct 30 21:53:42.598421 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:42.598349 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7cl2" podStartSLOduration=1.030086486 podStartE2EDuration="2.598330392s" totalImagesPullingTime="1.568243906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:42.595153325 +0000 UTC m=+48.038701440" watchObservedRunningTime="2026-10-30 21:53:42.598330392 +0000 UTC m=+48.041878513" Oct 30 21:53:42.656441 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:42.656366 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" podStartSLOduration=2.821590686 podStartE2EDuration="5.656344849s" totalImagesPullingTime="2.834754163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:42.653843784 +0000 UTC m=+48.097391904" watchObservedRunningTime="2026-10-30 21:53:42.656344849 +0000 UTC m=+48.099892986" Oct 30 21:53:43.854531 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:43.854489 2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-cccc5c698-lcpx2"] Oct 30 21:53:43.858317 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:43.858289 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:43.869743 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:43.869698 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Oct 30 21:53:43.872803 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:43.872777 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cccc5c698-lcpx2"] Oct 30 21:53:43.909653 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:43.909609 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-serving-cert\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:43.909817 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:43.909659 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-trusted-ca-bundle\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:43.909817 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:43.909798 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjd2f\" (UniqueName: \"kubernetes.io/projected/28b52705-cfb1-42c3-8942-e4ec290bf01a-kube-api-access-kjd2f\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:43.909908 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:43.909870 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-oauth-serving-cert\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:43.909952 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:43.909934 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-service-ca\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:43.910002 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:43.909993 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28b52705-cfb1-42c3-8942-e4ec290bf01a-tmp\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:43.910063 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:43.910048 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-oauth-config\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:43.910102 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:43.910078 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-config\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:44.011306 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:44.011269 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-oauth-config\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:44.011306 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:44.011307 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-config\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:44.011559 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:44.011363 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-serving-cert\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:44.011559 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:44.011407 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-trusted-ca-bundle\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:44.011559 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:44.011451 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjd2f\" (UniqueName: \"kubernetes.io/projected/28b52705-cfb1-42c3-8942-e4ec290bf01a-kube-api-access-kjd2f\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:44.011559 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:44.011480 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-oauth-serving-cert\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:44.011559 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:44.011513 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-service-ca\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:44.011559 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:44.011548 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28b52705-cfb1-42c3-8942-e4ec290bf01a-tmp\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:44.011880 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:44.011848 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28b52705-cfb1-42c3-8942-e4ec290bf01a-tmp\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:44.012539 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:44.012512 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-trusted-ca-bundle\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:44.012644 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:44.012628 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-oauth-serving-cert\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:44.013256 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:44.013181 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-service-ca\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:44.013256 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:44.013184 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-config\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:44.014016 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:44.013993 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-oauth-config\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:44.015766 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:44.015743 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-serving-cert\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:44.024674 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:44.024653 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjd2f\" (UniqueName: \"kubernetes.io/projected/28b52705-cfb1-42c3-8942-e4ec290bf01a-kube-api-access-kjd2f\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:44.172299 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:44.172259 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:44.454400 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:44.454228 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cccc5c698-lcpx2"] Oct 30 21:53:44.457240 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:53:44.457207 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28b52705_cfb1_42c3_8942_e4ec290bf01a.slice/crio-f6de22422c8b2cd9d1a8170c0f5dec8b03935e904af1bc21fb0374ab8023a7cf WatchSource:0}: Error finding container f6de22422c8b2cd9d1a8170c0f5dec8b03935e904af1bc21fb0374ab8023a7cf: Status 404 returned error can't find the container with id f6de22422c8b2cd9d1a8170c0f5dec8b03935e904af1bc21fb0374ab8023a7cf Oct 30 21:53:44.506234 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:44.506198 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cccc5c698-lcpx2" event={"ID":"28b52705-cfb1-42c3-8942-e4ec290bf01a","Type":"ContainerStarted","Data":"f6de22422c8b2cd9d1a8170c0f5dec8b03935e904af1bc21fb0374ab8023a7cf"} Oct 30 21:53:45.419891 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:45.419870 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dv6jp" Oct 30 21:53:45.512803 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:45.512769 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9ba3773-93d3-4b6b-b45d-a23ce6483e29","Type":"ContainerStarted","Data":"1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88"} Oct 30 21:53:45.512910 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:45.512848 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9ba3773-93d3-4b6b-b45d-a23ce6483e29","Type":"ContainerStarted","Data":"c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a"} Oct 30 21:53:45.516403 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:45.516356 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cccc5c698-lcpx2" event={"ID":"28b52705-cfb1-42c3-8942-e4ec290bf01a","Type":"ContainerStarted","Data":"dbba2f86a8b73a9b49e0807aa9b3009a9bcb6618b044eba0f5dc7c19c8807123"} Oct 30 21:53:45.550091 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:45.547726 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-cccc5c698-lcpx2" podStartSLOduration=2.547708406 podStartE2EDuration="2.547708406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:45.545958201 +0000 UTC m=+50.989506322" watchObservedRunningTime="2026-10-30 21:53:45.547708406 +0000 UTC m=+50.991256554" Oct 30 21:53:46.524592 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:46.524549 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9ba3773-93d3-4b6b-b45d-a23ce6483e29","Type":"ContainerStarted","Data":"cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056"} Oct 30 21:53:46.525030 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:46.524619 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9ba3773-93d3-4b6b-b45d-a23ce6483e29","Type":"ContainerStarted","Data":"a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6"} Oct 30 21:53:46.525030 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:46.524648 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9ba3773-93d3-4b6b-b45d-a23ce6483e29","Type":"ContainerStarted","Data":"012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361"} Oct 30 21:53:46.525030 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:46.524678 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9ba3773-93d3-4b6b-b45d-a23ce6483e29","Type":"ContainerStarted","Data":"20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee"} Oct 30 21:53:46.565244 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:46.565194 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.705011441 podStartE2EDuration="5.565178856s" totalImagesPullingTime="2.845896042s" totalInitContainerRuntime="14.271373ms" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:46.562720425 +0000 UTC m=+52.006268548" watchObservedRunningTime="2026-10-30 21:53:46.565178856 +0000 UTC m=+52.008726976" Oct 30 21:53:47.026454 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:47.026372 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:48.510672 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:48.509644 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:53:50.364141 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:50.364115 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:53:54.173095 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:54.173057 2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:54.173635 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:54.173133 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:54.177938 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:54.177915 2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:54.561322 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:54.561249 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:53:54.616778 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:54.616741 2577 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-97866b9c9-24hdt"] Oct 30 21:53:55.259673 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:55.259637 2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:55.277946 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:55.277920 2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:53:55.576945 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:53:55.576874 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:00.004262 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:00.004219 2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:54:00.004689 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:00.004286 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:54:00.790351 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:00.790311 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:54:00.790560 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:00.790414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs\") pod \"network-metrics-daemon-ktz7g\" (UID: \"e28f054c-44b5-4b39-9813-a547c1b41f04\") " pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:54:00.795854 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:00.795811 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 21:54:00.795854 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:00.795857 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 21:54:00.802895 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:00.802861 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs\") pod \"network-metrics-daemon-ktz7g\" (UID: \"e28f054c-44b5-4b39-9813-a547c1b41f04\") " pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:54:00.803018 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:00.802863 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:54:00.827822 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:00.827788 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lpdnh\"" Oct 30 21:54:00.835838 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:00.835812 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:54:00.893958 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:00.893911 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck7bh\" (UniqueName: \"kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh\") pod \"network-check-target-dzt7m\" (UID: \"363de559-91e1-406d-bdec-36438ab7a186\") " pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:54:00.896803 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:00.896778 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 21:54:00.907189 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:00.907165 2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 21:54:00.917667 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:00.917641 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck7bh\" (UniqueName: \"kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh\") pod \"network-check-target-dzt7m\" (UID: \"363de559-91e1-406d-bdec-36438ab7a186\") " pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:54:01.098252 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:01.098174 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-lttxg\"" Oct 30 21:54:01.106306 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:01.106277 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:54:01.111320 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:01.111295 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ktz7g"] Oct 30 21:54:01.116112 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:54:01.116088 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode28f054c_44b5_4b39_9813_a547c1b41f04.slice/crio-b4fde5cae0c3beb9c5d1ca649b43a0accc976342e909c0bf2427657074db0238 WatchSource:0}: Error finding container b4fde5cae0c3beb9c5d1ca649b43a0accc976342e909c0bf2427657074db0238: Status 404 returned error can't find the container with id b4fde5cae0c3beb9c5d1ca649b43a0accc976342e909c0bf2427657074db0238 Oct 30 21:54:01.141668 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:01.141642 2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-bwmbw\"" Oct 30 21:54:01.149789 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:01.149754 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:54:01.322007 ip-10-0-137-4 kubenswrapper[2577]: E1030 21:54:01.321976 2577 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 21:54:01.383042 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:01.383014 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kczg2"] Oct 30 21:54:01.385514 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:54:01.385489 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0081a009_4575_4b35_bf6b_6d12dd90067b.slice/crio-0d97e60279ae74b3fe7d74fe92403e4bec058d467be6caf32cbe857d4e2e628f WatchSource:0}: Error finding container 0d97e60279ae74b3fe7d74fe92403e4bec058d467be6caf32cbe857d4e2e628f: Status 404 returned error can't find the container with id 0d97e60279ae74b3fe7d74fe92403e4bec058d467be6caf32cbe857d4e2e628f Oct 30 21:54:01.430284 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:01.430253 2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dzt7m"] Oct 30 21:54:01.433017 ip-10-0-137-4 kubenswrapper[2577]: W1030 21:54:01.432991 2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod363de559_91e1_406d_bdec_36438ab7a186.slice/crio-6b66f46a0c0f6d9649a01a2a34fcf5a1fe50c30c0cdacbcc03b162017792b498 WatchSource:0}: Error finding container 6b66f46a0c0f6d9649a01a2a34fcf5a1fe50c30c0cdacbcc03b162017792b498: Status 404 returned error can't find the container with id 6b66f46a0c0f6d9649a01a2a34fcf5a1fe50c30c0cdacbcc03b162017792b498 Oct 30 21:54:01.584549 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:01.584507 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kczg2" event={"ID":"0081a009-4575-4b35-bf6b-6d12dd90067b","Type":"ContainerStarted","Data":"0d97e60279ae74b3fe7d74fe92403e4bec058d467be6caf32cbe857d4e2e628f"} Oct 30 21:54:01.585732 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:01.585703 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ktz7g" event={"ID":"e28f054c-44b5-4b39-9813-a547c1b41f04","Type":"ContainerStarted","Data":"b4fde5cae0c3beb9c5d1ca649b43a0accc976342e909c0bf2427657074db0238"} Oct 30 21:54:01.586818 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:01.586796 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dzt7m" event={"ID":"363de559-91e1-406d-bdec-36438ab7a186","Type":"ContainerStarted","Data":"6b66f46a0c0f6d9649a01a2a34fcf5a1fe50c30c0cdacbcc03b162017792b498"} Oct 30 21:54:02.596828 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:02.596731 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ktz7g" event={"ID":"e28f054c-44b5-4b39-9813-a547c1b41f04","Type":"ContainerStarted","Data":"2aea09785287060ae30451020fffc00daeeb63f949d2c386d4b59042ecc2754c"} Oct 30 21:54:02.596828 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:02.596807 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ktz7g" event={"ID":"e28f054c-44b5-4b39-9813-a547c1b41f04","Type":"ContainerStarted","Data":"13e0f1f25d009177ae63d7500fbb695e3b22b2ac3e2856048373f9b3cac21d3e"} Oct 30 21:54:02.621750 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:02.621692 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ktz7g" podStartSLOduration=65.516000827 podStartE2EDuration="1m6.621672265s" totalImagesPullingTime="1.105671438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:52:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:02.619335488 +0000 UTC m=+68.062883611" watchObservedRunningTime="2026-10-30 21:54:02.621672265 +0000 UTC m=+68.065220387" Oct 30 21:54:05.613003 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:05.612955 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dzt7m" event={"ID":"363de559-91e1-406d-bdec-36438ab7a186","Type":"ContainerStarted","Data":"19daad35536e1041db957a48d3ae33ff6853ede8ffb0d3ca406dc5f4bcd9542c"} Oct 30 21:54:05.613502 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:05.613251 2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:54:05.634971 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:05.634912 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dzt7m" podStartSLOduration=66.404495543 podStartE2EDuration="1m9.634896451s" totalImagesPullingTime="3.230400908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:52:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:05.633586622 +0000 UTC m=+71.077134740" watchObservedRunningTime="2026-10-30 21:54:05.634896451 +0000 UTC m=+71.078444570" Oct 30 21:54:06.619166 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:06.619128 2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kczg2" event={"ID":"0081a009-4575-4b35-bf6b-6d12dd90067b","Type":"ContainerStarted","Data":"f831d2a1434659a5f37bb81517d4aa5f649289b3d58d5e38d997c2f4b5e8e0a6"} Oct 30 21:54:06.638004 ip-10-0-137-4 kubenswrapper[2577]: I1030 21:54:06.637942 2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kczg2" podStartSLOduration=65.615638973 podStartE2EDuration="1m10.637925749s" totalImagesPullingTime="5.022286776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:52:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:06.636955593 +0000 UTC m=+72.080503734" watchObservedRunningTime="2026-10-30 21:54:06.637925749 +0000 UTC m=+72.081473868" Oct 30 21:54:06.727659 ip-10-0-137-4 systemd[1]: Stopping Kubernetes Kubelet... Oct 30 21:54:06.744863 ip-10-0-137-4 systemd[1]: kubelet.service: Deactivated successfully. Oct 30 21:54:06.745039 ip-10-0-137-4 systemd[1]: Stopped Kubernetes Kubelet. Oct 30 21:54:06.745230 ip-10-0-137-4 systemd[1]: kubelet.service: Consumed 4.904s CPU time. Oct 30 21:54:06.755922 ip-10-0-137-4 systemd[1]: Starting Kubernetes Kubelet... Oct 30 21:54:06.830091 ip-10-0-137-4 kubenswrapper[7307]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 21:54:06.830091 ip-10-0-137-4 kubenswrapper[7307]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 21:54:06.830091 ip-10-0-137-4 kubenswrapper[7307]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 21:54:06.830091 ip-10-0-137-4 kubenswrapper[7307]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 21:54:06.832217 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832122 7307 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:54:06.832217 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832216 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:54:06.832217 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832221 7307 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:54:06.832316 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832224 7307 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:54:06.832316 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832228 7307 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:54:06.832316 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832230 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:54:06.832316 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832234 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:54:06.832316 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832237 7307 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:54:06.832316 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832239 7307 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:54:06.832316 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832242 7307 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:54:06.832316 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832245 7307 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:54:06.832316 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832248 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:54:06.832316 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832250 7307 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:54:06.832316 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832253 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:54:06.832316 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832256 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:54:06.832316 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832258 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:54:06.832316 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832261 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:54:06.832316 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832263 7307 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:54:06.832316 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832267 7307 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:54:06.832316 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832270 7307 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:54:06.832316 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832273 7307 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:54:06.832316 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832284 7307 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:54:06.832316 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832287 7307 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:54:06.832845 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832290 7307 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:54:06.832845 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832292 7307 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:54:06.832845 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832295 7307 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:54:06.832845 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832297 7307 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:54:06.832845 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832301 7307 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:54:06.832845 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832303 7307 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:54:06.832845 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832306 7307 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:54:06.832845 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832309 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:54:06.832845 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832312 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:54:06.832845 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832315 7307 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:54:06.832845 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832318 7307 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:54:06.832845 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832321 7307 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:54:06.832845 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832324 7307 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:54:06.832845 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832327 7307 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:54:06.832845 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832330 7307 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:54:06.832845 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832333 7307 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:54:06.832845 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832335 7307 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:54:06.832845 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832338 7307 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:54:06.832845 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832341 7307 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:54:06.833373 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832344 7307 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:54:06.833373 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832346 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:54:06.833373 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832349 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:54:06.833373 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832351 7307 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:54:06.833373 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832354 7307 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:54:06.833373 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832356 7307 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:54:06.833373 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832360 7307 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:54:06.833373 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832362 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:54:06.833373 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832366 7307 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:54:06.833373 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832370 7307 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:54:06.833373 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832373 7307 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:54:06.833373 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832391 7307 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:54:06.833373 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832395 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:54:06.833373 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832398 7307 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:54:06.833373 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832401 7307 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:54:06.833373 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832404 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:54:06.833373 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832407 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:54:06.833373 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832410 7307 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:54:06.833373 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832412 7307 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:54:06.833884 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832415 7307 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:54:06.833884 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832418 7307 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:54:06.833884 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832421 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:54:06.833884 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832424 7307 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:54:06.833884 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832427 7307 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:54:06.833884 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832429 7307 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:54:06.833884 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832433 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:54:06.833884 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832435 7307 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:54:06.833884 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832438 7307 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:54:06.833884 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832441 7307 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:54:06.833884 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832443 7307 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:54:06.833884 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832446 7307 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:54:06.833884 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832449 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:54:06.833884 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832451 7307 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:54:06.833884 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832454 7307 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:54:06.833884 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832456 7307 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:54:06.833884 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832459 7307 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:54:06.833884 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832462 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:54:06.833884 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832464 7307 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:54:06.833884 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832467 7307 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:54:06.834509 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832471 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:54:06.834509 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832474 7307 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:54:06.834509 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832477 7307 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:54:06.834509 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832481 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:54:06.834509 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832485 7307 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:54:06.834509 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832488 7307 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:54:06.834509 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832491 7307 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:54:06.834509 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832494 7307 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:54:06.834509 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832497 7307 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:54:06.834509 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832500 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:54:06.834509 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832503 7307 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:54:06.834509 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832506 7307 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:54:06.834509 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832508 7307 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:54:06.834509 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832511 7307 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:54:06.834509 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832514 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:54:06.834509 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832516 7307 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:54:06.834509 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832519 7307 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:54:06.834509 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832522 7307 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:54:06.834509 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832525 7307 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:54:06.834509 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832527 7307 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:54:06.835027 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832530 7307 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:54:06.835027 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832533 7307 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:54:06.835027 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832536 7307 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:54:06.835027 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832538 7307 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:54:06.835027 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.832542 7307 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:54:06.835027 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833313 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:54:06.835027 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833320 7307 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:54:06.835027 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833323 7307 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:54:06.835027 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833327 7307 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:54:06.835027 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833331 7307 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:54:06.835027 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833334 7307 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:54:06.835027 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833337 7307 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:54:06.835027 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833339 7307 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:54:06.835027 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833342 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:54:06.835027 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833345 7307 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:54:06.835027 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833348 7307 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:54:06.835027 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833352 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:54:06.835027 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833354 7307 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:54:06.835027 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833357 7307 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:54:06.835027 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833360 7307 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:54:06.835556 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833363 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:54:06.835556 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833366 7307 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:54:06.835556 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833368 7307 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:54:06.835556 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833371 7307 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:54:06.835556 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833374 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:54:06.835556 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833397 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:54:06.835556 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833401 7307 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:54:06.835556 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833404 7307 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:54:06.835556 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833407 7307 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:54:06.835556 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833410 7307 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:54:06.835556 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833413 7307 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:54:06.835556 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833416 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:54:06.835556 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833419 7307 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:54:06.835556 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833421 7307 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:54:06.835556 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833424 7307 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:54:06.835556 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833427 7307 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:54:06.835556 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833430 7307 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:54:06.835556 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833432 7307 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:54:06.835556 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833435 7307 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:54:06.835556 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833438 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:54:06.836043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833440 7307 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:54:06.836043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833443 7307 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:54:06.836043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833446 7307 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:54:06.836043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833449 7307 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:54:06.836043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833452 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:54:06.836043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833454 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:54:06.836043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833457 7307 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:54:06.836043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833460 7307 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:54:06.836043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833463 7307 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:54:06.836043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833465 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:54:06.836043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833468 7307 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:54:06.836043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833471 7307 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:54:06.836043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833473 7307 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:54:06.836043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833476 7307 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:54:06.836043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833478 7307 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:54:06.836043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833481 7307 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:54:06.836043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833483 7307 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:54:06.836043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833486 7307 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:54:06.836043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833489 7307 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:54:06.836540 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833491 7307 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:54:06.836540 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833495 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:54:06.836540 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833498 7307 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:54:06.836540 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833500 7307 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:54:06.836540 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833503 7307 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:54:06.836540 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833506 7307 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:54:06.836540 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833509 7307 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:54:06.836540 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833511 7307 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:54:06.836540 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833514 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:54:06.836540 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833518 7307 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:54:06.836540 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833523 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:54:06.836540 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833526 7307 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:54:06.836540 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833529 7307 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:54:06.836540 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833532 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:54:06.836540 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833535 7307 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:54:06.836540 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833538 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:54:06.836540 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833541 7307 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:54:06.836540 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833544 7307 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:54:06.836540 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833547 7307 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:54:06.837017 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833550 7307 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:54:06.837017 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833552 7307 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:54:06.837017 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833555 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:54:06.837017 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833558 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:54:06.837017 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833560 7307 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:54:06.837017 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833563 7307 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:54:06.837017 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833566 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:54:06.837017 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833569 7307 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:54:06.837017 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833572 7307 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:54:06.837017 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833574 7307 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:54:06.837017 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833578 7307 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:54:06.837017 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833580 7307 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:54:06.837017 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833583 7307 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:54:06.837017 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833586 7307 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:54:06.837017 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833588 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:54:06.837017 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833591 7307 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:54:06.837017 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833594 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:54:06.837017 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833596 7307 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:54:06.837017 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833600 7307 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:54:06.837017 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833603 7307 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:54:06.837532 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833606 7307 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:54:06.837532 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833608 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:54:06.837532 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833611 7307 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:54:06.837532 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833614 7307 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:54:06.837532 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833616 7307 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:54:06.837532 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833619 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:54:06.837532 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833622 7307 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:54:06.837532 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833624 7307 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:54:06.837532 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833627 7307 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:54:06.837532 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833629 7307 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:54:06.837532 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833632 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:54:06.837532 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833635 7307 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:54:06.837532 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.833638 7307 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:54:06.837532 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834139 7307 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:54:06.837532 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834144 7307 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:54:06.837532 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834147 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:54:06.837532 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834150 7307 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:54:06.837532 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834153 7307 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:54:06.837532 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834156 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:54:06.837532 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834158 7307 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:54:06.838030 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834161 7307 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:54:06.838030 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834163 7307 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:54:06.838030 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834166 7307 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:54:06.838030 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834168 7307 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:54:06.838030 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834171 7307 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:54:06.838030 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834173 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:54:06.838030 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834176 7307 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:54:06.838030 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834179 7307 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:54:06.838030 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834182 7307 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:54:06.838030 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834184 7307 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:54:06.838030 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834190 7307 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:54:06.838030 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834194 7307 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:54:06.838030 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834196 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:54:06.838030 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834199 7307 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:54:06.838030 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834202 7307 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:54:06.838030 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834205 7307 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:54:06.838030 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834207 7307 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:54:06.838030 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834213 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:54:06.838030 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834216 7307 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:54:06.838527 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834219 7307 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:54:06.838527 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834221 7307 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:54:06.838527 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834224 7307 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:54:06.838527 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834227 7307 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:54:06.838527 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834231 7307 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:54:06.838527 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834235 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:54:06.838527 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834239 7307 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:54:06.838527 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834242 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:54:06.838527 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834245 7307 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:54:06.838527 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834247 7307 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:54:06.838527 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834250 7307 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:54:06.838527 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834253 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:54:06.838527 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834255 7307 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:54:06.838527 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834258 7307 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:54:06.838527 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834260 7307 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:54:06.838527 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834263 7307 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:54:06.838527 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834266 7307 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:54:06.838527 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834269 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:54:06.838527 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834272 7307 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:54:06.839318 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834274 7307 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:54:06.839318 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834277 7307 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:54:06.839318 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834280 7307 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:54:06.839318 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834282 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:54:06.839318 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834284 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:54:06.839318 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834288 7307 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:54:06.839318 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834290 7307 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:54:06.839318 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834293 7307 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:54:06.839318 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834296 7307 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:54:06.839318 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834298 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:54:06.839318 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834301 7307 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:54:06.839318 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834305 7307 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:54:06.839318 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834307 7307 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:54:06.839318 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834310 7307 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:54:06.839318 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834313 7307 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:54:06.839318 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834315 7307 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:54:06.839318 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834318 7307 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:54:06.839318 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834320 7307 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:54:06.839318 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834323 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:54:06.839318 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834325 7307 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:54:06.840171 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834327 7307 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:54:06.840171 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834330 7307 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:54:06.840171 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834333 7307 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:54:06.840171 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834336 7307 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:54:06.840171 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834341 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:54:06.840171 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834343 7307 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:54:06.840171 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834346 7307 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:54:06.840171 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834349 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:54:06.840171 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834351 7307 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:54:06.840171 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834354 7307 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:54:06.840171 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834357 7307 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:54:06.840171 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834359 7307 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:54:06.840171 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834362 7307 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:54:06.840171 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834365 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:54:06.840171 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834367 7307 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:54:06.840171 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834369 7307 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:54:06.840171 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834372 7307 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:54:06.840171 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834374 7307 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:54:06.840171 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834391 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:54:06.840171 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834394 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:54:06.841043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834396 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:54:06.841043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834399 7307 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:54:06.841043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834402 7307 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:54:06.841043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834406 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:54:06.841043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834409 7307 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:54:06.841043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834412 7307 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:54:06.841043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834415 7307 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:54:06.841043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834417 7307 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:54:06.841043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834420 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:54:06.841043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834422 7307 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:54:06.841043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834426 7307 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:54:06.841043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834430 7307 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:54:06.841043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834433 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:54:06.841043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834436 7307 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:54:06.841043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834438 7307 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:54:06.841043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834442 7307 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:54:06.841043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834446 7307 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:54:06.841043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834448 7307 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:54:06.841043 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834452 7307 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:54:06.841877 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834455 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:54:06.841877 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.834457 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:54:06.841877 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834555 7307 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 21:54:06.841877 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834569 7307 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 21:54:06.841877 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834576 7307 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 21:54:06.841877 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834580 7307 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 21:54:06.841877 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834585 7307 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 21:54:06.841877 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834589 7307 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 21:54:06.841877 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834594 7307 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 21:54:06.841877 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834598 7307 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 21:54:06.841877 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834602 7307 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 21:54:06.841877 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834605 7307 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 21:54:06.841877 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834610 7307 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 21:54:06.841877 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834613 7307 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 21:54:06.841877 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834617 7307 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 21:54:06.841877 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834620 7307 flags.go:64] FLAG: --cgroup-root="" Oct 30 21:54:06.841877 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834624 7307 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 21:54:06.841877 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834628 7307 flags.go:64] FLAG: --client-ca-file="" Oct 30 21:54:06.841877 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834631 7307 flags.go:64] FLAG: --cloud-provider="external" Oct 30 21:54:06.841877 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834634 7307 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 21:54:06.841877 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834639 7307 flags.go:64] FLAG: --cluster-domain="" Oct 30 21:54:06.841877 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834642 7307 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 21:54:06.841877 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834645 7307 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834648 7307 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834652 7307 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834657 7307 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834660 7307 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834663 7307 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834667 7307 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834671 7307 flags.go:64] FLAG: --contention-profiling="false" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834675 7307 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834678 7307 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834681 7307 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834684 7307 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834688 7307 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834692 7307 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834695 7307 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834698 7307 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834701 7307 flags.go:64] FLAG: --enable-server="true" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834704 7307 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834708 7307 flags.go:64] FLAG: --event-burst="100" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834712 7307 flags.go:64] FLAG: --event-qps="50" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834714 7307 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834717 7307 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834720 7307 flags.go:64] FLAG: --eviction-hard="" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834725 7307 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 21:54:06.842900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834729 7307 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 21:54:06.844004 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834732 7307 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 21:54:06.844004 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834735 7307 flags.go:64] FLAG: --eviction-soft="" Oct 30 21:54:06.844004 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834739 7307 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 21:54:06.844004 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834742 7307 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 21:54:06.844004 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834745 7307 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 21:54:06.844004 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834749 7307 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 21:54:06.844004 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834751 7307 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 21:54:06.844004 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834754 7307 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 21:54:06.844004 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834757 7307 flags.go:64] FLAG: --feature-gates="" Oct 30 21:54:06.844004 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834762 7307 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 21:54:06.844004 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834765 7307 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 21:54:06.844004 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834768 7307 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 21:54:06.844004 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834771 7307 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 21:54:06.844004 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834774 7307 flags.go:64] FLAG: --healthz-port="10248" Oct 30 21:54:06.844004 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834779 7307 flags.go:64] FLAG: --help="false" Oct 30 21:54:06.844004 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834782 7307 flags.go:64] FLAG: --hostname-override="ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:54:06.844004 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834786 7307 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 21:54:06.844004 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834789 7307 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 21:54:06.844004 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834792 7307 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 21:54:06.844004 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834795 7307 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 21:54:06.844004 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834799 7307 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 21:54:06.844004 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834802 7307 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 21:54:06.844004 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834805 7307 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834807 7307 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834810 7307 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834813 7307 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834817 7307 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834820 7307 flags.go:64] FLAG: --kube-reserved="" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834823 7307 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834826 7307 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834829 7307 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834832 7307 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834836 7307 flags.go:64] FLAG: --lock-file="" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834839 7307 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834842 7307 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834845 7307 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834851 7307 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834854 7307 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834858 7307 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834861 7307 flags.go:64] FLAG: --logging-format="text" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834864 7307 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834868 7307 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834870 7307 flags.go:64] FLAG: --manifest-url="" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834873 7307 flags.go:64] FLAG: --manifest-url-header="" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834878 7307 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834881 7307 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834887 7307 flags.go:64] FLAG: --max-pods="110" Oct 30 21:54:06.845066 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834890 7307 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834893 7307 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834896 7307 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834899 7307 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834903 7307 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834906 7307 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834909 7307 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834916 7307 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834919 7307 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834922 7307 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834926 7307 flags.go:64] FLAG: --pod-cidr="" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834929 7307 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834932 7307 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834935 7307 flags.go:64] FLAG: --pods-per-core="0" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834938 7307 flags.go:64] FLAG: --port="10250" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834942 7307 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834945 7307 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-085c58790d2f3ece0" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834949 7307 flags.go:64] FLAG: --qos-reserved="" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834952 7307 flags.go:64] FLAG: --read-only-port="10255" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834955 7307 flags.go:64] FLAG: --register-node="true" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834958 7307 flags.go:64] FLAG: --register-with-taints="" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834962 7307 flags.go:64] FLAG: --registry-burst="10" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834965 7307 flags.go:64] FLAG: --registry-qps="5" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834968 7307 flags.go:64] FLAG: --reserved-cpus="" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834971 7307 flags.go:64] FLAG: --reserved-memory="" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834975 7307 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 21:54:06.846155 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834978 7307 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834981 7307 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834985 7307 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834988 7307 flags.go:64] FLAG: --runonce="false" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834991 7307 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834996 7307 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.834999 7307 flags.go:64] FLAG: --seccomp-default="false" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835002 7307 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835006 7307 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835009 7307 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835012 7307 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835015 7307 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835018 7307 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835021 7307 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835024 7307 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835027 7307 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835030 7307 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835034 7307 flags.go:64] FLAG: --system-cgroups="" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835037 7307 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835043 7307 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835046 7307 flags.go:64] FLAG: --tls-cert-file="" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835050 7307 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835056 7307 flags.go:64] FLAG: --tls-min-version="" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835059 7307 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835062 7307 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 21:54:06.847292 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835066 7307 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 21:54:06.848397 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835068 7307 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 21:54:06.848397 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835071 7307 flags.go:64] FLAG: --v="2" Oct 30 21:54:06.848397 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835076 7307 flags.go:64] FLAG: --version="false" Oct 30 21:54:06.848397 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835081 7307 flags.go:64] FLAG: --vmodule="" Oct 30 21:54:06.848397 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835085 7307 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 21:54:06.848397 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835088 7307 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 21:54:06.848397 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835223 7307 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:54:06.848397 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835226 7307 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:54:06.848397 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835230 7307 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:54:06.848397 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835232 7307 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:54:06.848397 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835235 7307 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:54:06.848397 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835238 7307 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:54:06.848397 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835241 7307 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:54:06.848397 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835244 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:54:06.848397 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835247 7307 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:54:06.848397 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835249 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:54:06.848397 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835252 7307 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:54:06.848397 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835254 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:54:06.848397 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835257 7307 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:54:06.848397 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835260 7307 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:54:06.848397 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835262 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:54:06.849280 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835265 7307 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:54:06.849280 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835267 7307 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:54:06.849280 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835270 7307 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:54:06.849280 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835272 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:54:06.849280 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835275 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:54:06.849280 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835277 7307 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:54:06.849280 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835282 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:54:06.849280 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835284 7307 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:54:06.849280 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835287 7307 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:54:06.849280 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835289 7307 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:54:06.849280 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835292 7307 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:54:06.849280 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835295 7307 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:54:06.849280 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835298 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:54:06.849280 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835300 7307 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:54:06.849280 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835303 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:54:06.849280 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835305 7307 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:54:06.849280 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835308 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:54:06.849280 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835311 7307 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:54:06.849280 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835313 7307 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:54:06.849280 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835316 7307 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:54:06.849998 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835318 7307 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:54:06.849998 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835321 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:54:06.849998 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835324 7307 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:54:06.849998 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835326 7307 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:54:06.849998 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835329 7307 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:54:06.849998 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835332 7307 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:54:06.849998 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835334 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:54:06.849998 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835337 7307 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:54:06.849998 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835339 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:54:06.849998 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835342 7307 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:54:06.849998 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835345 7307 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:54:06.849998 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835347 7307 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:54:06.849998 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835350 7307 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:54:06.849998 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835352 7307 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:54:06.849998 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835355 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:54:06.849998 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835359 7307 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:54:06.849998 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835363 7307 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:54:06.849998 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835365 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:54:06.849998 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835370 7307 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:54:06.850596 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835373 7307 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:54:06.850596 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835389 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:54:06.850596 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835394 7307 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:54:06.850596 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835399 7307 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:54:06.850596 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835404 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:54:06.850596 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835408 7307 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:54:06.850596 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835411 7307 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:54:06.850596 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835414 7307 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:54:06.850596 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835416 7307 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:54:06.850596 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835419 7307 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:54:06.850596 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835421 7307 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:54:06.850596 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835424 7307 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:54:06.850596 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835427 7307 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:54:06.850596 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835430 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:54:06.850596 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835432 7307 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:54:06.850596 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835435 7307 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:54:06.850596 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835439 7307 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:54:06.850596 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835443 7307 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:54:06.850596 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835446 7307 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:54:06.864295 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835450 7307 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:54:06.864295 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835452 7307 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:54:06.864295 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835455 7307 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:54:06.864295 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835457 7307 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:54:06.864295 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835460 7307 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:54:06.864295 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835463 7307 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:54:06.864295 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835465 7307 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:54:06.864295 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835468 7307 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:54:06.864295 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835471 7307 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:54:06.864295 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835474 7307 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:54:06.864295 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835476 7307 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:54:06.864295 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835479 7307 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:54:06.864295 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835484 7307 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:54:06.864295 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835486 7307 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:54:06.864295 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835489 7307 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:54:06.864295 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835492 7307 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:54:06.864295 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835494 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:54:06.864295 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835497 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:54:06.864295 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835500 7307 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:54:06.864295 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835503 7307 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:54:06.864832 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835505 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:54:06.864832 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835508 7307 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:54:06.864832 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835511 7307 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:54:06.864832 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835513 7307 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:54:06.864832 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835516 7307 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:54:06.864832 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835519 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:54:06.864832 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835521 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:54:06.864832 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835524 7307 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:54:06.864832 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835526 7307 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:54:06.864832 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835529 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:54:06.864832 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835532 7307 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:54:06.864832 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835534 7307 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:54:06.864832 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835537 7307 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:54:06.864832 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.835565 7307 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 21:54:06.864832 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835610 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:54:06.865201 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835615 7307 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:54:06.865201 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835620 7307 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:54:06.865201 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835623 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:54:06.865201 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835626 7307 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:54:06.865201 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835629 7307 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:54:06.865201 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835632 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:54:06.865201 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835634 7307 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:54:06.865201 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835637 7307 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:54:06.865201 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835639 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:54:06.865201 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835643 7307 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:54:06.865201 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835646 7307 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:54:06.865201 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835649 7307 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:54:06.865201 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835651 7307 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:54:06.865201 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835654 7307 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:54:06.865201 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835660 7307 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:54:06.865201 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835663 7307 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:54:06.865201 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835666 7307 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:54:06.865201 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835669 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:54:06.865201 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835671 7307 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:54:06.865201 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835674 7307 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:54:06.865710 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835678 7307 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:54:06.865710 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835682 7307 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:54:06.865710 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835685 7307 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:54:06.865710 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835688 7307 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:54:06.865710 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835691 7307 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:54:06.865710 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835694 7307 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:54:06.865710 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835697 7307 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:54:06.865710 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835699 7307 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:54:06.865710 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835702 7307 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:54:06.865710 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835705 7307 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:54:06.865710 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835707 7307 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:54:06.865710 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835710 7307 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:54:06.865710 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835712 7307 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:54:06.865710 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835715 7307 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:54:06.865710 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835717 7307 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:54:06.865710 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835720 7307 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:54:06.865710 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835723 7307 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:54:06.865710 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835725 7307 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:54:06.865710 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835728 7307 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:54:06.866177 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835730 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:54:06.866177 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835733 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:54:06.866177 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835737 7307 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:54:06.866177 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835740 7307 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:54:06.866177 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835742 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:54:06.866177 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835745 7307 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:54:06.866177 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835747 7307 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:54:06.866177 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835752 7307 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:54:06.866177 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835755 7307 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:54:06.866177 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835757 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:54:06.866177 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835761 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:54:06.866177 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835763 7307 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:54:06.866177 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835767 7307 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:54:06.866177 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835769 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:54:06.866177 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835772 7307 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:54:06.866177 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835774 7307 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:54:06.866177 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835777 7307 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:54:06.866177 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835780 7307 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:54:06.866177 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835784 7307 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:54:06.866674 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835786 7307 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:54:06.866674 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835789 7307 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:54:06.866674 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835791 7307 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:54:06.866674 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835794 7307 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:54:06.866674 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835796 7307 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:54:06.866674 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835799 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:54:06.866674 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835802 7307 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:54:06.866674 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835804 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:54:06.866674 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835807 7307 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:54:06.866674 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835810 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:54:06.866674 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835812 7307 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:54:06.866674 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835815 7307 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:54:06.866674 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835817 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:54:06.866674 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835820 7307 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:54:06.866674 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835822 7307 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:54:06.866674 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835826 7307 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:54:06.866674 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835829 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:54:06.866674 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835831 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:54:06.866674 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835834 7307 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:54:06.867134 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835837 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:54:06.867134 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835841 7307 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:54:06.867134 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835844 7307 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:54:06.867134 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835846 7307 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:54:06.867134 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835849 7307 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:54:06.867134 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835852 7307 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:54:06.867134 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835855 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:54:06.867134 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835858 7307 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:54:06.867134 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835860 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:54:06.867134 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835863 7307 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:54:06.867134 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835865 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:54:06.867134 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835868 7307 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:54:06.867134 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835871 7307 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:54:06.867134 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835873 7307 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:54:06.867134 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835876 7307 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:54:06.867134 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835878 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:54:06.867134 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835881 7307 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:54:06.867134 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835883 7307 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:54:06.867134 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835886 7307 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:54:06.867134 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835888 7307 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:54:06.867734 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835891 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:54:06.867734 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835893 7307 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:54:06.867734 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835896 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:54:06.867734 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835898 7307 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:54:06.867734 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835902 7307 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:54:06.867734 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835905 7307 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:54:06.867734 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835907 7307 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:54:06.867734 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.835910 7307 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:54:06.867734 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.842224 7307 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 21:54:06.867734 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.842252 7307 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 21:54:06.867734 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.842279 7307 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 21:54:06.867734 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.842287 7307 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 21:54:06.867734 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842412 7307 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:54:06.867734 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842422 7307 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:54:06.867734 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842428 7307 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:54:06.867734 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842433 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:54:06.867734 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842438 7307 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:54:06.867734 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842442 7307 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:54:06.867734 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842447 7307 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:54:06.867734 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842451 7307 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:54:06.868336 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842456 7307 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:54:06.868336 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842460 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:54:06.868336 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842465 7307 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:54:06.868336 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842469 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:54:06.868336 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842473 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:54:06.868336 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842478 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:54:06.868336 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842482 7307 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:54:06.868336 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842487 7307 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:54:06.868336 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842491 7307 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:54:06.868336 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842495 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:54:06.868336 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842499 7307 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:54:06.868336 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842504 7307 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:54:06.868336 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842508 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:54:06.868336 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842512 7307 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:54:06.868336 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842517 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:54:06.868336 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842522 7307 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:54:06.868336 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842526 7307 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:54:06.868336 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842532 7307 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:54:06.868336 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842536 7307 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:54:06.868336 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842540 7307 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:54:06.869155 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842553 7307 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:54:06.869155 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842558 7307 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:54:06.869155 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842563 7307 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:54:06.869155 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842568 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:54:06.869155 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842572 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:54:06.869155 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842577 7307 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:54:06.869155 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842581 7307 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:54:06.869155 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842586 7307 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:54:06.869155 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842590 7307 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:54:06.869155 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842594 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:54:06.869155 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842599 7307 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:54:06.869155 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842603 7307 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:54:06.869155 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842608 7307 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:54:06.869155 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842612 7307 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:54:06.869155 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842617 7307 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:54:06.869155 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842622 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:54:06.869155 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842627 7307 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:54:06.869155 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842631 7307 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:54:06.869155 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842635 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:54:06.870035 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842640 7307 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:54:06.870035 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842647 7307 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:54:06.870035 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842654 7307 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:54:06.870035 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842659 7307 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:54:06.870035 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842664 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:54:06.870035 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842668 7307 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:54:06.870035 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842673 7307 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:54:06.870035 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842678 7307 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:54:06.870035 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842682 7307 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:54:06.870035 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842687 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:54:06.870035 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842691 7307 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:54:06.870035 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842696 7307 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:54:06.870035 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842701 7307 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:54:06.870035 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842706 7307 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:54:06.870035 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842710 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:54:06.870035 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842715 7307 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:54:06.870035 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842719 7307 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:54:06.870035 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842724 7307 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:54:06.870035 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842728 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:54:06.870936 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842732 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:54:06.870936 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842737 7307 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:54:06.870936 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842741 7307 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:54:06.870936 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842745 7307 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:54:06.870936 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842750 7307 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:54:06.870936 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842754 7307 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:54:06.870936 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842758 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:54:06.870936 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842763 7307 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:54:06.870936 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842767 7307 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:54:06.870936 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842771 7307 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:54:06.870936 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842775 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:54:06.870936 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842780 7307 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:54:06.870936 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842784 7307 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:54:06.870936 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842790 7307 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:54:06.870936 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842794 7307 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:54:06.870936 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842799 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:54:06.870936 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842803 7307 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:54:06.870936 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842807 7307 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:54:06.870936 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842811 7307 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:54:06.870936 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842816 7307 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:54:06.871890 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842820 7307 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:54:06.871890 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842827 7307 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:54:06.871890 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842832 7307 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:54:06.871890 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842837 7307 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:54:06.871890 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842842 7307 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:54:06.871890 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842846 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:54:06.871890 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842851 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:54:06.871890 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842855 7307 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:54:06.871890 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842859 7307 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:54:06.871890 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842864 7307 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:54:06.871890 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842869 7307 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:54:06.871890 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842873 7307 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:54:06.871890 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842877 7307 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:54:06.871890 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842882 7307 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:54:06.871890 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842886 7307 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:54:06.871890 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842890 7307 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:54:06.871890 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842894 7307 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:54:06.871890 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842898 7307 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:54:06.871890 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842902 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:54:06.872770 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.842906 7307 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:54:06.872770 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.842957 7307 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 21:54:06.872770 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843211 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:54:06.872770 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843221 7307 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:54:06.872770 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843226 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:54:06.872770 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843232 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:54:06.872770 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843237 7307 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:54:06.872770 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843243 7307 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:54:06.872770 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843248 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:54:06.872770 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843252 7307 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:54:06.872770 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843256 7307 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:54:06.872770 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843261 7307 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:54:06.872770 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843265 7307 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:54:06.872770 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843270 7307 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:54:06.872770 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843274 7307 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:54:06.872770 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843278 7307 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:54:06.873598 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843283 7307 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:54:06.873598 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843288 7307 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:54:06.873598 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843292 7307 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:54:06.873598 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843297 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:54:06.873598 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843302 7307 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:54:06.873598 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843307 7307 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:54:06.873598 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843311 7307 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:54:06.873598 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843316 7307 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:54:06.873598 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843320 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:54:06.873598 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843325 7307 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:54:06.873598 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843329 7307 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:54:06.873598 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843334 7307 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:54:06.873598 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843339 7307 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:54:06.873598 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843343 7307 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:54:06.873598 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843347 7307 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:54:06.873598 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843352 7307 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:54:06.873598 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843357 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:54:06.873598 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843361 7307 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:54:06.873598 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843365 7307 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:54:06.874582 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843370 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:54:06.874582 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843374 7307 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:54:06.874582 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843394 7307 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:54:06.874582 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843399 7307 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:54:06.874582 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843404 7307 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:54:06.874582 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843409 7307 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:54:06.874582 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843414 7307 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:54:06.874582 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843419 7307 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:54:06.874582 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843423 7307 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:54:06.874582 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843427 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:54:06.874582 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843431 7307 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:54:06.874582 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843436 7307 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:54:06.874582 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843440 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:54:06.874582 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843445 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:54:06.874582 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843449 7307 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:54:06.874582 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843453 7307 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:54:06.874582 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843460 7307 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:54:06.874582 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843464 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:54:06.874582 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843469 7307 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:54:06.875400 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843473 7307 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:54:06.875400 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843478 7307 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:54:06.875400 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843482 7307 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:54:06.875400 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843487 7307 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:54:06.875400 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843491 7307 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:54:06.875400 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843496 7307 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:54:06.875400 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843500 7307 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:54:06.875400 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843505 7307 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:54:06.875400 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843509 7307 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:54:06.875400 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843514 7307 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:54:06.875400 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843518 7307 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:54:06.875400 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843522 7307 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:54:06.875400 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843526 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:54:06.875400 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843531 7307 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:54:06.875400 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843535 7307 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:54:06.875400 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843540 7307 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:54:06.875400 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843545 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:54:06.875400 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843549 7307 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:54:06.875400 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843553 7307 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:54:06.875400 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843559 7307 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:54:06.876322 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843563 7307 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:54:06.876322 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843570 7307 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:54:06.876322 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843577 7307 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:54:06.876322 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843583 7307 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:54:06.876322 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843589 7307 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:54:06.876322 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843593 7307 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:54:06.876322 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843599 7307 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:54:06.876322 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843603 7307 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:54:06.876322 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843609 7307 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:54:06.876322 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843614 7307 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:54:06.876322 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843618 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:54:06.876322 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843623 7307 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:54:06.876322 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843627 7307 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:54:06.876322 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843632 7307 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:54:06.876322 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843636 7307 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:54:06.876322 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843640 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:54:06.876322 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843645 7307 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:54:06.876322 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843649 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:54:06.876322 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843654 7307 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:54:06.876322 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843658 7307 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:54:06.877264 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843662 7307 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:54:06.877264 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843667 7307 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:54:06.877264 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843671 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:54:06.877264 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843675 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:54:06.877264 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843679 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:54:06.877264 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843683 7307 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:54:06.877264 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843690 7307 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:54:06.877264 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843697 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:54:06.877264 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843703 7307 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:54:06.877264 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843708 7307 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:54:06.877264 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843712 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:54:06.877264 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843717 7307 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:54:06.877264 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843722 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:54:06.877264 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843726 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:54:06.877264 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.843772 7307 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 21:54:06.877264 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843828 7307 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 21:54:06.877967 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843835 7307 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 21:54:06.877967 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843840 7307 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 21:54:06.877967 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843844 7307 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 21:54:06.877967 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843849 7307 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 21:54:06.877967 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843854 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 21:54:06.877967 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843858 7307 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 21:54:06.877967 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843862 7307 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 21:54:06.877967 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843866 7307 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 21:54:06.877967 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843871 7307 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 21:54:06.877967 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843875 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 21:54:06.877967 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843880 7307 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 21:54:06.877967 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843885 7307 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 21:54:06.877967 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843889 7307 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 21:54:06.877967 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843894 7307 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 21:54:06.877967 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843898 7307 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 21:54:06.877967 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843903 7307 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 21:54:06.877967 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843907 7307 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 21:54:06.877967 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843911 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 21:54:06.877967 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843916 7307 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 21:54:06.878735 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843920 7307 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 21:54:06.878735 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843924 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 21:54:06.878735 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843929 7307 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 21:54:06.878735 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843933 7307 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 21:54:06.878735 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843938 7307 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 21:54:06.878735 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843942 7307 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 21:54:06.878735 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843946 7307 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 21:54:06.878735 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843951 7307 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 21:54:06.878735 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843955 7307 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 21:54:06.878735 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843959 7307 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 21:54:06.878735 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843965 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 21:54:06.878735 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843969 7307 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 21:54:06.878735 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843974 7307 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 21:54:06.878735 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843978 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 21:54:06.878735 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843982 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 21:54:06.878735 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843986 7307 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 21:54:06.878735 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843991 7307 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 21:54:06.878735 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.843997 7307 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 21:54:06.878735 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844001 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 21:54:06.879583 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844005 7307 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 21:54:06.879583 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844009 7307 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 21:54:06.879583 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844013 7307 feature_gate.go:386] unrecognized feature gate: Example Oct 30 21:54:06.879583 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844017 7307 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 21:54:06.879583 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844021 7307 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 21:54:06.879583 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844024 7307 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 21:54:06.879583 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844028 7307 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 21:54:06.879583 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844033 7307 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 21:54:06.879583 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844038 7307 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 21:54:06.879583 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844043 7307 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 21:54:06.879583 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844047 7307 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 21:54:06.879583 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844051 7307 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 21:54:06.879583 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844056 7307 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 21:54:06.879583 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844060 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 21:54:06.879583 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844064 7307 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 21:54:06.879583 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844069 7307 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 21:54:06.879583 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844073 7307 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 21:54:06.879583 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844077 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 21:54:06.879583 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844082 7307 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 21:54:06.879583 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844087 7307 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 21:54:06.879506 ip-10-0-137-4 systemd[1]: Started Kubernetes Kubelet. Oct 30 21:54:06.880565 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844091 7307 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 21:54:06.880565 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844095 7307 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 21:54:06.880565 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844102 7307 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 21:54:06.880565 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844109 7307 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 21:54:06.880565 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844116 7307 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 21:54:06.880565 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844121 7307 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 21:54:06.880565 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844126 7307 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 21:54:06.880565 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844131 7307 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 21:54:06.880565 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844135 7307 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 21:54:06.880565 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844139 7307 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 21:54:06.880565 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844144 7307 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 21:54:06.880565 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844148 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 21:54:06.880565 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844152 7307 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 21:54:06.880565 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844157 7307 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 21:54:06.880565 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844161 7307 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 21:54:06.880565 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844165 7307 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 21:54:06.880565 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844170 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 21:54:06.880565 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844174 7307 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 21:54:06.880565 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844179 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 21:54:06.881405 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844183 7307 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 21:54:06.881405 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844188 7307 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 21:54:06.881405 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844192 7307 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 21:54:06.881405 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844196 7307 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 21:54:06.881405 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844201 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 21:54:06.881405 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844205 7307 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 21:54:06.881405 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844209 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 21:54:06.881405 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844214 7307 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 21:54:06.881405 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844221 7307 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 21:54:06.881405 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844226 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 21:54:06.881405 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844231 7307 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 21:54:06.881405 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844235 7307 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 21:54:06.881405 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844239 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 21:54:06.881405 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844244 7307 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 21:54:06.881405 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844248 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 21:54:06.881405 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844252 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 21:54:06.881405 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844256 7307 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 21:54:06.881405 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844261 7307 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 21:54:06.881405 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844267 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 21:54:06.881999 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844272 7307 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 21:54:06.881999 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844277 7307 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 21:54:06.881999 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844283 7307 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 21:54:06.881999 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844287 7307 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 21:54:06.881999 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844291 7307 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 21:54:06.881999 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844300 7307 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 21:54:06.881999 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844305 7307 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 21:54:06.881999 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844310 7307 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 21:54:06.881999 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:06.844314 7307 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 21:54:06.881999 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.844427 7307 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 21:54:06.881999 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.846117 7307 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Oct 30 21:54:06.881999 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.846208 7307 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Oct 30 21:54:06.881999 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.846497 7307 server.go:1014] "Starting client certificate rotation" Oct 30 21:54:06.881999 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.846625 7307 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 21:54:06.881999 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.846688 7307 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 21:47:55 +0000 UTC" deadline="2028-07-07 04:15:17.36988571 +0000 UTC" Oct 30 21:54:06.881999 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.846725 7307 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14766h21m10.523162806s" Oct 30 21:54:06.882611 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.847265 7307 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 21:54:06.882611 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.849037 7307 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 21:54:06.882611 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.850618 7307 log.go:25] "Validated CRI v1 runtime API" Oct 30 21:54:06.882611 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.852649 7307 log.go:25] "Validated CRI v1 image API" Oct 30 21:54:06.882611 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.853421 7307 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 21:54:06.882611 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.855913 7307 fs.go:135] Filesystem UUIDs: map[79c19ff3-9b2a-4ac8-933c-44bc71cbd872:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a2025e27-464a-4c64-bce3-6350b6ecc480:/dev/nvme0n1p4] Oct 30 21:54:06.882819 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.855931 7307 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/051ed441a8b3bbaae88b54bed89515c0fd9196684c8dfb00e39eb26d3dc292c1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/051ed441a8b3bbaae88b54bed89515c0fd9196684c8dfb00e39eb26d3dc292c1/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0565bccc9dc62fed50c4e5d3477f1f54e303103455e94f46f6efa12a17dc9be7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0565bccc9dc62fed50c4e5d3477f1f54e303103455e94f46f6efa12a17dc9be7/userdata/shm major:0 minor:93 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0d97e60279ae74b3fe7d74fe92403e4bec058d467be6caf32cbe857d4e2e628f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0d97e60279ae74b3fe7d74fe92403e4bec058d467be6caf32cbe857d4e2e628f/userdata/shm major:0 minor:506 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1dbacc5e0626c219b587e2ed0d7b2c71ac618315dcdf1ac652101d32df14d80e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1dbacc5e0626c219b587e2ed0d7b2c71ac618315dcdf1ac652101d32df14d80e/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3acde190332b0365d41b1cd26eb49dce20d00b7a1036d5b6431082a68643cc5d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3acde190332b0365d41b1cd26eb49dce20d00b7a1036d5b6431082a68643cc5d/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/41022de65bd978786a192e634be1208f27d858785e232582ff4afe7746615ea0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/41022de65bd978786a192e634be1208f27d858785e232582ff4afe7746615ea0/userdata/shm major:0 minor:250 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/67fd2197a77748088e6777d53039591a9625b4d237e2ba8859488fa008cccf6f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/67fd2197a77748088e6777d53039591a9625b4d237e2ba8859488fa008cccf6f/userdata/shm major:0 minor:219 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/68326a8e59007b1a4742760879e1a4f15547f57bb6e4fa1e9a6b298af3ce76ad/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/68326a8e59007b1a4742760879e1a4f15547f57bb6e4fa1e9a6b298af3ce76ad/userdata/shm major:0 minor:71 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6995b8917988447b3525b6e9d908a0bdd4721bd665e977ec45267eb4ac6a211a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6995b8917988447b3525b6e9d908a0bdd4721bd665e977ec45267eb4ac6a211a/userdata/shm major:0 minor:309 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6b66f46a0c0f6d9649a01a2a34fcf5a1fe50c30c0cdacbcc03b162017792b498/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6b66f46a0c0f6d9649a01a2a34fcf5a1fe50c30c0cdacbcc03b162017792b498/userdata/shm major:0 minor:508 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6c76fa37209e2350624583e28aec434bd559baee3479c76793a882b4a46bbca7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6c76fa37209e2350624583e28aec434bd559baee3479c76793a882b4a46bbca7/userdata/shm major:0 minor:92 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7ef47aa9c6a96d58f868ed7c81e423e3b5e9305aa2b7d6febad1aafaaa4e1805/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7ef47aa9c6a96d58f868ed7c81e423e3b5e9305aa2b7d6febad1aafaaa4e1805/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/802240bbc87bffcbbf05e620a1a43ab3132e9487562d3be55aef05261496102e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/802240bbc87bffcbbf05e620a1a43ab3132e9487562d3be55aef05261496102e/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/918bc16854f8b256806e858af35b666017637fc2a51c4538e8a603ab83020f5e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/918bc16854f8b256806e858af35b666017637fc2a51c4538e8a603ab83020f5e/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a719f05f4ed357bdc371bdbe7a3d6b52f868c64dfbd92cd53fcd7a2abc6a0917/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a719f05f4ed357bdc371bdbe7a3d6b52f868c64dfbd92cd53fcd7a2abc6a0917/userdata/shm major:0 minor:373 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a779abf5a29e7d6c15b2c0d08b0e6ec14e95428cec2d15f340fe0ad65861761c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a779abf5a29e7d6c15b2c0d08b0e6ec14e95428cec2d15f340fe0ad65861761c/userdata/shm major:0 minor:355 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b14e234c177b9a6eae445efd4450f7527810442cb73501e6289dc1affd4fbb4c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b14e234c177b9a6eae445efd4450f7527810442cb73501e6289dc1affd4fbb4c/userdata/shm major:0 minor:439 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b4fde5cae0c3beb9c5d1ca649b43a0accc976342e909c0bf2427657074db0238/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b4fde5cae0c3beb9c5d1ca649b43a0accc976342e909c0bf2427657074db0238/userdata/shm major:0 minor:501 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cf38dc99f92c9e228ebf060b3455d9568001fd47b716bbfca7d11303873a3434/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cf38dc99f92c9e228ebf060b3455d9568001fd47b716bbfca7d11303873a3434/userdata/shm major:0 minor:268 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d21ca8a2e4610ec3ff50284a7b5a726afe9968c8dd47ff4c50de8f5c4c1fbdbc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d21ca8a2e4610ec3ff50284a7b5a726afe9968c8dd47ff4c50de8f5c4c1fbdbc/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d3cf138f480a2cff618e17f3afcee190b839c43aaecf340fdbd7fb21b4192f6d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d3cf138f480a2cff618e17f3afcee190b839c43aaecf340fdbd7fb21b4192f6d/userdata/shm major:0 minor:88 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d7b0ef0b3bd16b1ade507eac99d469db31033e84fec8439a6c64c82b1bfe873a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d7b0ef0b3bd16b1ade507eac99d469db31033e84fec8439a6c64c82b1bfe873a/userdata/shm major:0 minor:79 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/df0c845c843ba4846071f06ed65ee59bbe7b2dbe9485a7bddd8eb5c6ee64e311/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/df0c845c843ba4846071f06ed65ee59bbe7b2dbe9485a7bddd8eb5c6ee64e311/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f0a39f51aa230f8fd6257b67119920ef316b4edb5d0adde16ce696c264f41d14/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f0a39f51aa230f8fd6257b67119920ef316b4edb5d0adde16ce696c264f41d14/userdata/shm major:0 minor:305 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f6de22422c8b2cd9d1a8170c0f5dec8b03935e904af1bc21fb0374ab8023a7cf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f6de22422c8b2cd9d1a8170c0f5dec8b03935e904af1bc21fb0374ab8023a7cf/userdata/shm major:0 minor:458 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fb039c423b1e77b2504bd0a21f55fc98d49047c675e9e637ab7357fd0be2bc09/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fb039c423b1e77b2504bd0a21f55fc98d49047c675e9e637ab7357fd0be2bc09/userdata/shm major:0 minor:251 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0081a009-4575-4b35-bf6b-6d12dd90067b/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/0081a009-4575-4b35-bf6b-6d12dd90067b/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:496 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0268731b-5534-46e0-a079-4998617d8048/volumes/kubernetes.io~projected/kube-api-access-vr48z:{mountpoint:/var/lib/kubelet/pods/0268731b-5534-46e0-a079-4998617d8048/volumes/kubernetes.io~projected/kube-api-access-vr48z major:0 minor:320 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0268731b-5534-46e0-a079-4998617d8048/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/0268731b-5534-46e0-a079-4998617d8048/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:316 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0268731b-5534-46e0-a079-4998617d8048/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/0268731b-5534-46e0-a079-4998617d8048/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:319 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0268731b-5534-46e0-a079-4998617d8048/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/0268731b-5534-46e0-a079-4998617d8048/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:315 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0268731b-5534-46e0-a079-4998617d8048/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/0268731b-5534-46e0-a079-4998617d8048/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:318 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0268731b-5534-46e0-a079-4998617d8048/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/0268731b-5534-46e0-a079-4998617d8048/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:311 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0268731b-5534-46e0-a079-4998617d8048/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/0268731b-5534-46e0-a079-4998617d8048/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:317 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1928dc59-9826-41df-8599-fce8ce310d74/volumes/kubernetes.io~projected/kube-api-access-wsccl:{mountpoint:/var/lib/kubelet/pods/1928dc59-9826-41df-8599-fce8ce310d74/volumes/kubernetes.io~projected/kube-api-access-wsccl major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/28b52705-cfb1-42c3-8942-e4ec290bf01a/volumes/kubernetes.io~projected/kube-api-access-kjd2f:{mountpoint:/var/lib/kubelet/pods/28b52705-cfb1-42c3-8942-e4ec290bf01a/volumes/kubernetes.io~projected/kube-api-access-kjd2f major:0 minor:457 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/28b52705-cfb1-42c3-8942-e4ec290bf01a/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/28b52705-cfb1-42c3-8942-e4ec290bf01a/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:443 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/28b52705-cfb1-42c3-8942-e4ec290bf01a/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/28b52705-cfb1-42c3-8942-e4ec290bf01a/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:456 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/30d5a352-fc59-4709-9d83-0a756367d9e5/volumes/kubernetes.io~projected/kube-api-access-hhzxg:{mountpoint:/var/lib/kubelet/pods/30d5a352-fc59-4709-9d83-0a756367d9e5/volumes/kubernetes.io~projected/kube-api-access-hhzxg major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/363de559-91e1-406d-bdec-36438ab7a186/volumes/kubernetes.io~projected/kube-api-access-ck7bh:{mountpoint:/var/lib/kubelet/pods/363de559-91e1-406d-bdec-36438ab7a186/volumes/kubernetes.io~projected/kube-api-access-ck7bh major:0 minor:503 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/39ebed07-3b7e-4027-93b0-f9c2b83802ab/volumes/kubernetes.io~projected/kube-api-access-kj5j4:{mountpoint:/var/lib/kubelet/pods/39ebed07-3b7e-4027-93b0-f9c2b83802ab/volumes/kubernetes.io~projected/kube-api-access-kj5j4 major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/44e85fdf-12c8-4aaf-8485-4b1ba16ed02f/volumes/kubernetes.io~projected/kube-api-access-qbcsw:{mountpoint:/var/lib/kubelet/pods/44e85fdf-12c8-4aaf-8485-4b1ba16ed02f/volumes/kubernetes.io~projected/kube-api-access-qbcsw major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad/volumes/kubernetes.io~projected/kube-api-access-qbjcs:{mountpoint:/var/lib/kubelet/pods/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad/volumes/kubernetes.io~projected/kube-api-access-qbjcs major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6774e634-30d8-4808-9c87-fe25db7fcb9d/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/6774e634-30d8-4808-9c87-fe25db7fcb9d/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6774e634-30d8-4808-9c87-fe25db7fcb9d/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/6774e634-30d8-4808-9c87-fe25db7fcb9d/volumes/kubernetes.io~empty-dir/tmp major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6774e634-30d8-4808-9c87-fe25db7fcb9d/volumes/kubernetes.io~projected/kube-api-access-znz47:{mountpoint:/var/lib/kubelet/pods/6774e634-30d8-4808-9c87-fe25db7fcb9d/volumes/kubernetes.io~projected/kube-api-access-znz47 major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6f4b3be4-a694-497b-9fc5-ae54afc372d5/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/6f4b3be4-a694-497b-9fc5-ae54afc372d5/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6f4b3be4-a694-497b-9fc5-ae54afc372d5/volumes/kubernetes.io~projected/kube-api-access-ktv45:{mountpoint:/var/lib/kubelet/pods/6f4b3be4-a694-497b-9fc5-ae54afc372d5/volumes/kubernetes.io~projected/kube-api-access-ktv45 major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6f4b3be4-a694-497b-9fc5-ae54afc372d5/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/6f4b3be4-a694-497b-9fc5-ae54afc372d5/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/82584512-72fe-4964-a8c3-7cacc053025e/volumes/kubernetes.io~projected/kube-api-access-4nlgb:{mountpoint:/var/lib/kubelet/pods/82584512-72fe-4964-a8c3-7cacc053025e/volumes/kubernetes.io~projected/kube-api-access-4nlgb major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96b85972-43b4-4ebf-9d98-73905b20aba8/volumes/kubernetes.io~projected/kube-api-access-npnjz:{mountpoint:/var/lib/kubelet/pods/96b85972-43b4-4ebf-9d98-73905b20aba8/volumes/kubernetes.io~projected/kube-api-access-npnjz major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96b85972-43b4-4ebf-9d98-73905b20aba8/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/96b85972-43b4-4ebf-9d98-73905b20aba8/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96b85972-43b4-4ebf-9d98-73905b20aba8/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/96b85972-43b4-4ebf-9d98-73905b20aba8/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a0a75c4a-f43c-4b77-992c-3d060b81b889/volumes/kubernetes.io~projected/kube-api-access-bjr2s:{mountpoint:/var/lib/kubelet/pods/a0a75c4a-f43c-4b77-992c-3d060b81b889/volumes/kubernetes.io~projected/kube-api-access-bjr2s major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a0a75c4a-f43c-4b77-992c-3d060b81b889/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/a0a75c4a-f43c-4b77-992c-3d060b81b889/volumes/kubernetes.io~secret/cert major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a0b20b31-4338-40f4-82fb-55e7f9bafa3c/volumes/kubernetes.io~projected/kube-api-access-q4cjk:{mountpoint:/var/lib/kubelet/pods/a0b20b31-4338-40f4-82fb-55e7f9bafa3c/volumes/kubernetes.io~projected/kube-api-access-q4cjk major:0 minor:358 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a0b20b31-4338-40f4-82fb-55e7f9bafa3c/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/a0b20b31-4338-40f4-82fb-55e7f9bafa3c/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:357 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a7af64ff-9b50-4567-9016-b0cdd4ac7b15/volumes/kubernetes.io~projected/kube-api-access-gczjz:{mountpoint:/var/lib/kubelet/pods/a7af64ff-9b50-4567-9016-b0cdd4ac7b15/volumes/kubernetes.io~projected/kube-api-access-gczjz major:0 minor:265 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a7af64ff-9b50-4567-9016-b0cdd4ac7b15/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/a7af64ff-9b50-4567-9016-b0cdd4ac7b15/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:260 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a7af64ff-9b50-4567-9016-b0cdd4ac7b15/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/a7af64ff-9b50-4567-9016-b0cdd4ac7b15/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:259 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/acf30d7e-4114-4fe7-bf69-c6678b18c2af/volumes/kubernetes.io~projected/kube-api-access-6q76v:{mountpoint:/var/lib/kubelet/pods/acf30d7e-4114-4fe7-bf69-c6678b18c2af/volumes/kubernetes.io~projected/kube-api-access-6q76v major:0 minor:266 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/acf30d7e-4114-4fe7-bf69-c6678b18c2af/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/acf30d7e-4114-4fe7-bf69-c6678b18c2af/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:263 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/acf30d7e-4114-4fe7-bf69-c6678b18c2af/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/acf30d7e-4114-4fe7-bf69-c6678b18c2af/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:264 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volume-subpaths/web-config/config-reloader/2:{mountpoint:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volume-subpaths/web-config/config-reloader/2 major:0 minor:435 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volume-subpaths/web-config/init-config-reloader/2:{mountpoint:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volume-subpaths/web-config/init-config-reloader/2 major:0 minor:435 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volume-subpaths/web-config/prometheus/15:{mountpoint:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volume-subpaths/web-config/prometheus/15 major:0 minor:435 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~empty-dir/config-out major:0 minor:428 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~projected/kube-api-access-6q97n:{mountpoint:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~projected/kube-api-access-6q97n major:0 minor:438 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~projected/tls-assets major:0 minor:436 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/config:{mountpoint:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/config major:0 minor:431 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:430 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/secret-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/secret-kube-rbac-proxy major:0 minor:433 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/secret-metrics-client-certs:{mountpoint:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/secret-metrics-client-certs major:0 minor:432 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web major:0 minor:429 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls:{mountpoint:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls major:0 minor:437 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls:{mountpoint:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls major:0 minor:434 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file:{mountpoint:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file major:0 minor:424 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/web-config major:0 minor:435 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:298 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volume-subpaths/web-config/alertmanager/9 major:0 minor:302 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volume-subpaths/web-config/config-reloader/6 major:0 minor:302 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:302 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~empty-dir/config-out major:0 minor:292 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~projected/kube-api-access-hb9cn:{mountpoint:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~projected/kube-api-access-hb9cn major:0 minor:304 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~projected/tls-assets major:0 minor:303 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:298 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~secret/config-volume major:0 minor:300 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:299 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:301 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:296 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:297 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~secret/web-config major:0 minor:302 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dcb86fdd-20cd-45b3-8533-a6900b903f13/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/dcb86fdd-20cd-45b3-8533-a6900b903f13/volumes/kubernetes.io~secret/agent-certs major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e28f054c-44b5-4b39-9813-a547c1b41f04/volumes/kubernetes.io~projected/kube-api-access-q9gzz:{mountpoint:/var/lib/kubelet/pods/e28f054c-44b5-4b39-9813-a547c1b41f04/volumes/kubernetes.io~projected/kube-api-access-q9gzz major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e28f054c-44b5-4b39-9813-a547c1b41f04/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/e28f054c-44b5-4b39-9813-a547c1b41f04/volumes/kubernetes.io~secret/metrics-certs major:0 minor:500 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e94c0ad7-2799-48e6-ba5c-a10053ffe98d/volumes/kubernetes.io~projected/kube-api-access-n5nv7:{mountpoint:/var/lib/kubelet/pods/e94c0ad7-2799-48e6-ba5c-a10053ffe98d/volumes/kubernetes.io~projected/kube-api-access-n5nv7 major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e94c0ad7-2799-48e6-ba5c-a10053ffe98d/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/e94c0ad7-2799-48e6-ba5c-a10053ffe98d/volumes/kubernetes.io~secret/metrics-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eb862971-cdab-42db-8255-f8fee7a7df41/volumes/kubernetes.io~projected/kube-api-access-dl2xm:{mountpoint:/var/lib/kubelet/pods/eb862971-cdab-42db-8255-f8fee7a7df41/volumes/kubernetes.io~projected/kube-api-access-dl2xm major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ed8c71ed-0f37-4927-b52d-5966421f9978/volumes/kubernetes.io~projected/kube-api-access-n2qvr:{mountpoint:/var/lib/kubelet/pods/ed8c71ed-0f37-4927-b52d-5966421f9978/volumes/kubernetes.io~projected/kube-api-access-n2qvr major:0 minor:354 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ed8c71ed-0f37-4927-b52d-5966421f9978/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/ed8c71ed-0f37-4927-b52d-5966421f9978/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:346 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ed8c71ed-0f37-4927-b52d-5966421f9978/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/ed8c71ed-0f37-4927-b52d-5966421f9978/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:353 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ed8c71ed-0f37-4927-b52d-5966421f9978/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/ed8c71ed-0f37-4927-b52d-5966421f9978/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:345 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fa3d72fd-de71-426f-8841-f6fdc58ddfb5/volumes/kubernetes.io~projected/kube-api-access-mmxhd:{mountpoint:/var/lib/kubelet/pods/fa3d72fd-de71-426f-8841-f6fdc58ddfb5/volumes/kubernetes.io~projected/kube-api-access-mmxhd major:0 minor:267 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fa3d72fd-de71-426f-8841-f6fdc58ddfb5/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/fa3d72fd-de71-426f-8841-f6fdc58ddfb5/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:261 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fa3d72fd-de71-426f-8841-f6fdc58ddfb5/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/fa3d72fd-de71-426f-8841-f6fdc58ddfb5/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:262 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/ad04b4d08fcc271342fae9d8f44cd245a5838fae8eb40d18a600b8411a7f770b/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/aaee06efeb7a5eb333e262ec4d070e7c345765d9caf3aabc79ef4fb780ffdd49/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/948f3d56e63d1df50991f88622e267634dfba7ea6c013a31f37d76f6cc1becb5/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/61ddce4da1365f57d05c853fc466656201c0d8424426eaf9f84c1f52418c7194/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/3b3919e7ee81e68e4b4d710225328bb30eb5750e79ad385f1af1c5d5d591bd03/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/4157a7526f8baf2d6b7541c205acbf8faa2dafe57e4dbd583de2dbe3de9c547b/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/a9ea189a86510d1ed9850bebcce1f980da5ec4555e45a52f53d669407adeb7b8/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/72e1533b55a9fdf5eccc45c9606e3bc9d01668dec504fc5957217b0cdb017380/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/6b88feb8e96169ea46c067992729c0a109a94ef39a46e51b9af25639d07fe0c3/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/26ea172f55d9e832c381de8edd2fe2fe5e2723a0873f5e00eedcaa5d765da065/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-141:{mountpoint:/var/lib/containers/storage/overlay/fd7110ed1d5f03aea038f86f23615521a1722fa879e59fe9258eac85f0b96415/merged major:0 minor:141 fsType:overlay blockSize:0} overlay_0-146:{mountpoint:/var/lib/containers/storage/overlay/aaf1b264760c5dd0ec34f84e4ec6bb6df8341fcde36c3aaae505bd0befb74c6b/merged major:0 minor:146 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/d062f72ca884f8caf8e50c2a20e69163874310fb20eccf9226e0944db36b23f5/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/ce4ac30e179dfe95fe88cd60892660758fcc9b7bd7d633d9c875dc776acb476a/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-159:{mountpoint:/var/lib/containers/storage/overlay/77d8fca2185f624f2bbe79325e281bdd9fcd78e847356c3721b65f6e4b089df1/merged major:0 minor:159 fsType:overlay blockSize:0} overlay_0-164:{mountpoint:/var/lib/containers/storage/overlay/2babbce5242ea3250a462a1c87dc22a27fd6fe41c6aa001771f1f59a53200514/merged major:0 minor:164 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/8fc95183690a67198e7ddaaf5a15e7052cd3c396cb95fd95e854c4168e5fa246/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/5635b48080c5edda9ee8e6a8929fec87741ba33d0de496dd6846b96931b94b99/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/98464099886bbd3d1d8a341af4b351fa81c1a7d1828890bd2b69c8b80b490276/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/d50c004fe1dc6e488563972be4894ab9a87a69651bfc6dc824911e2516a19d6d/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/dc7b5e1f6479d2b49b250365c3fbcb43c7bee894109a55a958104b002bf06424/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/5fc2061e5912b55648c072c64bb4a4d76de35808c31d9192f4af4fdf8422d281/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/9913ffd810fd484e7ebbf729aecc296e9ebbdadb90fdf7ecf42315226d56e660/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/c861c95e31124a647efdd01acf1faac5ed8e467506f8a8e979ddf298e6e583d3/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/fc765f9374b493a7db825ab80288a1e94dbfbfa6cdbdf454e54e634c015ce70c/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-228:{mountpoint:/var/lib/containers/storage/overlay/bacd5a1743a5d4019c898a5b054533063457f07a1b0987424b4a905903fae034/merged major:0 minor:228 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/67171bacc557bf1474bdf8686c19af478a9c4d46306dffc98ce51772a2ebc78a/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-232:{mountpoint:/var/lib/containers/storage/overlay/c43a6e0cda3caef04129af8750081906fc93befb73008cea6ef9fa355f203e15/merged major:0 minor:232 fsType:overlay blockSize:0} overlay_0-237:{mountpoint:/var/lib/containers/storage/overlay/1e64e7898e88e37f304e028c4be09d84e395a3179490a7e53cb76c7f67d3d87e/merged major:0 minor:237 fsType:overlay blockSize:0} overlay_0-243:{mountpoint:/var/lib/containers/storage/overlay/b754f3cb7133d0c0030f37fa01a634ade8dfdcdbfabdee335a183e2ec7d6cbb0/merged major:0 minor:243 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/a0661d8f3af0a70e1f98b9e1731a0f0a9b0630e6f659003aab3c412ba6f9184f/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-272:{mountpoint:/var/lib/containers/storage/overlay/21116309b78b3355ddabc574253adc90bf914af82dab4d722c6134e547b4fead/merged major:0 minor:272 fsType:overlay blockSize:0} overlay_0-274:{mountpoint:/var/lib/containers/storage/overlay/77310e07f2da75a49474d55cfe3f2bb4f21af897989c9a5ff8c96372a482ea8d/merged major:0 minor:274 fsType:overlay blockSize:0} overlay_0-276:{mountpoint:/var/lib/containers/storage/overlay/59c03fb672545142942abba0da566dfa820de52f0a1c784640f384bd6ced4713/merged major:0 minor:276 fsType:overlay blockSize:0} overlay_0-282:{mountpoint:/var/lib/containers/storage/overlay/16426c34fc12cf7cc6afd34dc478747177ea1212fc58adfd2367cf432fd76a87/merged major:0 minor:282 fsType:overlay blockSize:0} overlay_0-284:{mountpoint:/var/lib/containers/storage/overlay/e021c0fee0ecba4c3c6edf51fd485e06b2b26bd536fbb00f2dc181e484972e49/merged major:0 minor:284 fsType:overlay blockSize:0} overlay_0-286:{mountpoint:/var/lib/containers/storage/overlay/90d75a87d7e2e680f71792ed62f696059774e4d61f1b9edcbf6a88c955bc9917/merged major:0 minor:286 fsType:overlay blockSize:0} overlay_0-307:{mountpoint:/var/lib/containers/storage/overlay/e1cbe6fb63ebadf5d663dfc799ddfe08c7cf2a249739481c6ba05d4b4fadb253/merged major:0 minor:307 fsType:overlay blockSize:0} overlay_0-312:{mountpoint:/var/lib/containers/storage/overlay/6672b85ca816f6c2223328d097f341be3b53e1ceb809b6f11d984a193f574167/merged major:0 minor:312 fsType:overlay blockSize:0} overlay_0-314:{mountpoint:/var/lib/containers/storage/overlay/8a4f573b26b9a217cd884c2ebe6dbe08f814f5931f83df3e37ede4687a9507ad/merged major:0 minor:314 fsType:overlay blockSize:0} overlay_0-325:{mountpoint:/var/lib/containers/storage/overlay/43617a8ff62050ffc9c539569523e71d4ae77dffb4f7f68d0e378a8c64a1eb75/merged major:0 minor:325 fsType:overlay blockSize:0} overlay_0-327:{mountpoint:/var/lib/containers/storage/overlay/4658ccc81279f4a77cb71222ea829ae26ac71aa392a9ce3c72e7aebdff1425eb/merged major:0 minor:327 fsType:overlay blockSize:0} overlay_0-333:{mountpoint:/var/lib/containers/storage/overlay/c703e8cb8547dd7aa9bf8e56e613ca226a3a3e5b1b3d015495d56fd29d9fd3ef/merged major:0 minor:333 fsType:overlay blockSize:0} overlay_0-335:{mountpoint:/var/lib/containers/storage/overlay/03d3a613365817ef9fcdc30698f48f51366d3882f1978cdbf31a1c68369c91aa/merged major:0 minor:335 fsType:overlay blockSize:0} overlay_0-343:{mountpoint:/var/lib/containers/storage/overlay/4ed30ae806d894bdb75db35850939f7b876b72c28714e5d134ade025233373a9/merged major:0 minor:343 fsType:overlay blockSize:0} overlay_0-359:{mountpoint:/var/lib/containers/storage/overlay/1285bb350032470d2f7c2744b249d1b1c4470b583455a22108af94d8448e14df/merged major:0 minor:359 fsType:overlay blockSize:0} overlay_0-361:{mountpoint:/var/lib/containers/storage/overlay/d8b2c0b7dc3a104e997496a9073c1a8b0997e2c43fa9fc33c42e30735c28aee8/merged major:0 minor:361 fsType:overlay blockSize:0} overlay_0-363:{mountpoint:/var/lib/containers/storage/overlay/7a32fb72b2d98fc205693fb1e3386a351220f7bdc9fafb9e4a981ddafd67192c/merged major:0 minor:363 fsType:overlay blockSize:0} overlay_0-369:{mountpoint:/var/lib/containers/storage/overlay/8201a4dfc4f355ceb99c0fe5e3ab74718691154ce37bd1b3ad2e76a1daf65c75/merged major:0 minor:369 fsType:overlay blockSize:0} overlay_0-376:{mountpoint:/var/lib/containers/storage/overlay/6b98fb7187cd6f8003c373d4730f7f565705d315305291e9aa9c042ff8f4cb68/merged major:0 minor:376 fsType:overlay blockSize:0} overlay_0-381:{mountpoint:/var/lib/containers/storage/overlay/aedb684f646e577d3d3c69d7da986b022370e885ff373806f5181eb2fb87ac7f/merged major:0 minor:381 fsType:overlay blockSize:0} overlay_0-383:{mountpoint:/var/lib/containers/storage/overlay/e1987c164ed674982b9e726b56116fe37baf24f3acbfb0919a093455a761c9e2/merged major:0 minor:383 fsType:overlay blockSize:0} overlay_0-389:{mountpoint:/var/lib/containers/storage/overlay/a8867c0cddaba6e4752dc26bdb4bb7e914ab27f952f252e937358027056d3f9a/merged major:0 minor:389 fsType:overlay blockSize:0} overlay_0-394:{mountpoint:/var/lib/containers/storage/overlay/5bddfa9392385c0852c5b9a03697ca44a28e41be1f0b5e86332b2a6099e1a9f9/merged major:0 minor:394 fsType:overlay blockSize:0} overlay_0-399:{mountpoint:/var/lib/containers/storage/overlay/eebd92b1d812ee53b32f423e5b2100d227f317ff0da26152d7aeafb0ea9eda6b/merged major:0 minor:399 fsType:overlay blockSize:0} overlay_0-404:{mountpoint:/var/lib/containers/storage/overlay/7041e68b65be4b48f7d4eb319038eba5d4763e60ee39f7a383d7f3d863e327e2/merged major:0 minor:404 fsType:overlay blockSize:0} overlay_0-409:{mountpoint:/var/lib/containers/storage/overlay/8d1303ec2a82366c74fddaa0e4cc4e5b4206fc196b2af17f790a16b3bd1295d8/merged major:0 minor:409 fsType:overlay blockSize:0} overlay_0-414:{mountpoint:/var/lib/containers/storage/overlay/b0a41bf0e80b1af6c53ff9f66c8586b28a451e2b83d3e6491c1c5d2e66045411/merged major:0 minor:414 fsType:overlay blockSize:0} overlay_0-419:{mountpoint:/var/lib/containers/storage/overlay/84b0e1ae4346452172a422965c545e740dc630b93cb81ea330b81a25078ba723/merged major:0 minor:419 fsType:overlay blockSize:0} overlay_0-441:{mountpoint:/var/lib/containers/storage/overlay/aeb6fe26d2ba1e26113dcf9164dbfbe46294b51edad6f5e6cdc161cbd41f9e34/merged major:0 minor:441 fsType:overlay blockSize:0} overlay_0-448:{mountpoint:/var/lib/containers/storage/overlay/87f7cc538e450993c98f828082af8ce9bd8a67aa5025adb8ab40170c481c7bb2/merged major:0 minor:448 fsType:overlay blockSize:0} overlay_0-454:{mountpoint:/var/lib/containers/storage/overlay/f74826efb04949c2299d1db60ccabb0977b59a1bf4c983af453b61d62c7ffe0c/merged major:0 minor:454 fsType:overlay blockSize:0} overlay_0-460:{mountpoint:/var/lib/containers/storage/overlay/1a523b241bf9ebb584ad09ee2d24d30ea5de95dbf9cbd3c08beea393051b901f/merged major:0 minor:460 fsType:overlay blockSize:0} overlay_0-462:{mountpoint:/var/lib/containers/storage/overlay/c5d996c41cb28dae3235ea2914c214bc3e84e2e2f02929bdf4d275aec81ef9e6/merged major:0 minor:462 fsType:overlay blockSize:0} overlay_0-464:{mountpoint:/var/lib/containers/storage/overlay/d33270ada26701a02bd01aaf4bddd9f450fd3eb7ea0a2c4af6de01294c4e8b43/merged major:0 minor:464 fsType:overlay blockSize:0} overlay_0-470:{mountpoint:/var/lib/containers/storage/overlay/f2c5667e561c7a0ccc5186be7fdb60e24091927c1de610c0b286fbf9cd596bfe/merged major:0 minor:470 fsType:overlay blockSize:0} overlay_0-476:{mountpoint:/var/lib/containers/storage/overlay/985708156bb79de5b0739b00ba614107f2de3d42257090e9bcf46690e7e9fead/merged major:0 minor:476 fsType:overlay blockSize:0} overlay_0-481:{mountpoint:/var/lib/containers/storage/overlay/aa89275aad26e45700dcb4b3d85bc3b4857c33826ea73a955faac05b247ffe09/merged major:0 minor:481 fsType:overlay blockSize:0} overlay_0-486:{mountpoint:/var/lib/containers/storage/overlay/3e915b121e3fd1922519d977096e589fa8f5f2ce4a6a5152950bfddd8979ae88/merged major:0 minor:486 fsType:overlay blockSize:0} overlay_0-491:{mountpoint:/var/lib/containers/storage/overlay/d6a63f3a62a7b29ecde5b0cb7fdbda2122d94554e546b1583c33964ab4fc823a/merged major:0 minor:491 fsType:overlay blockSize:0} overlay_0-504:{mountpoint:/var/lib/containers/storage/overlay/177d3ae5e840e5d8330a09dae7668f7fbd594c4c0215b174349ad68802a94973/merged major:0 minor:504 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/92e326c1b90ec183c966226d7128621e8442d69f32ad8c6ebcd0e7d5b3289446/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-510:{mountpoint:/var/lib/containers/storage/overlay/cffab7adbc09c7a56818ae040e46ad7f4cafe7140fe6597f9b703faa78010012/merged major:0 minor:510 fsType:overlay blockSize:0} overlay_0-512:{mountpoint:/var/lib/containers/storage/overlay/3c456ee52e16ada5a3a15344b228203c65c89bc4ce6f212b0ce9c1db1d01043c/merged major:0 minor:512 fsType:overlay blockSize:0} overlay_0-514:{mountpoint:/var/lib/containers/storage/overlay/fb96530644d2302b91a437783bb12665ff226f56ee327b0a4fbb2a1f3b12315a/merged major:0 minor:514 fsType:overlay blockSize:0} overlay_0-516:{mountpoint:/var/lib/containers/storage/overlay/0ce27a590dbc83dddfd0bb43b0c25dbb2c490c387201d28a59d4c5fbfc602cb8/merged major:0 minor:516 fsType:overlay blockSize:0} overlay_0-522:{mountpoint:/var/lib/containers/storage/overlay/85224dc21266c34edb1497eea655fdfad9fd3d54533e4832c1cfa5aae0f52c31/merged major:0 minor:522 fsType:overlay blockSize:0} overlay_0-527:{mountpoint:/var/lib/containers/storage/overlay/149b6419a2d6302c8c781760b5bf704113faffd7a59b604b6887fcbcd48bc942/merged major:0 minor:527 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/641dbe9b60af5c4e5de720101d2a77613add207d3bde17d35d3914d4977c8ca1/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/0f91ab1fc8849d7920e1687188d792bbe99f2654d30af2f3c40c7f62344c770c/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/d91ec0d1bd4a12df18b51dcd6c7fa88f846a40e5377cbd5668df75226f17cf8c/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/786e5e23be857332d8c959239d30aecfb13be7454fb355cb81b8943c0533ba4d/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/9ae102e325ded26130ed9fbd2657f2c61ea4116aac687eda631ffa5c0a682810/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/c42e3e2578def9d335b58a71d244e1cc2d6dfb9c80c083cc2a7e108cb3faed82/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/5ae6df8ab398d237408776cfbe38b08faec8dad989d6c4bdfbfd9dda799f9a15/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/5d6d9874a9788992482382873bb5d1cfb1cbb18edcf50bf0ed36e4e093dd3bb3/merged major:0 minor:96 fsType:overlay blockSize:0} overlay_0-98:{mountpoint:/var/lib/containers/storage/overlay/a53a687ca3996491b415c339c4b84fa2a11f757202a1280600f994978fd286ec/merged major:0 minor:98 fsType:overlay blockSize:0}] Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.865682 7307 manager.go:217] Machine: {Timestamp:2026-10-30 21:54:06.865147198 +0000 UTC m=+0.066519391 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104108 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e7805f08a27c4c9835f030cffbe4d SystemUUID:ec2e7805-f08a-27c4-c983-5f030cffbe4d BootID:690afed8-6836-4034-a2bb-ffbde2a562ac Filesystems:[{Device:overlay_0-141 DeviceMajor:0 DeviceMinor:141 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6774e634-30d8-4808-9c87-fe25db7fcb9d/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:63 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/41022de65bd978786a192e634be1208f27d858785e232582ff4afe7746615ea0/userdata/shm DeviceMajor:0 DeviceMinor:250 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f0a39f51aa230f8fd6257b67119920ef316b4edb5d0adde16ce696c264f41d14/userdata/shm DeviceMajor:0 DeviceMinor:305 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/802240bbc87bffcbbf05e620a1a43ab3132e9487562d3be55aef05261496102e/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0268731b-5534-46e0-a079-4998617d8048/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:319 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0268731b-5534-46e0-a079-4998617d8048/volumes/kubernetes.io~projected/kube-api-access-vr48z DeviceMajor:0 DeviceMinor:320 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-381 DeviceMajor:0 DeviceMinor:381 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-414 DeviceMajor:0 DeviceMinor:414 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0565bccc9dc62fed50c4e5d3477f1f54e303103455e94f46f6efa12a17dc9be7/userdata/shm DeviceMajor:0 DeviceMinor:93 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/67fd2197a77748088e6777d53039591a9625b4d237e2ba8859488fa008cccf6f/userdata/shm DeviceMajor:0 DeviceMinor:219 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0268731b-5534-46e0-a079-4998617d8048/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:317 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-394 DeviceMajor:0 DeviceMinor:394 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/secret-kube-rbac-proxy DeviceMajor:0 DeviceMinor:433 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a0a75c4a-f43c-4b77-992c-3d060b81b889/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:197 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:300 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0268731b-5534-46e0-a079-4998617d8048/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:318 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-361 DeviceMajor:0 DeviceMinor:361 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-454 DeviceMajor:0 DeviceMinor:454 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-228 DeviceMajor:0 DeviceMinor:228 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~projected/kube-api-access-hb9cn DeviceMajor:0 DeviceMinor:304 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-327 DeviceMajor:0 DeviceMinor:327 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/28b52705-cfb1-42c3-8942-e4ec290bf01a/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:443 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-476 DeviceMajor:0 DeviceMinor:476 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:301 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d21ca8a2e4610ec3ff50284a7b5a726afe9968c8dd47ff4c50de8f5c4c1fbdbc/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-369 DeviceMajor:0 DeviceMinor:369 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-419 DeviceMajor:0 DeviceMinor:419 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:430 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6b66f46a0c0f6d9649a01a2a34fcf5a1fe50c30c0cdacbcc03b162017792b498/userdata/shm DeviceMajor:0 DeviceMinor:508 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:302 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/051ed441a8b3bbaae88b54bed89515c0fd9196684c8dfb00e39eb26d3dc292c1/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/96b85972-43b4-4ebf-9d98-73905b20aba8/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:224 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-282 DeviceMajor:0 DeviceMinor:282 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:297 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/run/containers/storage/overlay-containers/df0c845c843ba4846071f06ed65ee59bbe7b2dbe9485a7bddd8eb5c6ee64e311/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/918bc16854f8b256806e858af35b666017637fc2a51c4538e8a603ab83020f5e/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/39ebed07-3b7e-4027-93b0-f9c2b83802ab/volumes/kubernetes.io~projected/kube-api-access-kj5j4 DeviceMajor:0 DeviceMinor:58 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e28f054c-44b5-4b39-9813-a547c1b41f04/volumes/kubernetes.io~projected/kube-api-access-q9gzz DeviceMajor:0 DeviceMinor:62 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad/volumes/kubernetes.io~projected/kube-api-access-qbjcs DeviceMajor:0 DeviceMinor:202 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/acf30d7e-4114-4fe7-bf69-c6678b18c2af/volumes/kubernetes.io~projected/kube-api-access-6q76v DeviceMajor:0 DeviceMinor:266 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-314 DeviceMajor:0 DeviceMinor:314 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/dcb86fdd-20cd-45b3-8533-a6900b903f13/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:56 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/68326a8e59007b1a4742760879e1a4f15547f57bb6e4fa1e9a6b298af3ce76ad/userdata/shm DeviceMajor:0 DeviceMinor:71 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a0b20b31-4338-40f4-82fb-55e7f9bafa3c/volumes/kubernetes.io~projected/kube-api-access-q4cjk DeviceMajor:0 DeviceMinor:358 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a719f05f4ed357bdc371bdbe7a3d6b52f868c64dfbd92cd53fcd7a2abc6a0917/userdata/shm DeviceMajor:0 DeviceMinor:373 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:435 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6774e634-30d8-4808-9c87-fe25db7fcb9d/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:64 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6774e634-30d8-4808-9c87-fe25db7fcb9d/volumes/kubernetes.io~projected/kube-api-access-znz47 DeviceMajor:0 DeviceMinor:65 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-335 DeviceMajor:0 DeviceMinor:335 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-359 DeviceMajor:0 DeviceMinor:359 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f6de22422c8b2cd9d1a8170c0f5dec8b03935e904af1bc21fb0374ab8023a7cf/userdata/shm DeviceMajor:0 DeviceMinor:458 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-276 DeviceMajor:0 DeviceMinor:276 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6995b8917988447b3525b6e9d908a0bdd4721bd665e977ec45267eb4ac6a211a/userdata/shm DeviceMajor:0 DeviceMinor:309 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~projected/kube-api-access-6q97n DeviceMajor:0 DeviceMinor:438 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-460 DeviceMajor:0 DeviceMinor:460 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0d97e60279ae74b3fe7d74fe92403e4bec058d467be6caf32cbe857d4e2e628f/userdata/shm DeviceMajor:0 DeviceMinor:506 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-514 DeviceMajor:0 DeviceMinor:514 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-527 DeviceMajor:0 DeviceMinor:527 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6f4b3be4-a694-497b-9fc5-ae54afc372d5/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:55 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-159 DeviceMajor:0 DeviceMinor:159 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-399 DeviceMajor:0 DeviceMinor:399 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file DeviceMajor:0 DeviceMinor:424 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/82584512-72fe-4964-a8c3-7cacc053025e/volumes/kubernetes.io~projected/kube-api-access-4nlgb DeviceMajor:0 DeviceMinor:66 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fa3d72fd-de71-426f-8841-f6fdc58ddfb5/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:261 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/fa3d72fd-de71-426f-8841-f6fdc58ddfb5/volumes/kubernetes.io~projected/kube-api-access-mmxhd DeviceMajor:0 DeviceMinor:267 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:296 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a0b20b31-4338-40f4-82fb-55e7f9bafa3c/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:357 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e94c0ad7-2799-48e6-ba5c-a10053ffe98d/volumes/kubernetes.io~projected/kube-api-access-n5nv7 DeviceMajor:0 DeviceMinor:204 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ed8c71ed-0f37-4927-b52d-5966421f9978/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:346 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:201 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a7af64ff-9b50-4567-9016-b0cdd4ac7b15/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:260 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-274 DeviceMajor:0 DeviceMinor:274 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0268731b-5534-46e0-a079-4998617d8048/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:315 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-404 DeviceMajor:0 DeviceMinor:404 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-462 DeviceMajor:0 DeviceMinor:462 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-464 DeviceMajor:0 DeviceMinor:464 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6f4b3be4-a694-497b-9fc5-ae54afc372d5/volumes/kubernetes.io~projected/kube-api-access-ktv45 DeviceMajor:0 DeviceMinor:61 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d7b0ef0b3bd16b1ade507eac99d469db31033e84fec8439a6c64c82b1bfe873a/userdata/shm DeviceMajor:0 DeviceMinor:79 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-363 DeviceMajor:0 DeviceMinor:363 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/28b52705-cfb1-42c3-8942-e4ec290bf01a/volumes/kubernetes.io~projected/kube-api-access-kjd2f DeviceMajor:0 DeviceMinor:457 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-510 DeviceMajor:0 DeviceMinor:510 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-243 DeviceMajor:0 DeviceMinor:243 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-325 DeviceMajor:0 DeviceMinor:325 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ed8c71ed-0f37-4927-b52d-5966421f9978/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:353 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a779abf5a29e7d6c15b2c0d08b0e6ec14e95428cec2d15f340fe0ad65861761c/userdata/shm DeviceMajor:0 DeviceMinor:355 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/secret-metrics-client-certs DeviceMajor:0 DeviceMinor:432 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls DeviceMajor:0 DeviceMinor:437 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-448 DeviceMajor:0 DeviceMinor:448 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b4fde5cae0c3beb9c5d1ca649b43a0accc976342e909c0bf2427657074db0238/userdata/shm DeviceMajor:0 DeviceMinor:501 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:298 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls DeviceMajor:0 DeviceMinor:434 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-522 DeviceMajor:0 DeviceMinor:522 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d3cf138f480a2cff618e17f3afcee190b839c43aaecf340fdbd7fb21b4192f6d/userdata/shm DeviceMajor:0 DeviceMinor:88 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b14e234c177b9a6eae445efd4450f7527810442cb73501e6289dc1affd4fbb4c/userdata/shm DeviceMajor:0 DeviceMinor:439 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volume-subpaths/web-config/config-reloader/2 DeviceMajor:0 DeviceMinor:435 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e28f054c-44b5-4b39-9813-a547c1b41f04/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:500 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/30d5a352-fc59-4709-9d83-0a756367d9e5/volumes/kubernetes.io~projected/kube-api-access-hhzxg DeviceMajor:0 DeviceMinor:57 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/eb862971-cdab-42db-8255-f8fee7a7df41/volumes/kubernetes.io~projected/kube-api-access-dl2xm DeviceMajor:0 DeviceMinor:59 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-164 DeviceMajor:0 DeviceMinor:164 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6f4b3be4-a694-497b-9fc5-ae54afc372d5/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/acf30d7e-4114-4fe7-bf69-c6678b18c2af/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:263 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-272 DeviceMajor:0 DeviceMinor:272 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1dbacc5e0626c219b587e2ed0d7b2c71ac618315dcdf1ac652101d32df14d80e/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a0a75c4a-f43c-4b77-992c-3d060b81b889/volumes/kubernetes.io~projected/kube-api-access-bjr2s DeviceMajor:0 DeviceMinor:203 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-333 DeviceMajor:0 DeviceMinor:333 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/config DeviceMajor:0 DeviceMinor:431 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-441 DeviceMajor:0 DeviceMinor:441 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volume-subpaths/web-config/prometheus/15 DeviceMajor:0 DeviceMinor:435 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-486 DeviceMajor:0 DeviceMinor:486 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-286 DeviceMajor:0 DeviceMinor:286 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e94c0ad7-2799-48e6-ba5c-a10053ffe98d/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:45 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7ef47aa9c6a96d58f868ed7c81e423e3b5e9305aa2b7d6febad1aafaaa4e1805/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-237 DeviceMajor:0 DeviceMinor:237 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fa3d72fd-de71-426f-8841-f6fdc58ddfb5/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:262 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fb039c423b1e77b2504bd0a21f55fc98d49047c675e9e637ab7357fd0be2bc09/userdata/shm DeviceMajor:0 DeviceMinor:251 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-284 DeviceMajor:0 DeviceMinor:284 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ed8c71ed-0f37-4927-b52d-5966421f9978/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:345 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-383 DeviceMajor:0 DeviceMinor:383 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-470 DeviceMajor:0 DeviceMinor:470 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-491 DeviceMajor:0 DeviceMinor:491 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6c76fa37209e2350624583e28aec434bd559baee3479c76793a882b4a46bbca7/userdata/shm DeviceMajor:0 DeviceMinor:92 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a7af64ff-9b50-4567-9016-b0cdd4ac7b15/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:259 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:292 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-504 DeviceMajor:0 DeviceMinor:504 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/44e85fdf-12c8-4aaf-8485-4b1ba16ed02f/volumes/kubernetes.io~projected/kube-api-access-qbcsw DeviceMajor:0 DeviceMinor:67 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-98 DeviceMajor:0 DeviceMinor:98 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cf38dc99f92c9e228ebf060b3455d9568001fd47b716bbfca7d11303873a3434/userdata/shm DeviceMajor:0 DeviceMinor:268 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-389 DeviceMajor:0 DeviceMinor:389 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1928dc59-9826-41df-8599-fce8ce310d74/volumes/kubernetes.io~projected/kube-api-access-wsccl DeviceMajor:0 DeviceMinor:60 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:428 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:429 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/96b85972-43b4-4ebf-9d98-73905b20aba8/volumes/kubernetes.io~projected/kube-api-access-npnjz DeviceMajor:0 DeviceMinor:226 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/acf30d7e-4114-4fe7-bf69-c6678b18c2af/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:264 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-307 DeviceMajor:0 DeviceMinor:307 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ed8c71ed-0f37-4927-b52d-5966421f9978/volumes/kubernetes.io~projected/kube-api-access-n2qvr DeviceMajor:0 DeviceMinor:354 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0081a009-4575-4b35-bf6b-6d12dd90067b/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:496 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/363de559-91e1-406d-bdec-36438ab7a186/volumes/kubernetes.io~projected/kube-api-access-ck7bh DeviceMajor:0 DeviceMinor:503 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/96b85972-43b4-4ebf-9d98-73905b20aba8/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:225 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0268731b-5534-46e0-a079-4998617d8048/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:311 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:302 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-481 DeviceMajor:0 DeviceMinor:481 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-516 DeviceMajor:0 DeviceMinor:516 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-232 DeviceMajor:0 DeviceMinor:232 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a7af64ff-9b50-4567-9016-b0cdd4ac7b15/volumes/kubernetes.io~projected/kube-api-access-gczjz DeviceMajor:0 DeviceMinor:265 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:298 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:303 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-343 DeviceMajor:0 DeviceMinor:343 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:302 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0268731b-5534-46e0-a079-4998617d8048/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:316 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-312 DeviceMajor:0 DeviceMinor:312 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-409 DeviceMajor:0 DeviceMinor:409 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/28b52705-cfb1-42c3-8942-e4ec290bf01a/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:456 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:299 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:436 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-512 DeviceMajor:0 DeviceMinor:512 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3acde190332b0365d41b1cd26eb49dce20d00b7a1036d5b6431082a68643cc5d/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-146 DeviceMajor:0 DeviceMinor:146 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-376 DeviceMajor:0 DeviceMinor:376 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:302 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volume-subpaths/web-config/init-config-reloader/2 DeviceMajor:0 DeviceMinor:435 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:051ed441a8b3bba MacAddress:ee:26:31:0e:29:ca Speed:10000 Mtu:8901} {Name:0d97e60279ae74b MacAddress:6a:d1:8b:0f:54:e1 Speed:10000 Mtu:8901} {Name:41022de65bd9787 MacAddress:4a:7a:77:2e:2b:29 Speed:10000 Mtu:8901} {Name:67fd2197a777480 MacAddress:32:27:51:71:1b:78 Speed:10000 Mtu:8901} {Name:6995b8917988447 MacAddress:e6:49:f6:db:00:69 Speed:10000 Mtu:8901} {Name:6b66f46a0c0f6d9 MacAddress:72:bc:2d:17:84:42 Speed:10000 Mtu:8901} {Name:7ef47aa9c6a96d5 MacAddress:d6:3d:14:50:68:76 Speed:10000 Mtu:8901} {Name:802240bbc87bffc MacAddress:3e:bc:47:c2:c1:21 Speed:10000 Mtu:8901} {Name:a719f05f4ed357b MacAddress:36:5f:54:35:5b:bd Speed:10000 Mtu:8901} {Name:a779abf5a29e7d6 MacAddress:16:2c:90:90:00:f9 Speed:10000 Mtu:8901} {Name:b14e234c177b9a6 MacAddress:12:9e:4e:61:db:53 Speed:10000 Mtu:8901} {Name:b4fde5cae0c3beb MacAddress:86:61:32:3c:39:6e Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:ff:59:0c:a3 Speed:0 Mtu:9001} {Name:br-int MacAddress:2e:91:1c:12:11:57 Speed:0 Mtu:8901} {Name:ens5 MacAddress:02:ff:ff:59:0c:a3 Speed:0 Mtu:9001} {Name:f0a39f51aa230f8 MacAddress:8a:54:da:a6:b8:c1 Speed:10000 Mtu:8901} {Name:f6de22422c8b2cd MacAddress:66:48:bb:79:00:50 Speed:10000 Mtu:8901} {Name:fb039c423b1e77b MacAddress:92:35:3f:16:9e:2a Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:12:e5:58:58:9e:e7 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:5a:17:89:9a:56:d4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.866173 7307 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.866227 7307 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.866511 7307 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.866537 7307 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-4.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.866677 7307 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.866686 7307 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.866697 7307 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.866717 7307 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.866830 7307 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.866999 7307 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.867106 7307 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.867142 7307 kubelet.go:493] "Attempting to sync node with API server" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.867153 7307 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.867163 7307 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.867172 7307 kubelet.go:405] "Adding apiserver pod source" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.867182 7307 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.867935 7307 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.867946 7307 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.868587 7307 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.872911 7307 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.872927 7307 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.873063 7307 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.873348 7307 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.873414 7307 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.873564 7307 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.873584 7307 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.873594 7307 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.873604 7307 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.873613 7307 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.873622 7307 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.873631 7307 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.873640 7307 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.873654 7307 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.873665 7307 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.873679 7307 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.873696 7307 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.873736 7307 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.873746 7307 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.878916 7307 server.go:1263] "Started kubelet" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.878984 7307 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.879009 7307 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.879116 7307 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.879444 7307 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 21:54:06.883150 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.881051 7307 server.go:317] "Adding debug handlers to kubelet server" Oct 30 21:54:06.887479 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.885637 7307 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 21:54:06.887479 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.886158 7307 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 21:54:06.887479 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.886171 7307 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 21:54:06.887479 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.886185 7307 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 21:54:06.887479 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:06.886421 7307 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-4.us-east-2.compute.internal\" not found" Oct 30 21:54:06.887479 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.886879 7307 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 21:54:06.888895 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.888580 7307 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:47:57 +0000 UTC" deadline="2028-05-12 20:17:00.974662547 +0000 UTC" Oct 30 21:54:06.888895 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.888653 7307 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13438h22m54.086013415s" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.889705 7307 factory.go:55] Registering systemd factory Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.889735 7307 factory.go:223] Registration of the systemd container factory successfully Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.889949 7307 factory.go:153] Registering CRI-O factory Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.889968 7307 factory.go:223] Registration of the crio container factory successfully Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.890018 7307 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.890036 7307 factory.go:103] Registering Raw factory Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.890052 7307 manager.go:1199] Started watching for new ooms in manager Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.890433 7307 manager.go:319] Starting recovery of all containers Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891015 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="44e85fdf-12c8-4aaf-8485-4b1ba16ed02f" volumeName="kubernetes.io/configmap/44e85fdf-12c8-4aaf-8485-4b1ba16ed02f-iptables-alerter-script" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891065 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82584512-72fe-4964-a8c3-7cacc053025e" volumeName="kubernetes.io/configmap/82584512-72fe-4964-a8c3-7cacc053025e-cni-sysctl-allowlist" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891087 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" volumeName="kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-grpc-tls" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891102 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0268731b-5534-46e0-a079-4998617d8048" volumeName="kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891116 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6774e634-30d8-4808-9c87-fe25db7fcb9d" volumeName="kubernetes.io/projected/6774e634-30d8-4808-9c87-fe25db7fcb9d-kube-api-access-znz47" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891130 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6f4b3be4-a694-497b-9fc5-ae54afc372d5" volumeName="kubernetes.io/projected/6f4b3be4-a694-497b-9fc5-ae54afc372d5-kube-api-access-ktv45" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891143 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="acf30d7e-4114-4fe7-bf69-c6678b18c2af" volumeName="kubernetes.io/secret/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-tls" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891155 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" volumeName="kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-thanos-sidecar-tls" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891169 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ed8c71ed-0f37-4927-b52d-5966421f9978" volumeName="kubernetes.io/configmap/ed8c71ed-0f37-4927-b52d-5966421f9978-configmap-kubelet-serving-ca-bundle" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891183 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0268731b-5534-46e0-a079-4998617d8048" volumeName="kubernetes.io/configmap/0268731b-5534-46e0-a079-4998617d8048-metrics-client-ca" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891195 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6f4b3be4-a694-497b-9fc5-ae54afc372d5" volumeName="kubernetes.io/configmap/6f4b3be4-a694-497b-9fc5-ae54afc372d5-env-overrides" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891246 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96b85972-43b4-4ebf-9d98-73905b20aba8" volumeName="kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-console-config" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891259 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ed8c71ed-0f37-4927-b52d-5966421f9978" volumeName="kubernetes.io/empty-dir/ed8c71ed-0f37-4927-b52d-5966421f9978-audit-log" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891271 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0268731b-5534-46e0-a079-4998617d8048" volumeName="kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-grpc-tls" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891304 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39ebed07-3b7e-4027-93b0-f9c2b83802ab" volumeName="kubernetes.io/configmap/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-daemon-config" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891319 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96b85972-43b4-4ebf-9d98-73905b20aba8" volumeName="kubernetes.io/secret/96b85972-43b4-4ebf-9d98-73905b20aba8-console-serving-cert" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891332 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" volumeName="kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-kube-rbac-proxy-web" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891345 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" volumeName="kubernetes.io/empty-dir/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-config-out" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891467 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fa3d72fd-de71-426f-8841-f6fdc58ddfb5" volumeName="kubernetes.io/secret/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-openshift-state-metrics-tls" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891486 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0268731b-5534-46e0-a079-4998617d8048" volumeName="kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891500 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="28b52705-cfb1-42c3-8942-e4ec290bf01a" volumeName="kubernetes.io/projected/28b52705-cfb1-42c3-8942-e4ec290bf01a-kube-api-access-kjd2f" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891512 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad" volumeName="kubernetes.io/secret/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-insights-runtime-extractor-tls" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891533 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7af64ff-9b50-4567-9016-b0cdd4ac7b15" volumeName="kubernetes.io/projected/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-api-access-gczjz" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891547 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0268731b-5534-46e0-a079-4998617d8048" volumeName="kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891559 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96b85972-43b4-4ebf-9d98-73905b20aba8" volumeName="kubernetes.io/empty-dir/96b85972-43b4-4ebf-9d98-73905b20aba8-tmp" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891572 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="acf30d7e-4114-4fe7-bf69-c6678b18c2af" volumeName="kubernetes.io/projected/acf30d7e-4114-4fe7-bf69-c6678b18c2af-kube-api-access-6q76v" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891585 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" volumeName="kubernetes.io/empty-dir/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-config-out" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891597 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e94c0ad7-2799-48e6-ba5c-a10053ffe98d" volumeName="kubernetes.io/secret/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-metrics-tls" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891617 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96b85972-43b4-4ebf-9d98-73905b20aba8" volumeName="kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-service-ca" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891630 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7af64ff-9b50-4567-9016-b0cdd4ac7b15" volumeName="kubernetes.io/configmap/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891642 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="28b52705-cfb1-42c3-8942-e4ec290bf01a" volumeName="kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-service-ca" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891655 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="28b52705-cfb1-42c3-8942-e4ec290bf01a" volumeName="kubernetes.io/secret/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-serving-cert" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891688 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad" volumeName="kubernetes.io/projected/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-kube-api-access-qbjcs" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891703 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96b85972-43b4-4ebf-9d98-73905b20aba8" volumeName="kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-oauth-serving-cert" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891716 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a0b20b31-4338-40f4-82fb-55e7f9bafa3c" volumeName="kubernetes.io/projected/a0b20b31-4338-40f4-82fb-55e7f9bafa3c-kube-api-access-q4cjk" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891730 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7af64ff-9b50-4567-9016-b0cdd4ac7b15" volumeName="kubernetes.io/secret/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891742 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" volumeName="kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891755 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" volumeName="kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-web-config" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891767 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a0a75c4a-f43c-4b77-992c-3d060b81b889" volumeName="kubernetes.io/projected/a0a75c4a-f43c-4b77-992c-3d060b81b889-kube-api-access-bjr2s" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891781 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a0b20b31-4338-40f4-82fb-55e7f9bafa3c" volumeName="kubernetes.io/secret/a0b20b31-4338-40f4-82fb-55e7f9bafa3c-monitoring-plugin-cert" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891794 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="acf30d7e-4114-4fe7-bf69-c6678b18c2af" volumeName="kubernetes.io/configmap/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-accelerators-collector-config" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891807 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" volumeName="kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-kubelet-serving-ca-bundle" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891820 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0268731b-5534-46e0-a079-4998617d8048" volumeName="kubernetes.io/empty-dir/0268731b-5534-46e0-a079-4998617d8048-tmp" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891834 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6f4b3be4-a694-497b-9fc5-ae54afc372d5" volumeName="kubernetes.io/configmap/6f4b3be4-a694-497b-9fc5-ae54afc372d5-ovnkube-config" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891846 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" volumeName="kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-metrics-client-ca" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891860 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0268731b-5534-46e0-a079-4998617d8048" volumeName="kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-tls" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891873 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0268731b-5534-46e0-a079-4998617d8048" volumeName="kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891887 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6f4b3be4-a694-497b-9fc5-ae54afc372d5" volumeName="kubernetes.io/configmap/6f4b3be4-a694-497b-9fc5-ae54afc372d5-ovnkube-script-lib" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891900 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7af64ff-9b50-4567-9016-b0cdd4ac7b15" volumeName="kubernetes.io/empty-dir/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-volume-directive-shadow" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891916 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="acf30d7e-4114-4fe7-bf69-c6678b18c2af" volumeName="kubernetes.io/empty-dir/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-textfile" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891929 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="acf30d7e-4114-4fe7-bf69-c6678b18c2af" volumeName="kubernetes.io/configmap/acf30d7e-4114-4fe7-bf69-c6678b18c2af-metrics-client-ca" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891942 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fa3d72fd-de71-426f-8841-f6fdc58ddfb5" volumeName="kubernetes.io/projected/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-kube-api-access-mmxhd" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891955 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="28b52705-cfb1-42c3-8942-e4ec290bf01a" volumeName="kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-trusted-ca-bundle" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891971 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6f4b3be4-a694-497b-9fc5-ae54afc372d5" volumeName="kubernetes.io/secret/6f4b3be4-a694-497b-9fc5-ae54afc372d5-ovn-node-metrics-cert" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891984 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" volumeName="kubernetes.io/projected/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-kube-api-access-6q97n" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.891997 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" volumeName="kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-metrics-client-certs" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892021 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" volumeName="kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892068 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ed8c71ed-0f37-4927-b52d-5966421f9978" volumeName="kubernetes.io/secret/ed8c71ed-0f37-4927-b52d-5966421f9978-client-ca-bundle" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892081 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fa3d72fd-de71-426f-8841-f6fdc58ddfb5" volumeName="kubernetes.io/secret/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892094 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1928dc59-9826-41df-8599-fce8ce310d74" volumeName="kubernetes.io/projected/1928dc59-9826-41df-8599-fce8ce310d74-kube-api-access-wsccl" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892106 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82584512-72fe-4964-a8c3-7cacc053025e" volumeName="kubernetes.io/configmap/82584512-72fe-4964-a8c3-7cacc053025e-whereabouts-flatfile-configmap" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892152 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e28f054c-44b5-4b39-9813-a547c1b41f04" volumeName="kubernetes.io/projected/e28f054c-44b5-4b39-9813-a547c1b41f04-kube-api-access-q9gzz" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892164 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ed8c71ed-0f37-4927-b52d-5966421f9978" volumeName="kubernetes.io/secret/ed8c71ed-0f37-4927-b52d-5966421f9978-secret-metrics-server-tls" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892176 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" volumeName="kubernetes.io/projected/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-tls-assets" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892201 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" volumeName="kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-kube-rbac-proxy" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892218 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="28b52705-cfb1-42c3-8942-e4ec290bf01a" volumeName="kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-oauth-serving-cert" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892231 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" volumeName="kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-1" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892255 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e94c0ad7-2799-48e6-ba5c-a10053ffe98d" volumeName="kubernetes.io/projected/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-kube-api-access-n5nv7" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892267 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="30d5a352-fc59-4709-9d83-0a756367d9e5" volumeName="kubernetes.io/configmap/30d5a352-fc59-4709-9d83-0a756367d9e5-serviceca" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892280 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" volumeName="kubernetes.io/empty-dir/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-alertmanager-main-db" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892293 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="28b52705-cfb1-42c3-8942-e4ec290bf01a" volumeName="kubernetes.io/secret/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-oauth-config" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892306 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="30d5a352-fc59-4709-9d83-0a756367d9e5" volumeName="kubernetes.io/projected/30d5a352-fc59-4709-9d83-0a756367d9e5-kube-api-access-hhzxg" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892318 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" volumeName="kubernetes.io/configmap/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-metrics-client-ca" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892330 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dcb86fdd-20cd-45b3-8533-a6900b903f13" volumeName="kubernetes.io/secret/dcb86fdd-20cd-45b3-8533-a6900b903f13-agent-certs" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892344 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ed8c71ed-0f37-4927-b52d-5966421f9978" volumeName="kubernetes.io/projected/ed8c71ed-0f37-4927-b52d-5966421f9978-kube-api-access-n2qvr" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892356 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="28b52705-cfb1-42c3-8942-e4ec290bf01a" volumeName="kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-config" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892368 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a0a75c4a-f43c-4b77-992c-3d060b81b889" volumeName="kubernetes.io/secret/a0a75c4a-f43c-4b77-992c-3d060b81b889-cert" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892398 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" volumeName="kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-trusted-ca-bundle" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892411 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" volumeName="kubernetes.io/empty-dir/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-db" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892423 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" volumeName="kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-config" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892435 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" volumeName="kubernetes.io/projected/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-tls-assets" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892448 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fa3d72fd-de71-426f-8841-f6fdc58ddfb5" volumeName="kubernetes.io/configmap/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-metrics-client-ca" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892460 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" volumeName="kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-main-tls" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892474 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e28f054c-44b5-4b39-9813-a547c1b41f04" volumeName="kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892487 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39ebed07-3b7e-4027-93b0-f9c2b83802ab" volumeName="kubernetes.io/configmap/39ebed07-3b7e-4027-93b0-f9c2b83802ab-cni-binary-copy" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892499 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7af64ff-9b50-4567-9016-b0cdd4ac7b15" volumeName="kubernetes.io/configmap/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-metrics-client-ca" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892511 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" volumeName="kubernetes.io/configmap/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-alertmanager-trusted-ca-bundle" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892524 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96b85972-43b4-4ebf-9d98-73905b20aba8" volumeName="kubernetes.io/secret/96b85972-43b4-4ebf-9d98-73905b20aba8-console-oauth-config" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892538 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" volumeName="kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-0" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892551 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" volumeName="kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-serving-certs-ca-bundle" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892563 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="44e85fdf-12c8-4aaf-8485-4b1ba16ed02f" volumeName="kubernetes.io/projected/44e85fdf-12c8-4aaf-8485-4b1ba16ed02f-kube-api-access-qbcsw" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892574 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6774e634-30d8-4808-9c87-fe25db7fcb9d" volumeName="kubernetes.io/empty-dir/6774e634-30d8-4808-9c87-fe25db7fcb9d-tmp" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892588 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="acf30d7e-4114-4fe7-bf69-c6678b18c2af" volumeName="kubernetes.io/secret/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-kube-rbac-proxy-config" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892600 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e94c0ad7-2799-48e6-ba5c-a10053ffe98d" volumeName="kubernetes.io/empty-dir/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-tmp-dir" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892612 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="28b52705-cfb1-42c3-8942-e4ec290bf01a" volumeName="kubernetes.io/empty-dir/28b52705-cfb1-42c3-8942-e4ec290bf01a-tmp" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892625 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="363de559-91e1-406d-bdec-36438ab7a186" volumeName="kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892639 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" volumeName="kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-2" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892654 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" volumeName="kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-cluster-tls-config" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892666 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ed8c71ed-0f37-4927-b52d-5966421f9978" volumeName="kubernetes.io/secret/ed8c71ed-0f37-4927-b52d-5966421f9978-secret-metrics-server-client-certs" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892678 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39ebed07-3b7e-4027-93b0-f9c2b83802ab" volumeName="kubernetes.io/projected/39ebed07-3b7e-4027-93b0-f9c2b83802ab-kube-api-access-kj5j4" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892691 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96b85972-43b4-4ebf-9d98-73905b20aba8" volumeName="kubernetes.io/projected/96b85972-43b4-4ebf-9d98-73905b20aba8-kube-api-access-npnjz" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892704 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e94c0ad7-2799-48e6-ba5c-a10053ffe98d" volumeName="kubernetes.io/configmap/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-config-volume" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892717 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0268731b-5534-46e0-a079-4998617d8048" volumeName="kubernetes.io/projected/0268731b-5534-46e0-a079-4998617d8048-kube-api-access-vr48z" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892731 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad" volumeName="kubernetes.io/configmap/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-kube-rbac-proxy-cm" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892742 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6774e634-30d8-4808-9c87-fe25db7fcb9d" volumeName="kubernetes.io/empty-dir/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-tuned" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892754 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82584512-72fe-4964-a8c3-7cacc053025e" volumeName="kubernetes.io/projected/82584512-72fe-4964-a8c3-7cacc053025e-kube-api-access-4nlgb" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892767 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" volumeName="kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-web-config" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892781 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" volumeName="kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-tls" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892793 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" volumeName="kubernetes.io/projected/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-kube-api-access-hb9cn" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892807 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" volumeName="kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892843 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dcb86fdd-20cd-45b3-8533-a6900b903f13" volumeName="kubernetes.io/configmap/dcb86fdd-20cd-45b3-8533-a6900b903f13-konnectivity-ca" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892857 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0081a009-4575-4b35-bf6b-6d12dd90067b" volumeName="kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892906 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1928dc59-9826-41df-8599-fce8ce310d74" volumeName="kubernetes.io/empty-dir/1928dc59-9826-41df-8599-fce8ce310d74-tmp-dir" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892920 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad" volumeName="kubernetes.io/empty-dir/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-data-volume" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892935 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" volumeName="kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-config-volume" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892951 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82584512-72fe-4964-a8c3-7cacc053025e" volumeName="kubernetes.io/configmap/82584512-72fe-4964-a8c3-7cacc053025e-cni-binary-copy" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892965 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7af64ff-9b50-4567-9016-b0cdd4ac7b15" volumeName="kubernetes.io/secret/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-state-metrics-tls" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892980 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" volumeName="kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-thanos-prometheus-http-client-file" seLinuxMountContext="" Oct 30 21:54:06.893031 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.892993 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eb862971-cdab-42db-8255-f8fee7a7df41" volumeName="kubernetes.io/projected/eb862971-cdab-42db-8255-f8fee7a7df41-kube-api-access-dl2xm" seLinuxMountContext="" Oct 30 21:54:06.898630 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.893809 7307 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ed8c71ed-0f37-4927-b52d-5966421f9978" volumeName="kubernetes.io/configmap/ed8c71ed-0f37-4927-b52d-5966421f9978-metrics-server-audit-profiles" seLinuxMountContext="" Oct 30 21:54:06.898630 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.893840 7307 reconstruct.go:97] "Volume reconstruction finished" Oct 30 21:54:06.898630 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.893847 7307 reconciler.go:29] "Reconciler: start to sync state" Oct 30 21:54:06.898630 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.897206 7307 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:54:06.898630 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.897602 7307 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:54:06.901315 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.901292 7307 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Oct 30 21:54:06.901748 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.901727 7307 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:54:06.921058 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.921016 7307 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 21:54:06.923307 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.923284 7307 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 21:54:06.923307 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.923307 7307 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 21:54:06.923513 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.923328 7307 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 21:54:06.923513 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:06.923371 7307 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 30 21:54:06.930115 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.930043 7307 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 21:54:06.969306 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.969267 7307 generic.go:356] "Generic (PLEG): container finished" podID="82584512-72fe-4964-a8c3-7cacc053025e" containerID="6c9d28164189b87056a62a73a3a7bda230d2312e3b35d5b25008881012320468" exitCode=0 Oct 30 21:54:06.969306 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.969303 7307 generic.go:356] "Generic (PLEG): container finished" podID="82584512-72fe-4964-a8c3-7cacc053025e" containerID="dc6a403b99cb5be2666f8615cd3dcbbd3ee296c15b4c404bc9fe342ed0ae15cd" exitCode=0 Oct 30 21:54:06.969306 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.969311 7307 generic.go:356] "Generic (PLEG): container finished" podID="82584512-72fe-4964-a8c3-7cacc053025e" containerID="4f30c43513e8461e70a4a7f220a8d40ec7db7259c3fadc6ddece2aa7d64561ed" exitCode=0 Oct 30 21:54:06.969624 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.969320 7307 generic.go:356] "Generic (PLEG): container finished" podID="82584512-72fe-4964-a8c3-7cacc053025e" containerID="304ec0081553b8b2a277cbc82887f2cf398e467948d992bb3e7e75fd5346eb65" exitCode=0 Oct 30 21:54:06.969624 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.969330 7307 generic.go:356] "Generic (PLEG): container finished" podID="82584512-72fe-4964-a8c3-7cacc053025e" containerID="ba5e81616f92d2ce067ad24c2aa1ce695bd155233f932e938d58ca391fac60ad" exitCode=0 Oct 30 21:54:06.969624 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.969337 7307 generic.go:356] "Generic (PLEG): container finished" podID="82584512-72fe-4964-a8c3-7cacc053025e" containerID="6b7afe0515b965b5f2b0f4eabd4eb60d42eec7540390fd8c5bc091aea2b7df31" exitCode=0 Oct 30 21:54:06.976057 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.975642 7307 generic.go:356] "Generic (PLEG): container finished" podID="ce9e46bc8cc07006aa910618f31ad4ad" containerID="92a43dc466fb2ad28b085ead3bafc93ca827e0328933d4ab563dcfe64460bf34" exitCode=0 Oct 30 21:54:06.979568 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.979490 7307 generic.go:356] "Generic (PLEG): container finished" podID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerID="6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22" exitCode=0 Oct 30 21:54:06.986212 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.986177 7307 generic.go:356] "Generic (PLEG): container finished" podID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerID="c78978e7e8af877cc442f8a41d3c68b09513f0020b5a5a08bdb286fba12e22cd" exitCode=0 Oct 30 21:54:06.993093 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:06.993062 7307 generic.go:356] "Generic (PLEG): container finished" podID="acf30d7e-4114-4fe7-bf69-c6678b18c2af" containerID="705999e7e928b598ce280fba69a5f361f51ada6022e01f80d0c4f8aa99ca2bba" exitCode=0 Oct 30 21:54:07.019906 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.019880 7307 manager.go:324] Recovery completed Oct 30 21:54:07.023506 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:07.023481 7307 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Oct 30 21:54:07.047701 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.047676 7307 cpu_manager.go:226] "Starting" policy="none" Oct 30 21:54:07.047701 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.047693 7307 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 21:54:07.047868 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.047717 7307 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 21:54:07.047868 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.047863 7307 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Oct 30 21:54:07.047952 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.047874 7307 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Oct 30 21:54:07.047952 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.047901 7307 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Oct 30 21:54:07.047952 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.047906 7307 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Oct 30 21:54:07.047952 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.047912 7307 policy_none.go:50] "Start" Oct 30 21:54:07.047952 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.047921 7307 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 21:54:07.047952 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.047932 7307 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 21:54:07.059326 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.059296 7307 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Oct 30 21:54:07.059326 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.059322 7307 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Oct 30 21:54:07.059326 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.059330 7307 policy_none.go:44] "Start" Oct 30 21:54:07.064401 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.064353 7307 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 21:54:07.067011 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.066995 7307 manager.go:341] "Starting Device Plugin manager" Oct 30 21:54:07.067504 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:07.067023 7307 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 21:54:07.067504 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.067503 7307 server.go:87] "Starting device plugin registration server" Oct 30 21:54:07.067793 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.067774 7307 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 21:54:07.067894 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.067788 7307 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 21:54:07.067960 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.067910 7307 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 21:54:07.068030 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.068002 7307 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 21:54:07.068082 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.068041 7307 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 21:54:07.068082 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.068048 7307 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 21:54:07.068156 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.068092 7307 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T21:54:07.068026042Z","UUID":"dacfd93d-fd68-4d08-a285-750762d6de48","Handler":null,"Name":"","Endpoint":""} Oct 30 21:54:07.069651 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.069464 7307 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 21:54:07.069651 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.069507 7307 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 21:54:07.070227 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:07.070201 7307 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 21:54:07.169077 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.169038 7307 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 21:54:07.171346 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.171325 7307 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasSufficientMemory" Oct 30 21:54:07.171463 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.171360 7307 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Oct 30 21:54:07.171463 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.171370 7307 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-4.us-east-2.compute.internal" event="NodeHasSufficientPID" Oct 30 21:54:07.171463 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.171442 7307 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:54:07.185697 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.185671 7307 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:54:07.185766 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.185755 7307 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:54:07.224035 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.223965 7307 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal"] Oct 30 21:54:07.224730 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.224705 7307 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:54:07.224817 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.224690 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal" event={"ID":"217839645ba686b08e18edb27afa5bea","Type":"ContainerStarted","Data":"39d6a93d975147d6f4224a499bb2dd605bb478690690535c0dd7d70ad4fe13eb"} Oct 30 21:54:07.224872 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.224849 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal" event={"ID":"217839645ba686b08e18edb27afa5bea","Type":"ContainerStarted","Data":"918bc16854f8b256806e858af35b666017637fc2a51c4538e8a603ab83020f5e"} Oct 30 21:54:07.224929 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.224916 7307 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:54:07.224966 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.224926 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" event={"ID":"ce9e46bc8cc07006aa910618f31ad4ad","Type":"ContainerStarted","Data":"9256783d723064c55603f599e42b88af5ab51c4a4f459858f2c2ab877b6ea078"} Oct 30 21:54:07.224966 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.224949 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" event={"ID":"ce9e46bc8cc07006aa910618f31ad4ad","Type":"ContainerDied","Data":"92a43dc466fb2ad28b085ead3bafc93ca827e0328933d4ab563dcfe64460bf34"} Oct 30 21:54:07.225024 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.224967 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" event={"ID":"ce9e46bc8cc07006aa910618f31ad4ad","Type":"ContainerStarted","Data":"df0c845c843ba4846071f06ed65ee59bbe7b2dbe9485a7bddd8eb5c6ee64e311"} Oct 30 21:54:07.239801 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.239740 7307 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 21:54:07.239801 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:07.239797 7307 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:54:07.240498 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.240480 7307 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 21:54:07.240537 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:07.240526 7307 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:54:07.302888 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.302846 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ce9e46bc8cc07006aa910618f31ad4ad-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal\" (UID: \"ce9e46bc8cc07006aa910618f31ad4ad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:54:07.303043 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.302893 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce9e46bc8cc07006aa910618f31ad4ad-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal\" (UID: \"ce9e46bc8cc07006aa910618f31ad4ad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:54:07.303043 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.302912 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/217839645ba686b08e18edb27afa5bea-config\") pod \"kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal\" (UID: \"217839645ba686b08e18edb27afa5bea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:54:07.403499 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.403464 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ce9e46bc8cc07006aa910618f31ad4ad-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal\" (UID: \"ce9e46bc8cc07006aa910618f31ad4ad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:54:07.403499 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.403502 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce9e46bc8cc07006aa910618f31ad4ad-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal\" (UID: \"ce9e46bc8cc07006aa910618f31ad4ad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:54:07.403728 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.403524 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/217839645ba686b08e18edb27afa5bea-config\") pod \"kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal\" (UID: \"217839645ba686b08e18edb27afa5bea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:54:07.403728 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.403568 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/217839645ba686b08e18edb27afa5bea-config\") pod \"kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal\" (UID: \"217839645ba686b08e18edb27afa5bea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:54:07.403728 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.403590 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce9e46bc8cc07006aa910618f31ad4ad-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal\" (UID: \"ce9e46bc8cc07006aa910618f31ad4ad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:54:07.403728 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.403591 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ce9e46bc8cc07006aa910618f31ad4ad-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal\" (UID: \"ce9e46bc8cc07006aa910618f31ad4ad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:54:07.867367 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.867334 7307 apiserver.go:52] "Watching apiserver" Oct 30 21:54:07.880164 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.880127 7307 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 21:54:07.880946 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.880918 7307 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-x5d7s","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb","openshift-monitoring/metrics-server-67979d6695-hbngh","openshift-monitoring/prometheus-k8s-0","openshift-network-operator/iptables-alerter-nwd9g","openshift-image-registry/node-ca-7zg8j","openshift-cluster-node-tuning-operator/tuned-wrp44","openshift-monitoring/monitoring-plugin-77f4f76594-k7cl2","openshift-monitoring/node-exporter-pqvnh","openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq","openshift-ingress-canary/ingress-canary-kb8fl","openshift-multus/multus-srvpr","openshift-insights/insights-runtime-extractor-flp69","openshift-console/console-cccc5c698-lcpx2","openshift-network-diagnostics/network-check-target-dzt7m","openshift-monitoring/alertmanager-main-0","kube-system/konnectivity-agent-mrg22","kube-system/global-pull-secret-syncer-kczg2","openshift-monitoring/thanos-querier-57888bcfc4-5g9tj","openshift-multus/multus-additional-cni-plugins-hkqj8","openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt","openshift-multus/network-metrics-daemon-ktz7g","openshift-console/console-97866b9c9-24hdt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal","openshift-ovn-kubernetes/ovnkube-node-b9xpx","kube-system/kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal","openshift-dns/dns-default-dv6jp"] Oct 30 21:54:07.888601 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.888572 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lpdnh\"" Oct 30 21:54:07.888601 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.888584 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-scccg\"" Oct 30 21:54:07.889595 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.889563 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gpwbs\"" Oct 30 21:54:07.889754 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.889614 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 21:54:07.889754 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.889673 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 21:54:07.889754 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.889685 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 21:54:07.889754 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.889702 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 21:54:07.889754 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.889726 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 21:54:07.890011 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.889785 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ddnf5\"" Oct 30 21:54:07.890011 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.889793 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-7pfmv\"" Oct 30 21:54:07.890011 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.889830 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 21:54:07.890011 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.889860 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pzcl5\"" Oct 30 21:54:07.890011 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.889867 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 21:54:07.890011 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.889899 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 21:54:07.890011 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.889915 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 21:54:07.890011 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.889946 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-hgb4n\"" Oct 30 21:54:07.890011 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.889967 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 21:54:07.890011 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.890005 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 21:54:07.890459 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.890064 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 21:54:07.890459 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.890147 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 21:54:07.890459 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.890187 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 21:54:07.890459 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.890219 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 21:54:07.890459 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.890237 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 21:54:07.890459 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.890242 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 21:54:07.890459 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.890260 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 21:54:07.890459 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.890345 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 21:54:07.890459 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.890425 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 21:54:07.890960 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.890928 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 21:54:07.891046 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.891028 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-bwmbw\"" Oct 30 21:54:07.891309 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.891289 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kxljf\"" Oct 30 21:54:07.891534 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.891511 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 21:54:07.891983 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.891962 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4xh5g\"" Oct 30 21:54:07.892179 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.892148 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 21:54:07.892275 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.892256 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 21:54:07.892528 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.892497 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 21:54:07.892869 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.892844 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 21:54:07.892962 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.892908 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 21:54:07.893060 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.893045 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 21:54:07.893126 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.893112 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-lttxg\"" Oct 30 21:54:07.895359 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.895332 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 21:54:07.895501 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.895472 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 21:54:07.895640 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.895590 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q26ql\"" Oct 30 21:54:07.895733 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.895701 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 21:54:07.895800 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.895749 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vplhc\"" Oct 30 21:54:07.895861 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.895802 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l9jfx\"" Oct 30 21:54:07.896094 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.896070 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 30 21:54:07.896266 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.896243 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 21:54:07.896413 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.896317 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 21:54:07.896413 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.896334 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 21:54:07.896413 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.896364 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-sr8tx\"" Oct 30 21:54:07.896577 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.896477 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 21:54:07.896636 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.896576 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 21:54:07.896691 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.896660 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 21:54:07.896749 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.896727 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 21:54:07.896850 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.896836 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 21:54:07.896913 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.896838 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-whw8p\"" Oct 30 21:54:07.897333 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.897316 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 21:54:07.905315 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.905292 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbjcs\" (UniqueName: \"kubernetes.io/projected/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-kube-api-access-qbjcs\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:54:07.905454 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.905321 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-var-lib-cni-multus\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:07.905454 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.905341 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znz47\" (UniqueName: \"kubernetes.io/projected/6774e634-30d8-4808-9c87-fe25db7fcb9d-kube-api-access-znz47\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:07.905454 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.905359 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.905454 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.905428 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44e85fdf-12c8-4aaf-8485-4b1ba16ed02f-host-slash\") pod \"iptables-alerter-nwd9g\" (UID: \"44e85fdf-12c8-4aaf-8485-4b1ba16ed02f\") " pod="openshift-network-operator/iptables-alerter-nwd9g" Oct 30 21:54:07.905596 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.905545 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0a75c4a-f43c-4b77-992c-3d060b81b889-cert\") pod \"ingress-canary-kb8fl\" (UID: \"a0a75c4a-f43c-4b77-992c-3d060b81b889\") " pod="openshift-ingress-canary/ingress-canary-kb8fl" Oct 30 21:54:07.905630 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.905605 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-conf-dir\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:07.905748 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.905724 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-modprobe-d\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:07.905780 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.905768 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck7bh\" (UniqueName: \"kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh\") pod \"network-check-target-dzt7m\" (UID: \"363de559-91e1-406d-bdec-36438ab7a186\") " pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:54:07.905823 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.905809 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-run-netns\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.905854 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.905819 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0a75c4a-f43c-4b77-992c-3d060b81b889-cert\") pod \"ingress-canary-kb8fl\" (UID: \"a0a75c4a-f43c-4b77-992c-3d060b81b889\") " pod="openshift-ingress-canary/ingress-canary-kb8fl" Oct 30 21:54:07.905854 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.905834 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-run-systemd\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.905942 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.905931 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktv45\" (UniqueName: \"kubernetes.io/projected/6f4b3be4-a694-497b-9fc5-ae54afc372d5-kube-api-access-ktv45\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.905973 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.905964 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/82584512-72fe-4964-a8c3-7cacc053025e-cnibin\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:54:07.906002 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.905980 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjr2s\" (UniqueName: \"kubernetes.io/projected/a0a75c4a-f43c-4b77-992c-3d060b81b889-kube-api-access-bjr2s\") pod \"ingress-canary-kb8fl\" (UID: \"a0a75c4a-f43c-4b77-992c-3d060b81b889\") " pod="openshift-ingress-canary/ingress-canary-kb8fl" Oct 30 21:54:07.906057 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906041 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-run-k8s-cni-cncf-io\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:07.906118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906105 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-run-multus-certs\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:07.906152 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906137 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1928dc59-9826-41df-8599-fce8ce310d74-tmp-dir\") pod \"node-resolver-x5d7s\" (UID: \"1928dc59-9826-41df-8599-fce8ce310d74\") " pod="openshift-dns/node-resolver-x5d7s" Oct 30 21:54:07.906184 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906172 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/30d5a352-fc59-4709-9d83-0a756367d9e5-serviceca\") pod \"node-ca-7zg8j\" (UID: \"30d5a352-fc59-4709-9d83-0a756367d9e5\") " pod="openshift-image-registry/node-ca-7zg8j" Oct 30 21:54:07.906221 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906200 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/82584512-72fe-4964-a8c3-7cacc053025e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:54:07.906251 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906219 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/82584512-72fe-4964-a8c3-7cacc053025e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:54:07.906302 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906285 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-var-lib-cni-bin\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:07.906335 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906310 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1928dc59-9826-41df-8599-fce8ce310d74-tmp-dir\") pod \"node-resolver-x5d7s\" (UID: \"1928dc59-9826-41df-8599-fce8ce310d74\") " pod="openshift-dns/node-resolver-x5d7s" Oct 30 21:54:07.906335 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906318 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-var-lib-kubelet\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:07.906422 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906345 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:54:07.906422 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906370 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.906502 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906421 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f4b3be4-a694-497b-9fc5-ae54afc372d5-ovn-node-metrics-cert\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.906502 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906426 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/82584512-72fe-4964-a8c3-7cacc053025e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:54:07.906502 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906441 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbcsw\" (UniqueName: \"kubernetes.io/projected/44e85fdf-12c8-4aaf-8485-4b1ba16ed02f-kube-api-access-qbcsw\") pod \"iptables-alerter-nwd9g\" (UID: \"44e85fdf-12c8-4aaf-8485-4b1ba16ed02f\") " pod="openshift-network-operator/iptables-alerter-nwd9g" Oct 30 21:54:07.906502 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906458 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-data-volume\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:54:07.906502 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906473 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dcb86fdd-20cd-45b3-8533-a6900b903f13-konnectivity-ca\") pod \"konnectivity-agent-mrg22\" (UID: \"dcb86fdd-20cd-45b3-8533-a6900b903f13\") " pod="kube-system/konnectivity-agent-mrg22" Oct 30 21:54:07.906502 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906494 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-system-cni-dir\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:07.906775 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906515 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-cnibin\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:07.906775 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906538 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-kubernetes\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:07.906775 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906577 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-data-volume\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:54:07.906775 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906584 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44e85fdf-12c8-4aaf-8485-4b1ba16ed02f-iptables-alerter-script\") pod \"iptables-alerter-nwd9g\" (UID: \"44e85fdf-12c8-4aaf-8485-4b1ba16ed02f\") " pod="openshift-network-operator/iptables-alerter-nwd9g" Oct 30 21:54:07.906775 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906675 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dcb86fdd-20cd-45b3-8533-a6900b903f13-konnectivity-ca\") pod \"konnectivity-agent-mrg22\" (UID: \"dcb86fdd-20cd-45b3-8533-a6900b903f13\") " pod="kube-system/konnectivity-agent-mrg22" Oct 30 21:54:07.906775 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906694 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:54:07.906775 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906745 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nlgb\" (UniqueName: \"kubernetes.io/projected/82584512-72fe-4964-a8c3-7cacc053025e-kube-api-access-4nlgb\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:54:07.907059 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906825 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f4b3be4-a694-497b-9fc5-ae54afc372d5-ovn-node-metrics-cert\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.907059 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906840 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44e85fdf-12c8-4aaf-8485-4b1ba16ed02f-iptables-alerter-script\") pod \"iptables-alerter-nwd9g\" (UID: \"44e85fdf-12c8-4aaf-8485-4b1ba16ed02f\") " pod="openshift-network-operator/iptables-alerter-nwd9g" Oct 30 21:54:07.907059 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906845 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/30d5a352-fc59-4709-9d83-0a756367d9e5-serviceca\") pod \"node-ca-7zg8j\" (UID: \"30d5a352-fc59-4709-9d83-0a756367d9e5\") " pod="openshift-image-registry/node-ca-7zg8j" Oct 30 21:54:07.907059 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906855 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-etc-kubernetes\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:07.907059 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906895 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-registration-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:54:07.907059 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906932 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-config-volume\") pod \"dns-default-dv6jp\" (UID: \"e94c0ad7-2799-48e6-ba5c-a10053ffe98d\") " pod="openshift-dns/dns-default-dv6jp" Oct 30 21:54:07.907059 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906946 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:54:07.907059 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.906970 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-node-log\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.907327 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907076 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9gzz\" (UniqueName: \"kubernetes.io/projected/e28f054c-44b5-4b39-9813-a547c1b41f04-kube-api-access-q9gzz\") pod \"network-metrics-daemon-ktz7g\" (UID: \"e28f054c-44b5-4b39-9813-a547c1b41f04\") " pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:54:07.907327 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907099 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-config-volume\") pod \"dns-default-dv6jp\" (UID: \"e94c0ad7-2799-48e6-ba5c-a10053ffe98d\") " pod="openshift-dns/dns-default-dv6jp" Oct 30 21:54:07.907327 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907128 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhzxg\" (UniqueName: \"kubernetes.io/projected/30d5a352-fc59-4709-9d83-0a756367d9e5-kube-api-access-hhzxg\") pod \"node-ca-7zg8j\" (UID: \"30d5a352-fc59-4709-9d83-0a756367d9e5\") " pod="openshift-image-registry/node-ca-7zg8j" Oct 30 21:54:07.907327 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907150 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-kubelet\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.907327 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907166 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-daemon-config\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:07.907327 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907182 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-sysconfig\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:07.907327 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907201 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-device-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:54:07.907327 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907223 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-etc-selinux\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:54:07.907327 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907245 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6f4b3be4-a694-497b-9fc5-ae54afc372d5-ovnkube-config\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.907327 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907276 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj5j4\" (UniqueName: \"kubernetes.io/projected/39ebed07-3b7e-4027-93b0-f9c2b83802ab-kube-api-access-kj5j4\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:07.907754 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907351 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-daemon-config\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:07.907754 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907426 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-lib-modules\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:07.907754 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907447 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-run-ovn\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.907754 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907464 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6f4b3be4-a694-497b-9fc5-ae54afc372d5-ovnkube-script-lib\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.907754 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907488 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0081a009-4575-4b35-bf6b-6d12dd90067b-kubelet-config\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:54:07.907754 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907502 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6f4b3be4-a694-497b-9fc5-ae54afc372d5-ovnkube-config\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.907754 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907529 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-systemd\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:07.907754 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907554 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-run\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:07.907754 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907577 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-sys-fs\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:54:07.907754 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907666 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl2xm\" (UniqueName: \"kubernetes.io/projected/eb862971-cdab-42db-8255-f8fee7a7df41-kube-api-access-dl2xm\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:54:07.907754 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907703 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/82584512-72fe-4964-a8c3-7cacc053025e-cni-binary-copy\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:54:07.907754 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907723 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6f4b3be4-a694-497b-9fc5-ae54afc372d5-ovnkube-script-lib\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.907754 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907731 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-cni-dir\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:07.908307 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907802 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-metrics-tls\") pod \"dns-default-dv6jp\" (UID: \"e94c0ad7-2799-48e6-ba5c-a10053ffe98d\") " pod="openshift-dns/dns-default-dv6jp" Oct 30 21:54:07.908307 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907830 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-systemd-units\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.908307 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907886 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6f4b3be4-a694-497b-9fc5-ae54afc372d5-env-overrides\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.908307 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907912 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-run-netns\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:07.908307 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907916 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/82584512-72fe-4964-a8c3-7cacc053025e-cni-binary-copy\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:54:07.908307 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907945 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-crio-socket\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:54:07.908307 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.907972 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dcb86fdd-20cd-45b3-8533-a6900b903f13-agent-certs\") pod \"konnectivity-agent-mrg22\" (UID: \"dcb86fdd-20cd-45b3-8533-a6900b903f13\") " pod="kube-system/konnectivity-agent-mrg22" Oct 30 21:54:07.908307 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908038 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-metrics-tls\") pod \"dns-default-dv6jp\" (UID: \"e94c0ad7-2799-48e6-ba5c-a10053ffe98d\") " pod="openshift-dns/dns-default-dv6jp" Oct 30 21:54:07.908307 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908077 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6f4b3be4-a694-497b-9fc5-ae54afc372d5-env-overrides\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.908307 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908091 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-socket-dir-parent\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:07.908307 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908160 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-sys\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:07.908307 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908218 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-host\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:07.908307 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908259 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsccl\" (UniqueName: \"kubernetes.io/projected/1928dc59-9826-41df-8599-fce8ce310d74-kube-api-access-wsccl\") pod \"node-resolver-x5d7s\" (UID: \"1928dc59-9826-41df-8599-fce8ce310d74\") " pod="openshift-dns/node-resolver-x5d7s" Oct 30 21:54:07.908307 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908275 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dcb86fdd-20cd-45b3-8533-a6900b903f13-agent-certs\") pod \"konnectivity-agent-mrg22\" (UID: \"dcb86fdd-20cd-45b3-8533-a6900b903f13\") " pod="kube-system/konnectivity-agent-mrg22" Oct 30 21:54:07.908307 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908285 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-slash\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.908856 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908412 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/82584512-72fe-4964-a8c3-7cacc053025e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:54:07.908856 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908441 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-etc-openvswitch\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.908856 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908456 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-log-socket\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.908856 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908470 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-cni-bin\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.908856 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908500 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0081a009-4575-4b35-bf6b-6d12dd90067b-dbus\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:54:07.908856 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908530 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/39ebed07-3b7e-4027-93b0-f9c2b83802ab-cni-binary-copy\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:07.908856 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908575 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-var-lib-kubelet\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:07.908856 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908601 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6774e634-30d8-4808-9c87-fe25db7fcb9d-tmp\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:07.908856 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908628 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/82584512-72fe-4964-a8c3-7cacc053025e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:54:07.908856 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908678 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-socket-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:54:07.908856 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908686 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6774e634-30d8-4808-9c87-fe25db7fcb9d-tmp\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:07.908856 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908750 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/39ebed07-3b7e-4027-93b0-f9c2b83802ab-cni-binary-copy\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:07.908856 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908765 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-tmp-dir\") pod \"dns-default-dv6jp\" (UID: \"e94c0ad7-2799-48e6-ba5c-a10053ffe98d\") " pod="openshift-dns/dns-default-dv6jp" Oct 30 21:54:07.908856 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908796 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:54:07.908856 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908815 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:54:07.908856 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908845 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30d5a352-fc59-4709-9d83-0a756367d9e5-host\") pod \"node-ca-7zg8j\" (UID: \"30d5a352-fc59-4709-9d83-0a756367d9e5\") " pod="openshift-image-registry/node-ca-7zg8j" Oct 30 21:54:07.909591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908870 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-tmp-dir\") pod \"dns-default-dv6jp\" (UID: \"e94c0ad7-2799-48e6-ba5c-a10053ffe98d\") " pod="openshift-dns/dns-default-dv6jp" Oct 30 21:54:07.909591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908958 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-sysctl-d\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:07.909591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.908984 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5nv7\" (UniqueName: \"kubernetes.io/projected/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-kube-api-access-n5nv7\") pod \"dns-default-dv6jp\" (UID: \"e94c0ad7-2799-48e6-ba5c-a10053ffe98d\") " pod="openshift-dns/dns-default-dv6jp" Oct 30 21:54:07.909591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.909011 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1928dc59-9826-41df-8599-fce8ce310d74-hosts-file\") pod \"node-resolver-x5d7s\" (UID: \"1928dc59-9826-41df-8599-fce8ce310d74\") " pod="openshift-dns/node-resolver-x5d7s" Oct 30 21:54:07.909591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.909016 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:54:07.909591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.909026 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82584512-72fe-4964-a8c3-7cacc053025e-system-cni-dir\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:54:07.909591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.909066 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-hostroot\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:07.909591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.909159 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-sysctl-conf\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:07.909591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.909165 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0081a009-4575-4b35-bf6b-6d12dd90067b-original-pull-secret\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:54:07.909591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.909182 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-tuned\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:07.909591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.909217 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-var-lib-openvswitch\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.909591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.909275 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-run-openvswitch\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.909591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.909282 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-tuned\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:07.909591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.909348 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-cni-netd\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.909591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.909399 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs\") pod \"network-metrics-daemon-ktz7g\" (UID: \"e28f054c-44b5-4b39-9813-a547c1b41f04\") " pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:54:07.910025 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.909642 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e28f054c-44b5-4b39-9813-a547c1b41f04-metrics-certs\") pod \"network-metrics-daemon-ktz7g\" (UID: \"e28f054c-44b5-4b39-9813-a547c1b41f04\") " pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:54:07.916073 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.916044 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znz47\" (UniqueName: \"kubernetes.io/projected/6774e634-30d8-4808-9c87-fe25db7fcb9d-kube-api-access-znz47\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:07.916073 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.916063 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbjcs\" (UniqueName: \"kubernetes.io/projected/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-kube-api-access-qbjcs\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:54:07.916341 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.916323 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjr2s\" (UniqueName: \"kubernetes.io/projected/a0a75c4a-f43c-4b77-992c-3d060b81b889-kube-api-access-bjr2s\") pod \"ingress-canary-kb8fl\" (UID: \"a0a75c4a-f43c-4b77-992c-3d060b81b889\") " pod="openshift-ingress-canary/ingress-canary-kb8fl" Oct 30 21:54:07.916492 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.916473 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck7bh\" (UniqueName: \"kubernetes.io/projected/363de559-91e1-406d-bdec-36438ab7a186-kube-api-access-ck7bh\") pod \"network-check-target-dzt7m\" (UID: \"363de559-91e1-406d-bdec-36438ab7a186\") " pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:54:07.916685 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.916666 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktv45\" (UniqueName: \"kubernetes.io/projected/6f4b3be4-a694-497b-9fc5-ae54afc372d5-kube-api-access-ktv45\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:07.916815 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.916798 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbcsw\" (UniqueName: \"kubernetes.io/projected/44e85fdf-12c8-4aaf-8485-4b1ba16ed02f-kube-api-access-qbcsw\") pod \"iptables-alerter-nwd9g\" (UID: \"44e85fdf-12c8-4aaf-8485-4b1ba16ed02f\") " pod="openshift-network-operator/iptables-alerter-nwd9g" Oct 30 21:54:07.917448 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.917425 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nlgb\" (UniqueName: \"kubernetes.io/projected/82584512-72fe-4964-a8c3-7cacc053025e-kube-api-access-4nlgb\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:54:07.917540 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.917454 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhzxg\" (UniqueName: \"kubernetes.io/projected/30d5a352-fc59-4709-9d83-0a756367d9e5-kube-api-access-hhzxg\") pod \"node-ca-7zg8j\" (UID: \"30d5a352-fc59-4709-9d83-0a756367d9e5\") " pod="openshift-image-registry/node-ca-7zg8j" Oct 30 21:54:07.917597 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.917569 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9gzz\" (UniqueName: \"kubernetes.io/projected/e28f054c-44b5-4b39-9813-a547c1b41f04-kube-api-access-q9gzz\") pod \"network-metrics-daemon-ktz7g\" (UID: \"e28f054c-44b5-4b39-9813-a547c1b41f04\") " pod="openshift-multus/network-metrics-daemon-ktz7g" Oct 30 21:54:07.917923 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.917902 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj5j4\" (UniqueName: \"kubernetes.io/projected/39ebed07-3b7e-4027-93b0-f9c2b83802ab-kube-api-access-kj5j4\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:07.918063 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.918047 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl2xm\" (UniqueName: \"kubernetes.io/projected/eb862971-cdab-42db-8255-f8fee7a7df41-kube-api-access-dl2xm\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:54:07.918687 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.918666 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsccl\" (UniqueName: \"kubernetes.io/projected/1928dc59-9826-41df-8599-fce8ce310d74-kube-api-access-wsccl\") pod \"node-resolver-x5d7s\" (UID: \"1928dc59-9826-41df-8599-fce8ce310d74\") " pod="openshift-dns/node-resolver-x5d7s" Oct 30 21:54:07.919482 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.919459 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5nv7\" (UniqueName: \"kubernetes.io/projected/e94c0ad7-2799-48e6-ba5c-a10053ffe98d-kube-api-access-n5nv7\") pod \"dns-default-dv6jp\" (UID: \"e94c0ad7-2799-48e6-ba5c-a10053ffe98d\") " pod="openshift-dns/dns-default-dv6jp" Oct 30 21:54:07.989261 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.989222 7307 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 21:54:07.991655 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.991608 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Oct 30 21:54:07.991655 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.991656 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Oct 30 21:54:07.991930 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.991718 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Oct 30 21:54:07.991930 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.991886 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Oct 30 21:54:07.991930 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.991888 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Oct 30 21:54:07.992078 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.991972 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Oct 30 21:54:07.992129 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.992091 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Oct 30 21:54:07.992340 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.992249 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 30 21:54:07.992457 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.992438 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Oct 30 21:54:07.992935 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.992917 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Oct 30 21:54:07.993110 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.993087 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Oct 30 21:54:07.993110 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.993101 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Oct 30 21:54:07.993325 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.993188 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Oct 30 21:54:07.993325 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.993246 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Oct 30 21:54:07.993325 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.993278 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Oct 30 21:54:07.993325 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.993289 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qzlv4\"" Oct 30 21:54:07.993325 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.993302 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Oct 30 21:54:07.993325 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.993318 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Oct 30 21:54:07.993634 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.993352 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-49cblkfdffbbv\"" Oct 30 21:54:07.993634 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.993359 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Oct 30 21:54:07.993634 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.993360 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Oct 30 21:54:07.993634 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.993416 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Oct 30 21:54:07.993837 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.993820 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Oct 30 21:54:07.993898 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.993855 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Oct 30 21:54:07.993987 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.993970 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Oct 30 21:54:07.994079 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.993997 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Oct 30 21:54:07.994079 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.994022 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Oct 30 21:54:07.994079 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.994032 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Oct 30 21:54:07.994079 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.994042 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Oct 30 21:54:07.994079 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.994054 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Oct 30 21:54:07.994079 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.994060 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Oct 30 21:54:07.994079 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.994044 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Oct 30 21:54:07.994303 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.994083 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 30 21:54:07.994303 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.994094 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Oct 30 21:54:07.994303 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.994106 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Oct 30 21:54:07.994303 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.994113 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Oct 30 21:54:07.995218 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.995117 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Oct 30 21:54:07.995218 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.995162 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 30 21:54:07.995218 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.995167 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 30 21:54:07.995218 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.995165 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Oct 30 21:54:07.995218 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.995172 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Oct 30 21:54:07.995591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.995278 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Oct 30 21:54:07.995591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.995299 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Oct 30 21:54:07.995591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.995325 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-zt887\"" Oct 30 21:54:07.995591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.995352 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5mpvw\"" Oct 30 21:54:07.995591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.995366 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Oct 30 21:54:07.995591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.995422 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Oct 30 21:54:07.995591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.995436 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-98tjekdqudah9\"" Oct 30 21:54:07.995591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.995450 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Oct 30 21:54:07.995591 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.995467 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-czqxc\"" Oct 30 21:54:07.995898 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.995703 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Oct 30 21:54:07.996222 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.996149 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nn8xr\"" Oct 30 21:54:07.996222 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.996152 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 30 21:54:07.996222 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.996173 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9v7gcturvjje9\"" Oct 30 21:54:07.996222 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.996168 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qnh5q\"" Oct 30 21:54:07.996222 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.996189 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Oct 30 21:54:07.996222 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.996219 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nqd4m\"" Oct 30 21:54:07.996570 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:07.996221 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lfmrm\"" Oct 30 21:54:08.004569 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.004294 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Oct 30 21:54:08.004569 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.004501 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Oct 30 21:54:08.004569 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.004532 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Oct 30 21:54:08.004809 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.004656 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Oct 30 21:54:08.004809 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.004669 7307 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:54:08.004892 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.004848 7307 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:54:08.010360 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010335 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-etc-openvswitch\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.010496 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010368 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-cni-bin\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.010496 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010415 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.010496 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010478 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-cni-bin\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.010596 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010523 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-config-out\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.010596 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010534 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-etc-openvswitch\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.010596 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010572 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-var-lib-kubelet\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:08.010712 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010599 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-socket-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:54:08.010712 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010626 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.010712 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010680 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-config-out\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.010712 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010685 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-var-lib-kubelet\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:08.010712 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010627 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.010712 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010706 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-socket-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:54:08.010898 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010725 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q97n\" (UniqueName: \"kubernetes.io/projected/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-kube-api-access-6q97n\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.010898 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010750 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30d5a352-fc59-4709-9d83-0a756367d9e5-host\") pod \"node-ca-7zg8j\" (UID: \"30d5a352-fc59-4709-9d83-0a756367d9e5\") " pod="openshift-image-registry/node-ca-7zg8j" Oct 30 21:54:08.010898 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010787 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1928dc59-9826-41df-8599-fce8ce310d74-hosts-file\") pod \"node-resolver-x5d7s\" (UID: \"1928dc59-9826-41df-8599-fce8ce310d74\") " pod="openshift-dns/node-resolver-x5d7s" Oct 30 21:54:08.010898 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010815 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0b20b31-4338-40f4-82fb-55e7f9bafa3c-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-k7cl2\" (UID: \"a0b20b31-4338-40f4-82fb-55e7f9bafa3c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7cl2" Oct 30 21:54:08.010898 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010843 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.010898 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010868 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-hostroot\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.010898 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010885 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.010898 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010891 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-cni-netd\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.011143 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010918 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gczjz\" (UniqueName: \"kubernetes.io/projected/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-api-access-gczjz\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:54:08.011143 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010926 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30d5a352-fc59-4709-9d83-0a756367d9e5-host\") pod \"node-ca-7zg8j\" (UID: \"30d5a352-fc59-4709-9d83-0a756367d9e5\") " pod="openshift-image-registry/node-ca-7zg8j" Oct 30 21:54:08.011143 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.010980 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.011143 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011007 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0268731b-5534-46e0-a079-4998617d8048-tmp\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:54:08.011143 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011030 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.011143 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011055 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-var-lib-cni-multus\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.011143 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011088 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:54:08.011143 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011112 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-accelerators-collector-config\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:54:08.011143 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011140 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:54:08.011436 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011169 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-oauth-serving-cert\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:54:08.011436 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011191 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-conf-dir\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.011436 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011259 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-run-systemd\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.011436 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011265 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.011436 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011289 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acf30d7e-4114-4fe7-bf69-c6678b18c2af-sys\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:54:08.011436 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011314 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-config\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.011436 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011345 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-console-config\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:54:08.011436 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011413 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-tls\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:54:08.011728 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011438 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-wtmp\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:54:08.011728 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011464 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.011728 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011474 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1928dc59-9826-41df-8599-fce8ce310d74-hosts-file\") pod \"node-resolver-x5d7s\" (UID: \"1928dc59-9826-41df-8599-fce8ce310d74\") " pod="openshift-dns/node-resolver-x5d7s" Oct 30 21:54:08.011728 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011475 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-accelerators-collector-config\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:54:08.011728 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011509 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-hostroot\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.011728 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011532 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96b85972-43b4-4ebf-9d98-73905b20aba8-tmp\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:54:08.011728 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011555 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0268731b-5534-46e0-a079-4998617d8048-tmp\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:54:08.011728 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011556 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-system-cni-dir\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.011728 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011662 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:54:08.012002 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011740 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.012002 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011768 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0b20b31-4338-40f4-82fb-55e7f9bafa3c-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-k7cl2\" (UID: \"a0b20b31-4338-40f4-82fb-55e7f9bafa3c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7cl2" Oct 30 21:54:08.012002 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011799 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-system-cni-dir\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.012002 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011810 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-cni-netd\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.012002 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011844 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-oauth-serving-cert\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:54:08.012002 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011847 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-var-lib-cni-multus\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.012002 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011892 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-run-systemd\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.012002 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.011958 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96b85972-43b4-4ebf-9d98-73905b20aba8-tmp\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:54:08.012263 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012050 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:54:08.012263 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012104 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-conf-dir\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.012263 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012142 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.012263 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012178 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-tls\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:54:08.012263 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012237 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-kubernetes\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:08.012518 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012343 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-config\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.012518 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012351 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:54:08.012518 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012406 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-kubernetes\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:08.012518 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012439 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npnjz\" (UniqueName: \"kubernetes.io/projected/96b85972-43b4-4ebf-9d98-73905b20aba8-kube-api-access-npnjz\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:54:08.012518 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012448 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.012518 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012456 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-etc-kubernetes\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.012518 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012514 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-config-volume\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.012848 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012541 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-web-config\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.012848 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012560 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-etc-kubernetes\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.012848 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012584 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.012848 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012602 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-sysconfig\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:08.012848 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012631 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-device-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:54:08.012848 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012662 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:54:08.012848 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012685 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.012848 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012734 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.012848 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012745 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-config-volume\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.012848 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012764 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:54:08.012848 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012812 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-sysconfig\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:08.012848 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012843 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:54:08.013430 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012855 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-console-config\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:54:08.013430 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012910 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:54:08.013430 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.012986 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:54:08.013430 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013005 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-device-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:54:08.013430 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013031 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr48z\" (UniqueName: \"kubernetes.io/projected/0268731b-5534-46e0-a079-4998617d8048-kube-api-access-vr48z\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:54:08.013430 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013053 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-web-config\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.013430 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013065 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjd2f\" (UniqueName: \"kubernetes.io/projected/28b52705-cfb1-42c3-8942-e4ec290bf01a-kube-api-access-kjd2f\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:54:08.013430 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013169 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.013430 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013213 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.013430 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013263 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.013430 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013412 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-tv9dq\" (UID: \"fa3d72fd-de71-426f-8841-f6fdc58ddfb5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013441 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013454 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ed8c71ed-0f37-4927-b52d-5966421f9978-secret-metrics-server-client-certs\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013484 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013511 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013530 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013537 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013566 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ed8c71ed-0f37-4927-b52d-5966421f9978-secret-metrics-server-tls\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013588 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-cni-dir\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013610 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-systemd-units\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013634 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96b85972-43b4-4ebf-9d98-73905b20aba8-console-serving-cert\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013661 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-oauth-serving-cert\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013684 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-crio-socket\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013695 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013709 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013714 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013721 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ed8c71ed-0f37-4927-b52d-5966421f9978-secret-metrics-server-client-certs\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013736 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013606 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-tv9dq\" (UID: \"fa3d72fd-de71-426f-8841-f6fdc58ddfb5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013782 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad-crio-socket\") pod \"insights-runtime-extractor-flp69\" (UID: \"4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad\") " pod="openshift-insights/insights-runtime-extractor-flp69" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013795 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-cni-dir\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013800 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ed8c71ed-0f37-4927-b52d-5966421f9978-secret-metrics-server-tls\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013825 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-systemd-units\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013848 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013863 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-socket-dir-parent\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013891 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-sys\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013915 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-host\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013939 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-slash\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013965 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-textfile\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013979 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013991 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q76v\" (UniqueName: \"kubernetes.io/projected/acf30d7e-4114-4fe7-bf69-c6678b18c2af-kube-api-access-6q76v\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013994 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-oauth-serving-cert\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:54:08.013980 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.013998 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014028 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ed8c71ed-0f37-4927-b52d-5966421f9978-metrics-server-audit-profiles\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014048 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96b85972-43b4-4ebf-9d98-73905b20aba8-console-serving-cert\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014057 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-log-socket\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014069 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-multus-socket-dir-parent\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014073 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-textfile\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014082 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0081a009-4575-4b35-bf6b-6d12dd90067b-dbus\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014099 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-host\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014108 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014124 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-sys\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014140 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014169 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed8c71ed-0f37-4927-b52d-5966421f9978-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014194 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-slash\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014203 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-web-config\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014318 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-log-socket\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014327 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ed8c71ed-0f37-4927-b52d-5966421f9978-metrics-server-audit-profiles\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014400 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed8c71ed-0f37-4927-b52d-5966421f9978-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014406 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0081a009-4575-4b35-bf6b-6d12dd90067b-dbus\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014427 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014478 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014372 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014586 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-sysctl-d\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014595 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-web-config\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014612 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82584512-72fe-4964-a8c3-7cacc053025e-system-cni-dir\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014636 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/acf30d7e-4114-4fe7-bf69-c6678b18c2af-root\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014657 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014679 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014698 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-serving-cert\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014723 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmxhd\" (UniqueName: \"kubernetes.io/projected/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-kube-api-access-mmxhd\") pod \"openshift-state-metrics-7bd7489957-tv9dq\" (UID: \"fa3d72fd-de71-426f-8841-f6fdc58ddfb5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014731 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-sysctl-d\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014747 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-sysctl-conf\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014771 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-var-lib-openvswitch\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014795 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-run-openvswitch\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014820 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb9cn\" (UniqueName: \"kubernetes.io/projected/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-kube-api-access-hb9cn\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014846 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-oauth-config\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014872 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-tv9dq\" (UID: \"fa3d72fd-de71-426f-8841-f6fdc58ddfb5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014902 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014913 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014927 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44e85fdf-12c8-4aaf-8485-4b1ba16ed02f-host-slash\") pod \"iptables-alerter-nwd9g\" (UID: \"44e85fdf-12c8-4aaf-8485-4b1ba16ed02f\") " pod="openshift-network-operator/iptables-alerter-nwd9g" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014927 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014957 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/82584512-72fe-4964-a8c3-7cacc053025e-system-cni-dir\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014973 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-var-lib-openvswitch\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.014991 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-run-openvswitch\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015153 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-sysctl-conf\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015319 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-serving-cert\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015344 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-oauth-config\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015358 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015404 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015462 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015522 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44e85fdf-12c8-4aaf-8485-4b1ba16ed02f-host-slash\") pod \"iptables-alerter-nwd9g\" (UID: \"44e85fdf-12c8-4aaf-8485-4b1ba16ed02f\") " pod="openshift-network-operator/iptables-alerter-nwd9g" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015551 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28b52705-cfb1-42c3-8942-e4ec290bf01a-tmp\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015564 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015574 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ed8c71ed-0f37-4927-b52d-5966421f9978-audit-log\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:54:08.015574 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015599 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-modprobe-d\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015623 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-run-netns\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015630 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28b52705-cfb1-42c3-8942-e4ec290bf01a-tmp\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015630 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ed8c71ed-0f37-4927-b52d-5966421f9978-audit-log\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015648 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/82584512-72fe-4964-a8c3-7cacc053025e-cnibin\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015573 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-tv9dq\" (UID: \"fa3d72fd-de71-426f-8841-f6fdc58ddfb5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015675 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015696 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-run-netns\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015697 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-run-k8s-cni-cncf-io\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015731 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-modprobe-d\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015739 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-run-multus-certs\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015761 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/82584512-72fe-4964-a8c3-7cacc053025e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015784 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015799 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015825 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-grpc-tls\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015830 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-run-k8s-cni-cncf-io\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015852 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-tv9dq\" (UID: \"fa3d72fd-de71-426f-8841-f6fdc58ddfb5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015911 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015968 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/82584512-72fe-4964-a8c3-7cacc053025e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015734 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/82584512-72fe-4964-a8c3-7cacc053025e-cnibin\") pod \"multus-additional-cni-plugins-hkqj8\" (UID: \"82584512-72fe-4964-a8c3-7cacc053025e\") " pod="openshift-multus/multus-additional-cni-plugins-hkqj8" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016036 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016046 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-tv9dq\" (UID: \"fa3d72fd-de71-426f-8841-f6fdc58ddfb5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015827 7307 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016075 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-var-lib-cni-bin\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:08.016106 7307 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016108 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-var-lib-kubelet\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016142 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016146 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-grpc-tls\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.015800 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-run-multus-certs\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016175 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016201 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016207 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-var-lib-kubelet\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016225 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016231 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016246 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-var-lib-cni-bin\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016255 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016255 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-config\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016279 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-service-ca\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016303 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-cnibin\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016331 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acf30d7e-4114-4fe7-bf69-c6678b18c2af-metrics-client-ca\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016355 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96b85972-43b4-4ebf-9d98-73905b20aba8-console-oauth-config\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016396 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-registration-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016436 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-node-log\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016464 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016469 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-service-ca\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016494 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-kubelet\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016507 7307 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016521 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-etc-selinux\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:08.016544 7307 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-4.us-east-2.compute.internal" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016547 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0268731b-5534-46e0-a079-4998617d8048-metrics-client-ca\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016554 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-registration-dir\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016576 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016602 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed8c71ed-0f37-4927-b52d-5966421f9978-client-ca-bundle\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016606 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-cnibin\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016613 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-config\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016625 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-lib-modules\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016667 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-run-ovn\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016691 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-node-log\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016692 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0081a009-4575-4b35-bf6b-6d12dd90067b-kubelet-config\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016715 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-etc-selinux\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016718 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016508 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016790 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acf30d7e-4114-4fe7-bf69-c6678b18c2af-metrics-client-ca\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016818 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-systemd\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016833 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-host-kubelet\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016841 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-run\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016845 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed8c71ed-0f37-4927-b52d-5966421f9978-client-ca-bundle\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016869 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-sys-fs\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016878 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0081a009-4575-4b35-bf6b-6d12dd90067b-kubelet-config\") pod \"global-pull-secret-syncer-kczg2\" (UID: \"0081a009-4575-4b35-bf6b-6d12dd90067b\") " pod="kube-system/global-pull-secret-syncer-kczg2" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016889 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016893 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-etc-systemd\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016923 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2qvr\" (UniqueName: \"kubernetes.io/projected/ed8c71ed-0f37-4927-b52d-5966421f9978-kube-api-access-n2qvr\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016973 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-config-out\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.016986 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.017017 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6f4b3be4-a694-497b-9fc5-ae54afc372d5-run-ovn\") pod \"ovnkube-node-b9xpx\" (UID: \"6f4b3be4-a694-497b-9fc5-ae54afc372d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.017029 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0268731b-5534-46e0-a079-4998617d8048-metrics-client-ca\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.017030 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-tls\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.017053 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96b85972-43b4-4ebf-9d98-73905b20aba8-console-oauth-config\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.017070 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.017115 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-lib-modules\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.017123 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-config-out\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.017130 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eb862971-cdab-42db-8255-f8fee7a7df41-sys-fs\") pod \"aws-ebs-csi-driver-node-rg4gb\" (UID: \"eb862971-cdab-42db-8255-f8fee7a7df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rg4gb" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.017150 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-trusted-ca-bundle\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.017177 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6774e634-30d8-4808-9c87-fe25db7fcb9d-run\") pod \"tuned-wrp44\" (UID: \"6774e634-30d8-4808-9c87-fe25db7fcb9d\") " pod="openshift-cluster-node-tuning-operator/tuned-wrp44" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.017215 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-run-netns\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.017277 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.017293 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4cjk\" (UniqueName: \"kubernetes.io/projected/a0b20b31-4338-40f4-82fb-55e7f9bafa3c-kube-api-access-q4cjk\") pod \"monitoring-plugin-77f4f76594-k7cl2\" (UID: \"a0b20b31-4338-40f4-82fb-55e7f9bafa3c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7cl2" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.017318 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39ebed07-3b7e-4027-93b0-f9c2b83802ab-host-run-netns\") pod \"multus-srvpr\" (UID: \"39ebed07-3b7e-4027-93b0-f9c2b83802ab\") " pod="openshift-multus/multus-srvpr" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.017344 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.017360 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-service-ca\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.017498 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-trusted-ca-bundle\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.017611 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-service-ca\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.017729 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.018118 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.017919 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0268731b-5534-46e0-a079-4998617d8048-secret-thanos-querier-tls\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:54:08.022581 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.020695 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.022696 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.022677 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npnjz\" (UniqueName: \"kubernetes.io/projected/96b85972-43b4-4ebf-9d98-73905b20aba8-kube-api-access-npnjz\") pod \"console-97866b9c9-24hdt\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:54:08.022750 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.022708 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q97n\" (UniqueName: \"kubernetes.io/projected/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-kube-api-access-6q97n\") pod \"prometheus-k8s-0\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:08.022949 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.022926 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gczjz\" (UniqueName: \"kubernetes.io/projected/a7af64ff-9b50-4567-9016-b0cdd4ac7b15-kube-api-access-gczjz\") pod \"kube-state-metrics-5dc8d7d89b-rzwtt\" (UID: \"a7af64ff-9b50-4567-9016-b0cdd4ac7b15\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-rzwtt" Oct 30 21:54:08.023273 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.023251 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr48z\" (UniqueName: \"kubernetes.io/projected/0268731b-5534-46e0-a079-4998617d8048-kube-api-access-vr48z\") pod \"thanos-querier-57888bcfc4-5g9tj\" (UID: \"0268731b-5534-46e0-a079-4998617d8048\") " pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:54:08.023466 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.023450 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjd2f\" (UniqueName: \"kubernetes.io/projected/28b52705-cfb1-42c3-8942-e4ec290bf01a-kube-api-access-kjd2f\") pod \"console-cccc5c698-lcpx2\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:54:08.024498 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.024479 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q76v\" (UniqueName: \"kubernetes.io/projected/acf30d7e-4114-4fe7-bf69-c6678b18c2af-kube-api-access-6q76v\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:54:08.025672 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.025649 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb9cn\" (UniqueName: \"kubernetes.io/projected/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-kube-api-access-hb9cn\") pod \"alertmanager-main-0\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:08.025672 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.025664 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmxhd\" (UniqueName: \"kubernetes.io/projected/fa3d72fd-de71-426f-8841-f6fdc58ddfb5-kube-api-access-mmxhd\") pod \"openshift-state-metrics-7bd7489957-tv9dq\" (UID: \"fa3d72fd-de71-426f-8841-f6fdc58ddfb5\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-tv9dq" Oct 30 21:54:08.027847 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.027826 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4cjk\" (UniqueName: \"kubernetes.io/projected/a0b20b31-4338-40f4-82fb-55e7f9bafa3c-kube-api-access-q4cjk\") pod \"monitoring-plugin-77f4f76594-k7cl2\" (UID: \"a0b20b31-4338-40f4-82fb-55e7f9bafa3c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7cl2" Oct 30 21:54:08.028246 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.028231 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2qvr\" (UniqueName: \"kubernetes.io/projected/ed8c71ed-0f37-4927-b52d-5966421f9978-kube-api-access-n2qvr\") pod \"metrics-server-67979d6695-hbngh\" (UID: \"ed8c71ed-0f37-4927-b52d-5966421f9978\") " pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:54:08.118436 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.118333 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acf30d7e-4114-4fe7-bf69-c6678b18c2af-sys\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:54:08.118587 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.118372 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-wtmp\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:54:08.118587 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.118459 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acf30d7e-4114-4fe7-bf69-c6678b18c2af-sys\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:54:08.118587 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.118498 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/acf30d7e-4114-4fe7-bf69-c6678b18c2af-root\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:54:08.118587 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.118548 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/acf30d7e-4114-4fe7-bf69-c6678b18c2af-node-exporter-wtmp\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:54:08.118587 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.118558 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/acf30d7e-4114-4fe7-bf69-c6678b18c2af-root\") pod \"node-exporter-pqvnh\" (UID: \"acf30d7e-4114-4fe7-bf69-c6678b18c2af\") " pod="openshift-monitoring/node-exporter-pqvnh" Oct 30 21:54:08.568681 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:08.568596 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:09.140624 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:09.140595 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:09.889566 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:09.889537 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-57888bcfc4-5g9tj" Oct 30 21:54:10.013992 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:10.013961 7307 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 21:54:10.644628 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:10.644591 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:10.894345 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:10.894314 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-k7cl2" Oct 30 21:54:10.908594 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:10.908531 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dv6jp" Oct 30 21:54:12.239781 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:12.239745 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:54:14.273169 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:14.273132 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 21:54:14.542107 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:14.542030 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mrg22" Oct 30 21:54:15.536101 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:15.536062 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:54:17.643409 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:17.643320 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b9xpx" Oct 30 21:54:17.855878 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:17.855848 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-67979d6695-hbngh" Oct 30 21:54:23.054179 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:23.054139 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 21:54:23.054808 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:23.054730 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="alertmanager" containerID="cri-o://7daf53af9532eeb059fdea4a0e58fc036de29c4560630f9e819efbf0fabe0d13" gracePeriod=120 Oct 30 21:54:23.055561 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:23.055064 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="kube-rbac-proxy" containerID="cri-o://a6e19020732e2ef5fe8a5b92b1b7903f609e351465549904056976bee570d1d0" gracePeriod=120 Oct 30 21:54:23.055561 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:23.055215 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="kube-rbac-proxy-web" containerID="cri-o://9de38abea22a0d3a09e608a11e58aa0d2d798ee0ffd689901125214fdd2f786e" gracePeriod=120 Oct 30 21:54:23.055561 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:23.055234 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="kube-rbac-proxy-metric" containerID="cri-o://34199c2cc199efb1b1064ba2e7108967f351ad188b5bb9b4392256106088b4d7" gracePeriod=120 Oct 30 21:54:23.055561 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:23.055244 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="prom-label-proxy" containerID="cri-o://a696b8eb58c851d4fd25fb75a70633bbb94b7f6b2a6c9e92e09bb55373213e38" gracePeriod=120 Oct 30 21:54:23.055561 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:23.055338 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="config-reloader" containerID="cri-o://d4667f4ebb55938df9156f226eb0ef7aae82dd5ed80113af453eebcb10f8c367" gracePeriod=120 Oct 30 21:54:24.072000 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.071970 7307 generic.go:356] "Generic (PLEG): container finished" podID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerID="a696b8eb58c851d4fd25fb75a70633bbb94b7f6b2a6c9e92e09bb55373213e38" exitCode=0 Oct 30 21:54:24.072000 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.071993 7307 generic.go:356] "Generic (PLEG): container finished" podID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerID="34199c2cc199efb1b1064ba2e7108967f351ad188b5bb9b4392256106088b4d7" exitCode=0 Oct 30 21:54:24.072000 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.072000 7307 generic.go:356] "Generic (PLEG): container finished" podID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerID="a6e19020732e2ef5fe8a5b92b1b7903f609e351465549904056976bee570d1d0" exitCode=0 Oct 30 21:54:24.072000 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.072009 7307 generic.go:356] "Generic (PLEG): container finished" podID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerID="d4667f4ebb55938df9156f226eb0ef7aae82dd5ed80113af453eebcb10f8c367" exitCode=0 Oct 30 21:54:24.072491 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.072014 7307 generic.go:356] "Generic (PLEG): container finished" podID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerID="7daf53af9532eeb059fdea4a0e58fc036de29c4560630f9e819efbf0fabe0d13" exitCode=0 Oct 30 21:54:24.072491 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.072038 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d24ddebb-3f30-4295-bc6c-1e8adf037cb9","Type":"ContainerDied","Data":"a696b8eb58c851d4fd25fb75a70633bbb94b7f6b2a6c9e92e09bb55373213e38"} Oct 30 21:54:24.072491 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.072103 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d24ddebb-3f30-4295-bc6c-1e8adf037cb9","Type":"ContainerDied","Data":"34199c2cc199efb1b1064ba2e7108967f351ad188b5bb9b4392256106088b4d7"} Oct 30 21:54:24.072491 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.072131 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d24ddebb-3f30-4295-bc6c-1e8adf037cb9","Type":"ContainerDied","Data":"a6e19020732e2ef5fe8a5b92b1b7903f609e351465549904056976bee570d1d0"} Oct 30 21:54:24.072491 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.072155 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d24ddebb-3f30-4295-bc6c-1e8adf037cb9","Type":"ContainerDied","Data":"d4667f4ebb55938df9156f226eb0ef7aae82dd5ed80113af453eebcb10f8c367"} Oct 30 21:54:24.072491 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.072195 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d24ddebb-3f30-4295-bc6c-1e8adf037cb9","Type":"ContainerDied","Data":"7daf53af9532eeb059fdea4a0e58fc036de29c4560630f9e819efbf0fabe0d13"} Oct 30 21:54:24.315569 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.315544 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:24.465920 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.465884 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-config-volume\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-config-volume\") pod \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " Oct 30 21:54:24.466116 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.465936 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-cluster-tls-config\") pod \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " Oct 30 21:54:24.466116 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.465979 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-metrics-client-ca\") pod \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " Oct 30 21:54:24.466116 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.465997 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-main-tls\") pod \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " Oct 30 21:54:24.466116 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.466029 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-config-out\" (UniqueName: \"kubernetes.io/empty-dir/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-config-out\") pod \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " Oct 30 21:54:24.466116 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.466063 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-alertmanager-main-db\") pod \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " Oct 30 21:54:24.466477 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.466175 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-tls-assets\" (UniqueName: \"kubernetes.io/projected/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-tls-assets\") pod \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " Oct 30 21:54:24.466477 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.466449 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-alertmanager-main-db" pod "d24ddebb-3f30-4295-bc6c-1e8adf037cb9" (UID: "d24ddebb-3f30-4295-bc6c-1e8adf037cb9"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 21:54:24.466608 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.466453 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-web-config\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-web-config\") pod \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " Oct 30 21:54:24.466608 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.466535 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy\") pod \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " Oct 30 21:54:24.466608 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.466580 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-kube-api-access-hb9cn\" (UniqueName: \"kubernetes.io/projected/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-kube-api-access-hb9cn\") pod \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " Oct 30 21:54:24.466751 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.466627 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-alertmanager-trusted-ca-bundle\") pod \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " Oct 30 21:54:24.466751 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.466668 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " Oct 30 21:54:24.466751 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.466703 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy-web\") pod \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\" (UID: \"d24ddebb-3f30-4295-bc6c-1e8adf037cb9\") " Oct 30 21:54:24.467904 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.466977 7307 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-alertmanager-main-db\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:24.468482 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.466533 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-metrics-client-ca" pod "d24ddebb-3f30-4295-bc6c-1e8adf037cb9" (UID: "d24ddebb-3f30-4295-bc6c-1e8adf037cb9"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:54:24.468586 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.467638 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-alertmanager-trusted-ca-bundle" pod "d24ddebb-3f30-4295-bc6c-1e8adf037cb9" (UID: "d24ddebb-3f30-4295-bc6c-1e8adf037cb9"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:54:24.469714 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.469686 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-config-volume" pod "d24ddebb-3f30-4295-bc6c-1e8adf037cb9" (UID: "d24ddebb-3f30-4295-bc6c-1e8adf037cb9"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:54:24.469867 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.469820 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy" pod "d24ddebb-3f30-4295-bc6c-1e8adf037cb9" (UID: "d24ddebb-3f30-4295-bc6c-1e8adf037cb9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:54:24.470024 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.469981 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-main-tls" pod "d24ddebb-3f30-4295-bc6c-1e8adf037cb9" (UID: "d24ddebb-3f30-4295-bc6c-1e8adf037cb9"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:54:24.470161 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.470136 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy-web" pod "d24ddebb-3f30-4295-bc6c-1e8adf037cb9" (UID: "d24ddebb-3f30-4295-bc6c-1e8adf037cb9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:54:24.470273 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.470248 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-config-out" pod "d24ddebb-3f30-4295-bc6c-1e8adf037cb9" (UID: "d24ddebb-3f30-4295-bc6c-1e8adf037cb9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 21:54:24.470423 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.470404 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy-metric" pod "d24ddebb-3f30-4295-bc6c-1e8adf037cb9" (UID: "d24ddebb-3f30-4295-bc6c-1e8adf037cb9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:54:24.470701 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.470675 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-tls-assets" pod "d24ddebb-3f30-4295-bc6c-1e8adf037cb9" (UID: "d24ddebb-3f30-4295-bc6c-1e8adf037cb9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 21:54:24.471145 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.471127 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-kube-api-access-hb9cn" pod "d24ddebb-3f30-4295-bc6c-1e8adf037cb9" (UID: "d24ddebb-3f30-4295-bc6c-1e8adf037cb9"). InnerVolumeSpecName "kube-api-access-hb9cn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 21:54:24.474755 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.474733 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-cluster-tls-config" pod "d24ddebb-3f30-4295-bc6c-1e8adf037cb9" (UID: "d24ddebb-3f30-4295-bc6c-1e8adf037cb9"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:54:24.481568 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.481503 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-web-config" pod "d24ddebb-3f30-4295-bc6c-1e8adf037cb9" (UID: "d24ddebb-3f30-4295-bc6c-1e8adf037cb9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:54:24.568071 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.568031 7307 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-cluster-tls-config\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:24.568071 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.568063 7307 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-metrics-client-ca\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:24.568071 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.568075 7307 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-main-tls\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:24.568295 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.568088 7307 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-config-out\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:24.568295 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.568097 7307 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-tls-assets\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:24.568295 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.568107 7307 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-web-config\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:24.568295 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.568116 7307 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:24.568295 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.568125 7307 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hb9cn\" (UniqueName: \"kubernetes.io/projected/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-kube-api-access-hb9cn\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:24.568295 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.568134 7307 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:24.568295 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.568143 7307 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:24.568295 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.568153 7307 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:24.568295 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:24.568162 7307 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d24ddebb-3f30-4295-bc6c-1e8adf037cb9-config-volume\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:25.078700 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.078663 7307 generic.go:356] "Generic (PLEG): container finished" podID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerID="9de38abea22a0d3a09e608a11e58aa0d2d798ee0ffd689901125214fdd2f786e" exitCode=0 Oct 30 21:54:25.079099 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.078738 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d24ddebb-3f30-4295-bc6c-1e8adf037cb9","Type":"ContainerDied","Data":"9de38abea22a0d3a09e608a11e58aa0d2d798ee0ffd689901125214fdd2f786e"} Oct 30 21:54:25.079099 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.078760 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.079099 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.078807 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d24ddebb-3f30-4295-bc6c-1e8adf037cb9","Type":"ContainerDied","Data":"f0a39f51aa230f8fd6257b67119920ef316b4edb5d0adde16ce696c264f41d14"} Oct 30 21:54:25.079099 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.078840 7307 scope.go:122] "RemoveContainer" containerID="a696b8eb58c851d4fd25fb75a70633bbb94b7f6b2a6c9e92e09bb55373213e38" Oct 30 21:54:25.087327 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.087307 7307 scope.go:122] "RemoveContainer" containerID="34199c2cc199efb1b1064ba2e7108967f351ad188b5bb9b4392256106088b4d7" Oct 30 21:54:25.094209 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.094192 7307 scope.go:122] "RemoveContainer" containerID="a6e19020732e2ef5fe8a5b92b1b7903f609e351465549904056976bee570d1d0" Oct 30 21:54:25.101217 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.101195 7307 scope.go:122] "RemoveContainer" containerID="9de38abea22a0d3a09e608a11e58aa0d2d798ee0ffd689901125214fdd2f786e" Oct 30 21:54:25.101769 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.101749 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 21:54:25.106448 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.106423 7307 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 21:54:25.110147 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.110125 7307 scope.go:122] "RemoveContainer" containerID="d4667f4ebb55938df9156f226eb0ef7aae82dd5ed80113af453eebcb10f8c367" Oct 30 21:54:25.117552 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.117528 7307 scope.go:122] "RemoveContainer" containerID="7daf53af9532eeb059fdea4a0e58fc036de29c4560630f9e819efbf0fabe0d13" Oct 30 21:54:25.124951 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.124931 7307 scope.go:122] "RemoveContainer" containerID="c78978e7e8af877cc442f8a41d3c68b09513f0020b5a5a08bdb286fba12e22cd" Oct 30 21:54:25.132428 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.132408 7307 scope.go:122] "RemoveContainer" containerID="a696b8eb58c851d4fd25fb75a70633bbb94b7f6b2a6c9e92e09bb55373213e38" Oct 30 21:54:25.132748 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:25.132727 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a696b8eb58c851d4fd25fb75a70633bbb94b7f6b2a6c9e92e09bb55373213e38\": container with ID starting with a696b8eb58c851d4fd25fb75a70633bbb94b7f6b2a6c9e92e09bb55373213e38 not found: ID does not exist" containerID="a696b8eb58c851d4fd25fb75a70633bbb94b7f6b2a6c9e92e09bb55373213e38" Oct 30 21:54:25.132831 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.132765 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a696b8eb58c851d4fd25fb75a70633bbb94b7f6b2a6c9e92e09bb55373213e38"} err="failed to get container status \"a696b8eb58c851d4fd25fb75a70633bbb94b7f6b2a6c9e92e09bb55373213e38\": rpc error: code = NotFound desc = could not find container \"a696b8eb58c851d4fd25fb75a70633bbb94b7f6b2a6c9e92e09bb55373213e38\": container with ID starting with a696b8eb58c851d4fd25fb75a70633bbb94b7f6b2a6c9e92e09bb55373213e38 not found: ID does not exist" Oct 30 21:54:25.132831 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.132812 7307 scope.go:122] "RemoveContainer" containerID="34199c2cc199efb1b1064ba2e7108967f351ad188b5bb9b4392256106088b4d7" Oct 30 21:54:25.133075 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:25.133055 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34199c2cc199efb1b1064ba2e7108967f351ad188b5bb9b4392256106088b4d7\": container with ID starting with 34199c2cc199efb1b1064ba2e7108967f351ad188b5bb9b4392256106088b4d7 not found: ID does not exist" containerID="34199c2cc199efb1b1064ba2e7108967f351ad188b5bb9b4392256106088b4d7" Oct 30 21:54:25.133120 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.133086 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34199c2cc199efb1b1064ba2e7108967f351ad188b5bb9b4392256106088b4d7"} err="failed to get container status \"34199c2cc199efb1b1064ba2e7108967f351ad188b5bb9b4392256106088b4d7\": rpc error: code = NotFound desc = could not find container \"34199c2cc199efb1b1064ba2e7108967f351ad188b5bb9b4392256106088b4d7\": container with ID starting with 34199c2cc199efb1b1064ba2e7108967f351ad188b5bb9b4392256106088b4d7 not found: ID does not exist" Oct 30 21:54:25.133120 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.133103 7307 scope.go:122] "RemoveContainer" containerID="a6e19020732e2ef5fe8a5b92b1b7903f609e351465549904056976bee570d1d0" Oct 30 21:54:25.133357 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:25.133310 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6e19020732e2ef5fe8a5b92b1b7903f609e351465549904056976bee570d1d0\": container with ID starting with a6e19020732e2ef5fe8a5b92b1b7903f609e351465549904056976bee570d1d0 not found: ID does not exist" containerID="a6e19020732e2ef5fe8a5b92b1b7903f609e351465549904056976bee570d1d0" Oct 30 21:54:25.133357 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.133328 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6e19020732e2ef5fe8a5b92b1b7903f609e351465549904056976bee570d1d0"} err="failed to get container status \"a6e19020732e2ef5fe8a5b92b1b7903f609e351465549904056976bee570d1d0\": rpc error: code = NotFound desc = could not find container \"a6e19020732e2ef5fe8a5b92b1b7903f609e351465549904056976bee570d1d0\": container with ID starting with a6e19020732e2ef5fe8a5b92b1b7903f609e351465549904056976bee570d1d0 not found: ID does not exist" Oct 30 21:54:25.133357 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.133345 7307 scope.go:122] "RemoveContainer" containerID="9de38abea22a0d3a09e608a11e58aa0d2d798ee0ffd689901125214fdd2f786e" Oct 30 21:54:25.133650 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:25.133634 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9de38abea22a0d3a09e608a11e58aa0d2d798ee0ffd689901125214fdd2f786e\": container with ID starting with 9de38abea22a0d3a09e608a11e58aa0d2d798ee0ffd689901125214fdd2f786e not found: ID does not exist" containerID="9de38abea22a0d3a09e608a11e58aa0d2d798ee0ffd689901125214fdd2f786e" Oct 30 21:54:25.133698 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.133654 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9de38abea22a0d3a09e608a11e58aa0d2d798ee0ffd689901125214fdd2f786e"} err="failed to get container status \"9de38abea22a0d3a09e608a11e58aa0d2d798ee0ffd689901125214fdd2f786e\": rpc error: code = NotFound desc = could not find container \"9de38abea22a0d3a09e608a11e58aa0d2d798ee0ffd689901125214fdd2f786e\": container with ID starting with 9de38abea22a0d3a09e608a11e58aa0d2d798ee0ffd689901125214fdd2f786e not found: ID does not exist" Oct 30 21:54:25.133698 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.133666 7307 scope.go:122] "RemoveContainer" containerID="d4667f4ebb55938df9156f226eb0ef7aae82dd5ed80113af453eebcb10f8c367" Oct 30 21:54:25.133913 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:25.133893 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4667f4ebb55938df9156f226eb0ef7aae82dd5ed80113af453eebcb10f8c367\": container with ID starting with d4667f4ebb55938df9156f226eb0ef7aae82dd5ed80113af453eebcb10f8c367 not found: ID does not exist" containerID="d4667f4ebb55938df9156f226eb0ef7aae82dd5ed80113af453eebcb10f8c367" Oct 30 21:54:25.133953 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.133919 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4667f4ebb55938df9156f226eb0ef7aae82dd5ed80113af453eebcb10f8c367"} err="failed to get container status \"d4667f4ebb55938df9156f226eb0ef7aae82dd5ed80113af453eebcb10f8c367\": rpc error: code = NotFound desc = could not find container \"d4667f4ebb55938df9156f226eb0ef7aae82dd5ed80113af453eebcb10f8c367\": container with ID starting with d4667f4ebb55938df9156f226eb0ef7aae82dd5ed80113af453eebcb10f8c367 not found: ID does not exist" Oct 30 21:54:25.133953 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.133933 7307 scope.go:122] "RemoveContainer" containerID="7daf53af9532eeb059fdea4a0e58fc036de29c4560630f9e819efbf0fabe0d13" Oct 30 21:54:25.134176 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:25.134158 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7daf53af9532eeb059fdea4a0e58fc036de29c4560630f9e819efbf0fabe0d13\": container with ID starting with 7daf53af9532eeb059fdea4a0e58fc036de29c4560630f9e819efbf0fabe0d13 not found: ID does not exist" containerID="7daf53af9532eeb059fdea4a0e58fc036de29c4560630f9e819efbf0fabe0d13" Oct 30 21:54:25.134222 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.134183 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7daf53af9532eeb059fdea4a0e58fc036de29c4560630f9e819efbf0fabe0d13"} err="failed to get container status \"7daf53af9532eeb059fdea4a0e58fc036de29c4560630f9e819efbf0fabe0d13\": rpc error: code = NotFound desc = could not find container \"7daf53af9532eeb059fdea4a0e58fc036de29c4560630f9e819efbf0fabe0d13\": container with ID starting with 7daf53af9532eeb059fdea4a0e58fc036de29c4560630f9e819efbf0fabe0d13 not found: ID does not exist" Oct 30 21:54:25.134222 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.134198 7307 scope.go:122] "RemoveContainer" containerID="c78978e7e8af877cc442f8a41d3c68b09513f0020b5a5a08bdb286fba12e22cd" Oct 30 21:54:25.134442 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:25.134427 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c78978e7e8af877cc442f8a41d3c68b09513f0020b5a5a08bdb286fba12e22cd\": container with ID starting with c78978e7e8af877cc442f8a41d3c68b09513f0020b5a5a08bdb286fba12e22cd not found: ID does not exist" containerID="c78978e7e8af877cc442f8a41d3c68b09513f0020b5a5a08bdb286fba12e22cd" Oct 30 21:54:25.134480 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.134445 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c78978e7e8af877cc442f8a41d3c68b09513f0020b5a5a08bdb286fba12e22cd"} err="failed to get container status \"c78978e7e8af877cc442f8a41d3c68b09513f0020b5a5a08bdb286fba12e22cd\": rpc error: code = NotFound desc = could not find container \"c78978e7e8af877cc442f8a41d3c68b09513f0020b5a5a08bdb286fba12e22cd\": container with ID starting with c78978e7e8af877cc442f8a41d3c68b09513f0020b5a5a08bdb286fba12e22cd not found: ID does not exist" Oct 30 21:54:25.137683 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.137661 7307 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 21:54:25.137974 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.137961 7307 cpu_manager.go:414] "containerMap: removing container" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="init-config-reloader" Oct 30 21:54:25.138015 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.137976 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="init-config-reloader" Oct 30 21:54:25.138015 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.137989 7307 cpu_manager.go:414] "containerMap: removing container" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="config-reloader" Oct 30 21:54:25.138015 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.137995 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="config-reloader" Oct 30 21:54:25.138015 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.138006 7307 cpu_manager.go:414] "containerMap: removing container" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="kube-rbac-proxy" Oct 30 21:54:25.138015 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.138011 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="kube-rbac-proxy" Oct 30 21:54:25.138160 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.138027 7307 cpu_manager.go:414] "containerMap: removing container" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="alertmanager" Oct 30 21:54:25.138160 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.138032 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="alertmanager" Oct 30 21:54:25.138160 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.138041 7307 cpu_manager.go:414] "containerMap: removing container" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="kube-rbac-proxy-web" Oct 30 21:54:25.138160 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.138046 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="kube-rbac-proxy-web" Oct 30 21:54:25.138160 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.138055 7307 cpu_manager.go:414] "containerMap: removing container" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="prom-label-proxy" Oct 30 21:54:25.138160 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.138060 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="prom-label-proxy" Oct 30 21:54:25.138160 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.138070 7307 cpu_manager.go:414] "containerMap: removing container" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="kube-rbac-proxy-metric" Oct 30 21:54:25.138160 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.138074 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="kube-rbac-proxy-metric" Oct 30 21:54:25.138160 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.138123 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="kube-rbac-proxy-web" Oct 30 21:54:25.138160 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.138131 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="prom-label-proxy" Oct 30 21:54:25.138160 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.138139 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="kube-rbac-proxy-metric" Oct 30 21:54:25.138160 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.138145 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="init-config-reloader" Oct 30 21:54:25.138160 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.138151 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="config-reloader" Oct 30 21:54:25.138160 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.138158 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="kube-rbac-proxy" Oct 30 21:54:25.138160 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.138164 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" containerName="alertmanager" Oct 30 21:54:25.144239 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.144210 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.150290 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.150269 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Oct 30 21:54:25.150612 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.150593 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nqd4m\"" Oct 30 21:54:25.150699 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.150626 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Oct 30 21:54:25.150794 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.150782 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Oct 30 21:54:25.151009 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.150996 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Oct 30 21:54:25.151135 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.151122 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Oct 30 21:54:25.151211 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.151194 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Oct 30 21:54:25.151258 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.151198 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Oct 30 21:54:25.151258 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.151204 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Oct 30 21:54:25.154413 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.154397 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Oct 30 21:54:25.161637 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.161611 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 21:54:25.274676 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.274570 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.274676 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.274613 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-web-config\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.274676 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.274632 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.274891 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.274697 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.274891 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.274849 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-config-out\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.274891 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.274884 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-config-volume\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.275015 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.274908 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdqd5\" (UniqueName: \"kubernetes.io/projected/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-kube-api-access-gdqd5\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.275015 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.274935 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.275121 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.275049 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.275121 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.275104 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.275189 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.275146 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.275189 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.275169 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.275263 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.275226 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.376613 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.376577 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-config-out\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.376613 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.376617 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-config-volume\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.376857 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.376643 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdqd5\" (UniqueName: \"kubernetes.io/projected/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-kube-api-access-gdqd5\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.376857 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.376673 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.376857 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.376695 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.376857 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.376723 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.376857 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.376765 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.376857 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.376794 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.376857 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.376831 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.377134 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.376888 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.377134 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.376910 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-web-config\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.377134 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.376928 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.377134 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.376945 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.377134 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.377036 7307 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 21:54:25.377552 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.377498 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.377998 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.377974 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.378209 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.378183 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.379783 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.379758 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.380449 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.380047 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-config-volume\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.380449 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.380401 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-config-out\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.380594 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.380531 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-web-config\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.380594 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.380540 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.380996 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.380975 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.381058 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.380976 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.381306 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.381289 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.381566 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.381549 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.389711 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.389689 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdqd5\" (UniqueName: \"kubernetes.io/projected/d8d85cab-0e50-45eb-8b0d-10a3fbde35b9-kube-api-access-gdqd5\") pod \"alertmanager-main-0\" (UID: \"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.476214 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.476176 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 21:54:25.763053 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:25.762946 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 21:54:25.767516 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:25.767484 7307 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d85cab_0e50_45eb_8b0d_10a3fbde35b9.slice/crio-d2e08ca3fa65f8e336fa3e59728da5cb5230ba50c7cffd6bf99ad8f3cb6ac33f WatchSource:0}: Error finding container d2e08ca3fa65f8e336fa3e59728da5cb5230ba50c7cffd6bf99ad8f3cb6ac33f: Status 404 returned error can't find the container with id d2e08ca3fa65f8e336fa3e59728da5cb5230ba50c7cffd6bf99ad8f3cb6ac33f Oct 30 21:54:26.084285 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:26.084198 7307 generic.go:356] "Generic (PLEG): container finished" podID="d8d85cab-0e50-45eb-8b0d-10a3fbde35b9" containerID="989abe1f6b9d0ab0081dc027649fc690d775a8a29f4e9ca4f425bc76b2f9fd09" exitCode=0 Oct 30 21:54:26.084755 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:26.084287 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9","Type":"ContainerDied","Data":"989abe1f6b9d0ab0081dc027649fc690d775a8a29f4e9ca4f425bc76b2f9fd09"} Oct 30 21:54:26.084755 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:26.084374 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9","Type":"ContainerStarted","Data":"d2e08ca3fa65f8e336fa3e59728da5cb5230ba50c7cffd6bf99ad8f3cb6ac33f"} Oct 30 21:54:26.930219 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:26.930187 7307 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d24ddebb-3f30-4295-bc6c-1e8adf037cb9" path="/var/lib/kubelet/pods/d24ddebb-3f30-4295-bc6c-1e8adf037cb9/volumes" Oct 30 21:54:27.093449 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.093408 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9","Type":"ContainerStarted","Data":"a9dbd80108f74d16070d578bc8716614a474511abb0b798eb75c487a9a951b66"} Oct 30 21:54:27.093968 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.093502 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9","Type":"ContainerStarted","Data":"aee9ae1a634155add79d66dc4bd85ab1e4488998f6ea2134bc7e5e2e8093ca7a"} Oct 30 21:54:27.093968 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.093543 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9","Type":"ContainerStarted","Data":"da3fe8b1256602d059f1ede56a84c0cbeac51ef00397c8ab41155b0a0c291934"} Oct 30 21:54:27.093968 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.093582 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9","Type":"ContainerStarted","Data":"2b43e095df1a6dacfa94002ceff5720d198c228b2919c82c3e4e30ff6ec248c9"} Oct 30 21:54:27.093968 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.093627 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9","Type":"ContainerStarted","Data":"17cf2040ebaeeb262520163822e2c41fe117ce9c398856c97b85f70c1f0e525a"} Oct 30 21:54:27.093968 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.093664 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8d85cab-0e50-45eb-8b0d-10a3fbde35b9","Type":"ContainerStarted","Data":"68f2f8c6e56e12ed3666d983be75cd6348f4c0a9444f99675c81ed7c0bd2a00f"} Oct 30 21:54:27.441590 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.441371 7307 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.427868386 podStartE2EDuration="2.441352226s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.48384ms" isStatefulPod=false podCreationTimestamp="2026-10-30 21:54:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:27.131262543 +0000 UTC m=+20.332634764" watchObservedRunningTime="2026-10-30 21:54:27.441352226 +0000 UTC m=+20.642724429" Oct 30 21:54:27.441825 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.441800 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 30 21:54:27.442264 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.442218 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="prometheus" containerID="cri-o://c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a" gracePeriod=600 Oct 30 21:54:27.442438 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.442413 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="kube-rbac-proxy-thanos" containerID="cri-o://cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056" gracePeriod=600 Oct 30 21:54:27.442512 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.442425 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="thanos-sidecar" containerID="cri-o://20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee" gracePeriod=600 Oct 30 21:54:27.442512 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.442459 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="kube-rbac-proxy" containerID="cri-o://a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6" gracePeriod=600 Oct 30 21:54:27.442609 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.442528 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="config-reloader" containerID="cri-o://1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88" gracePeriod=600 Oct 30 21:54:27.442609 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.442554 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="kube-rbac-proxy-web" containerID="cri-o://012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361" gracePeriod=600 Oct 30 21:54:27.730243 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.730216 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:27.900934 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.900881 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-tls-assets\" (UniqueName: \"kubernetes.io/projected/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-tls-assets\") pod \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " Oct 30 21:54:27.900934 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.900942 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " Oct 30 21:54:27.901188 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.900966 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-db\") pod \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " Oct 30 21:54:27.901188 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.900995 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-2\") pod \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " Oct 30 21:54:27.901188 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.901043 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-kubelet-serving-ca-bundle\") pod \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " Oct 30 21:54:27.901188 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.901068 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-config\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-config\") pod \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " Oct 30 21:54:27.901188 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.901089 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-trusted-ca-bundle\") pod \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " Oct 30 21:54:27.901188 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.901126 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-config-out\") pod \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " Oct 30 21:54:27.901188 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.901146 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-tls\") pod \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " Oct 30 21:54:27.901188 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.901172 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-metrics-client-ca\") pod \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " Oct 30 21:54:27.901626 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.901209 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-1\") pod \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " Oct 30 21:54:27.901626 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.901237 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " Oct 30 21:54:27.901626 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.901280 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-web-config\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-web-config\") pod \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " Oct 30 21:54:27.901626 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.901307 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-kube-api-access-6q97n\" (UniqueName: \"kubernetes.io/projected/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-kube-api-access-6q97n\") pod \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " Oct 30 21:54:27.901626 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.901336 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-serving-certs-ca-bundle\") pod \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " Oct 30 21:54:27.901626 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.901363 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-thanos-prometheus-http-client-file\") pod \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " Oct 30 21:54:27.901626 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.901425 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-metrics-client-certs\") pod \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " Oct 30 21:54:27.901626 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.901431 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-2" pod "b9ba3773-93d3-4b6b-b45d-a23ce6483e29" (UID: "b9ba3773-93d3-4b6b-b45d-a23ce6483e29"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:54:27.901626 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.901477 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-0\") pod \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " Oct 30 21:54:27.901626 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.901511 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-grpc-tls\") pod \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " Oct 30 21:54:27.901626 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.901547 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-kube-rbac-proxy\") pod \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\" (UID: \"b9ba3773-93d3-4b6b-b45d-a23ce6483e29\") " Oct 30 21:54:27.901626 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.901576 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-kubelet-serving-ca-bundle" pod "b9ba3773-93d3-4b6b-b45d-a23ce6483e29" (UID: "b9ba3773-93d3-4b6b-b45d-a23ce6483e29"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:54:27.902233 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.902205 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-trusted-ca-bundle" pod "b9ba3773-93d3-4b6b-b45d-a23ce6483e29" (UID: "b9ba3773-93d3-4b6b-b45d-a23ce6483e29"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:54:27.902293 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.902249 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-db" pod "b9ba3773-93d3-4b6b-b45d-a23ce6483e29" (UID: "b9ba3773-93d3-4b6b-b45d-a23ce6483e29"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 21:54:27.902362 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.902344 7307 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:27.902447 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.902371 7307 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:27.902447 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.902404 7307 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-db\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:27.902447 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.902421 7307 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:27.902849 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.902773 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-metrics-client-ca" pod "b9ba3773-93d3-4b6b-b45d-a23ce6483e29" (UID: "b9ba3773-93d3-4b6b-b45d-a23ce6483e29"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:54:27.903922 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.903820 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-tls-assets" pod "b9ba3773-93d3-4b6b-b45d-a23ce6483e29" (UID: "b9ba3773-93d3-4b6b-b45d-a23ce6483e29"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 21:54:27.904028 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.903995 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-config" pod "b9ba3773-93d3-4b6b-b45d-a23ce6483e29" (UID: "b9ba3773-93d3-4b6b-b45d-a23ce6483e29"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:54:27.904095 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.904031 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-config-out" pod "b9ba3773-93d3-4b6b-b45d-a23ce6483e29" (UID: "b9ba3773-93d3-4b6b-b45d-a23ce6483e29"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 21:54:27.904720 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.904402 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-thanos-prometheus-http-client-file" pod "b9ba3773-93d3-4b6b-b45d-a23ce6483e29" (UID: "b9ba3773-93d3-4b6b-b45d-a23ce6483e29"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:54:27.904720 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.904457 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-serving-certs-ca-bundle" pod "b9ba3773-93d3-4b6b-b45d-a23ce6483e29" (UID: "b9ba3773-93d3-4b6b-b45d-a23ce6483e29"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:54:27.904868 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.904806 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-1" pod "b9ba3773-93d3-4b6b-b45d-a23ce6483e29" (UID: "b9ba3773-93d3-4b6b-b45d-a23ce6483e29"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:54:27.904926 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.904891 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-kube-api-access-6q97n" pod "b9ba3773-93d3-4b6b-b45d-a23ce6483e29" (UID: "b9ba3773-93d3-4b6b-b45d-a23ce6483e29"). InnerVolumeSpecName "kube-api-access-6q97n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 21:54:27.905229 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.905164 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-kube-rbac-proxy" pod "b9ba3773-93d3-4b6b-b45d-a23ce6483e29" (UID: "b9ba3773-93d3-4b6b-b45d-a23ce6483e29"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:54:27.905318 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.905302 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-tls" pod "b9ba3773-93d3-4b6b-b45d-a23ce6483e29" (UID: "b9ba3773-93d3-4b6b-b45d-a23ce6483e29"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:54:27.905397 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.905351 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-0" pod "b9ba3773-93d3-4b6b-b45d-a23ce6483e29" (UID: "b9ba3773-93d3-4b6b-b45d-a23ce6483e29"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:54:27.906278 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.906254 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-kube-rbac-proxy-web" pod "b9ba3773-93d3-4b6b-b45d-a23ce6483e29" (UID: "b9ba3773-93d3-4b6b-b45d-a23ce6483e29"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:54:27.906807 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.906784 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-grpc-tls" pod "b9ba3773-93d3-4b6b-b45d-a23ce6483e29" (UID: "b9ba3773-93d3-4b6b-b45d-a23ce6483e29"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:54:27.906895 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.906876 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-metrics-client-certs" pod "b9ba3773-93d3-4b6b-b45d-a23ce6483e29" (UID: "b9ba3773-93d3-4b6b-b45d-a23ce6483e29"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:54:27.907148 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.907128 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-thanos-sidecar-tls" pod "b9ba3773-93d3-4b6b-b45d-a23ce6483e29" (UID: "b9ba3773-93d3-4b6b-b45d-a23ce6483e29"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:54:27.915016 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:27.914995 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-web-config" pod "b9ba3773-93d3-4b6b-b45d-a23ce6483e29" (UID: "b9ba3773-93d3-4b6b-b45d-a23ce6483e29"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:54:28.003651 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.003570 7307 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-config\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:28.003651 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.003601 7307 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-config-out\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:28.003651 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.003613 7307 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:28.003651 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.003624 7307 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-metrics-client-ca\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:28.003651 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.003635 7307 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:28.003651 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.003645 7307 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:28.003651 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.003654 7307 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-web-config\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:28.003956 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.003663 7307 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6q97n\" (UniqueName: \"kubernetes.io/projected/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-kube-api-access-6q97n\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:28.003956 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.003672 7307 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:28.003956 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.003681 7307 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:28.003956 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.003690 7307 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-metrics-client-certs\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:28.003956 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.003698 7307 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:28.003956 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.003707 7307 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-grpc-tls\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:28.003956 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.003715 7307 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-kube-rbac-proxy\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:28.003956 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.003722 7307 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-tls-assets\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:28.003956 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.003731 7307 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9ba3773-93d3-4b6b-b45d-a23ce6483e29-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:28.101040 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.101002 7307 generic.go:356] "Generic (PLEG): container finished" podID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerID="cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056" exitCode=0 Oct 30 21:54:28.101040 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.101029 7307 generic.go:356] "Generic (PLEG): container finished" podID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerID="a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6" exitCode=0 Oct 30 21:54:28.101040 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.101035 7307 generic.go:356] "Generic (PLEG): container finished" podID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerID="012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361" exitCode=0 Oct 30 21:54:28.101040 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.101041 7307 generic.go:356] "Generic (PLEG): container finished" podID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerID="20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee" exitCode=0 Oct 30 21:54:28.101040 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.101046 7307 generic.go:356] "Generic (PLEG): container finished" podID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerID="1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88" exitCode=0 Oct 30 21:54:28.101040 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.101052 7307 generic.go:356] "Generic (PLEG): container finished" podID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerID="c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a" exitCode=0 Oct 30 21:54:28.101707 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.101079 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.101707 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.101090 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9ba3773-93d3-4b6b-b45d-a23ce6483e29","Type":"ContainerDied","Data":"cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056"} Oct 30 21:54:28.101707 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.101164 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9ba3773-93d3-4b6b-b45d-a23ce6483e29","Type":"ContainerDied","Data":"a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6"} Oct 30 21:54:28.101707 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.101192 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9ba3773-93d3-4b6b-b45d-a23ce6483e29","Type":"ContainerDied","Data":"012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361"} Oct 30 21:54:28.101707 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.101222 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9ba3773-93d3-4b6b-b45d-a23ce6483e29","Type":"ContainerDied","Data":"20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee"} Oct 30 21:54:28.101707 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.101233 7307 scope.go:122] "RemoveContainer" containerID="cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056" Oct 30 21:54:28.101707 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.101260 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9ba3773-93d3-4b6b-b45d-a23ce6483e29","Type":"ContainerDied","Data":"1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88"} Oct 30 21:54:28.101707 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.101298 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9ba3773-93d3-4b6b-b45d-a23ce6483e29","Type":"ContainerDied","Data":"c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a"} Oct 30 21:54:28.101707 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.101336 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9ba3773-93d3-4b6b-b45d-a23ce6483e29","Type":"ContainerDied","Data":"b14e234c177b9a6eae445efd4450f7527810442cb73501e6289dc1affd4fbb4c"} Oct 30 21:54:28.109349 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.109294 7307 scope.go:122] "RemoveContainer" containerID="a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6" Oct 30 21:54:28.116297 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.116281 7307 scope.go:122] "RemoveContainer" containerID="012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361" Oct 30 21:54:28.122851 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.122835 7307 scope.go:122] "RemoveContainer" containerID="20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee" Oct 30 21:54:28.126886 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.126868 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 30 21:54:28.130296 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.130276 7307 scope.go:122] "RemoveContainer" containerID="1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88" Oct 30 21:54:28.132314 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.132294 7307 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 30 21:54:28.137402 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.137371 7307 scope.go:122] "RemoveContainer" containerID="c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a" Oct 30 21:54:28.144154 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.144139 7307 scope.go:122] "RemoveContainer" containerID="6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22" Oct 30 21:54:28.152140 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.152123 7307 scope.go:122] "RemoveContainer" containerID="cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056" Oct 30 21:54:28.152623 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:28.152597 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056\": container with ID starting with cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056 not found: ID does not exist" containerID="cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056" Oct 30 21:54:28.152698 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.152632 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056"} err="failed to get container status \"cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056\": rpc error: code = NotFound desc = could not find container \"cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056\": container with ID starting with cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056 not found: ID does not exist" Oct 30 21:54:28.152698 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.152654 7307 scope.go:122] "RemoveContainer" containerID="a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6" Oct 30 21:54:28.152983 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:28.152962 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6\": container with ID starting with a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6 not found: ID does not exist" containerID="a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6" Oct 30 21:54:28.153049 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.152992 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6"} err="failed to get container status \"a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6\": rpc error: code = NotFound desc = could not find container \"a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6\": container with ID starting with a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6 not found: ID does not exist" Oct 30 21:54:28.153049 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.153013 7307 scope.go:122] "RemoveContainer" containerID="012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361" Oct 30 21:54:28.153301 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:28.153284 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361\": container with ID starting with 012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361 not found: ID does not exist" containerID="012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361" Oct 30 21:54:28.153350 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.153316 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361"} err="failed to get container status \"012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361\": rpc error: code = NotFound desc = could not find container \"012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361\": container with ID starting with 012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361 not found: ID does not exist" Oct 30 21:54:28.153350 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.153338 7307 scope.go:122] "RemoveContainer" containerID="20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee" Oct 30 21:54:28.153791 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:28.153772 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee\": container with ID starting with 20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee not found: ID does not exist" containerID="20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee" Oct 30 21:54:28.153838 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.153796 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee"} err="failed to get container status \"20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee\": rpc error: code = NotFound desc = could not find container \"20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee\": container with ID starting with 20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee not found: ID does not exist" Oct 30 21:54:28.153838 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.153808 7307 scope.go:122] "RemoveContainer" containerID="1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88" Oct 30 21:54:28.154057 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:28.154041 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88\": container with ID starting with 1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88 not found: ID does not exist" containerID="1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88" Oct 30 21:54:28.154099 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.154061 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88"} err="failed to get container status \"1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88\": rpc error: code = NotFound desc = could not find container \"1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88\": container with ID starting with 1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88 not found: ID does not exist" Oct 30 21:54:28.154099 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.154081 7307 scope.go:122] "RemoveContainer" containerID="c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a" Oct 30 21:54:28.154324 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:28.154305 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a\": container with ID starting with c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a not found: ID does not exist" containerID="c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a" Oct 30 21:54:28.154364 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.154330 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a"} err="failed to get container status \"c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a\": rpc error: code = NotFound desc = could not find container \"c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a\": container with ID starting with c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a not found: ID does not exist" Oct 30 21:54:28.154364 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.154349 7307 scope.go:122] "RemoveContainer" containerID="6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22" Oct 30 21:54:28.154592 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:28.154576 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22\": container with ID starting with 6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22 not found: ID does not exist" containerID="6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22" Oct 30 21:54:28.154639 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.154596 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22"} err="failed to get container status \"6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22\": rpc error: code = NotFound desc = could not find container \"6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22\": container with ID starting with 6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22 not found: ID does not exist" Oct 30 21:54:28.154639 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.154607 7307 scope.go:122] "RemoveContainer" containerID="cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056" Oct 30 21:54:28.154825 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.154807 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056"} err="failed to get container status \"cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056\": rpc error: code = NotFound desc = could not find container \"cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056\": container with ID starting with cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056 not found: ID does not exist" Oct 30 21:54:28.154825 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.154825 7307 scope.go:122] "RemoveContainer" containerID="a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6" Oct 30 21:54:28.155046 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.155031 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6"} err="failed to get container status \"a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6\": rpc error: code = NotFound desc = could not find container \"a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6\": container with ID starting with a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6 not found: ID does not exist" Oct 30 21:54:28.155046 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.155045 7307 scope.go:122] "RemoveContainer" containerID="012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361" Oct 30 21:54:28.155271 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.155254 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361"} err="failed to get container status \"012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361\": rpc error: code = NotFound desc = could not find container \"012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361\": container with ID starting with 012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361 not found: ID does not exist" Oct 30 21:54:28.155315 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.155270 7307 scope.go:122] "RemoveContainer" containerID="20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee" Oct 30 21:54:28.155606 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.155471 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee"} err="failed to get container status \"20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee\": rpc error: code = NotFound desc = could not find container \"20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee\": container with ID starting with 20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee not found: ID does not exist" Oct 30 21:54:28.155606 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.155484 7307 scope.go:122] "RemoveContainer" containerID="1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88" Oct 30 21:54:28.155750 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.155689 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88"} err="failed to get container status \"1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88\": rpc error: code = NotFound desc = could not find container \"1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88\": container with ID starting with 1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88 not found: ID does not exist" Oct 30 21:54:28.155750 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.155705 7307 scope.go:122] "RemoveContainer" containerID="c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a" Oct 30 21:54:28.156021 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.155916 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a"} err="failed to get container status \"c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a\": rpc error: code = NotFound desc = could not find container \"c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a\": container with ID starting with c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a not found: ID does not exist" Oct 30 21:54:28.156021 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.155928 7307 scope.go:122] "RemoveContainer" containerID="6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22" Oct 30 21:54:28.156208 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.156133 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22"} err="failed to get container status \"6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22\": rpc error: code = NotFound desc = could not find container \"6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22\": container with ID starting with 6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22 not found: ID does not exist" Oct 30 21:54:28.156208 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.156151 7307 scope.go:122] "RemoveContainer" containerID="cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056" Oct 30 21:54:28.156498 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.156374 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056"} err="failed to get container status \"cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056\": rpc error: code = NotFound desc = could not find container \"cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056\": container with ID starting with cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056 not found: ID does not exist" Oct 30 21:54:28.156498 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.156408 7307 scope.go:122] "RemoveContainer" containerID="a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6" Oct 30 21:54:28.156662 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.156610 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6"} err="failed to get container status \"a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6\": rpc error: code = NotFound desc = could not find container \"a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6\": container with ID starting with a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6 not found: ID does not exist" Oct 30 21:54:28.156662 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.156623 7307 scope.go:122] "RemoveContainer" containerID="012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361" Oct 30 21:54:28.156884 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.156810 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361"} err="failed to get container status \"012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361\": rpc error: code = NotFound desc = could not find container \"012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361\": container with ID starting with 012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361 not found: ID does not exist" Oct 30 21:54:28.156884 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.156834 7307 scope.go:122] "RemoveContainer" containerID="20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee" Oct 30 21:54:28.157164 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.157044 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee"} err="failed to get container status \"20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee\": rpc error: code = NotFound desc = could not find container \"20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee\": container with ID starting with 20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee not found: ID does not exist" Oct 30 21:54:28.157164 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.157075 7307 scope.go:122] "RemoveContainer" containerID="1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88" Oct 30 21:54:28.157392 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.157358 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88"} err="failed to get container status \"1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88\": rpc error: code = NotFound desc = could not find container \"1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88\": container with ID starting with 1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88 not found: ID does not exist" Oct 30 21:54:28.157496 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.157413 7307 scope.go:122] "RemoveContainer" containerID="c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a" Oct 30 21:54:28.157720 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.157701 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a"} err="failed to get container status \"c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a\": rpc error: code = NotFound desc = could not find container \"c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a\": container with ID starting with c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a not found: ID does not exist" Oct 30 21:54:28.157720 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.157719 7307 scope.go:122] "RemoveContainer" containerID="6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22" Oct 30 21:54:28.157982 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.157962 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22"} err="failed to get container status \"6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22\": rpc error: code = NotFound desc = could not find container \"6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22\": container with ID starting with 6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22 not found: ID does not exist" Oct 30 21:54:28.158051 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.157990 7307 scope.go:122] "RemoveContainer" containerID="cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056" Oct 30 21:54:28.158273 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.158248 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056"} err="failed to get container status \"cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056\": rpc error: code = NotFound desc = could not find container \"cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056\": container with ID starting with cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056 not found: ID does not exist" Oct 30 21:54:28.158354 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.158275 7307 scope.go:122] "RemoveContainer" containerID="a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6" Oct 30 21:54:28.158592 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.158559 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6"} err="failed to get container status \"a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6\": rpc error: code = NotFound desc = could not find container \"a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6\": container with ID starting with a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6 not found: ID does not exist" Oct 30 21:54:28.158702 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.158592 7307 scope.go:122] "RemoveContainer" containerID="012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361" Oct 30 21:54:28.158933 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.158911 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361"} err="failed to get container status \"012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361\": rpc error: code = NotFound desc = could not find container \"012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361\": container with ID starting with 012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361 not found: ID does not exist" Oct 30 21:54:28.158933 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.158930 7307 scope.go:122] "RemoveContainer" containerID="20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee" Oct 30 21:54:28.159223 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.159187 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee"} err="failed to get container status \"20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee\": rpc error: code = NotFound desc = could not find container \"20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee\": container with ID starting with 20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee not found: ID does not exist" Oct 30 21:54:28.159223 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.159218 7307 scope.go:122] "RemoveContainer" containerID="1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88" Oct 30 21:54:28.159566 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.159541 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88"} err="failed to get container status \"1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88\": rpc error: code = NotFound desc = could not find container \"1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88\": container with ID starting with 1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88 not found: ID does not exist" Oct 30 21:54:28.159656 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.159568 7307 scope.go:122] "RemoveContainer" containerID="c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a" Oct 30 21:54:28.159843 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.159824 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a"} err="failed to get container status \"c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a\": rpc error: code = NotFound desc = could not find container \"c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a\": container with ID starting with c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a not found: ID does not exist" Oct 30 21:54:28.159925 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.159843 7307 scope.go:122] "RemoveContainer" containerID="6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22" Oct 30 21:54:28.160156 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.160138 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22"} err="failed to get container status \"6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22\": rpc error: code = NotFound desc = could not find container \"6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22\": container with ID starting with 6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22 not found: ID does not exist" Oct 30 21:54:28.160218 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.160164 7307 scope.go:122] "RemoveContainer" containerID="cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056" Oct 30 21:54:28.160447 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.160425 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056"} err="failed to get container status \"cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056\": rpc error: code = NotFound desc = could not find container \"cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056\": container with ID starting with cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056 not found: ID does not exist" Oct 30 21:54:28.160549 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.160446 7307 scope.go:122] "RemoveContainer" containerID="a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6" Oct 30 21:54:28.160735 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.160713 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6"} err="failed to get container status \"a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6\": rpc error: code = NotFound desc = could not find container \"a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6\": container with ID starting with a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6 not found: ID does not exist" Oct 30 21:54:28.160818 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.160737 7307 scope.go:122] "RemoveContainer" containerID="012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361" Oct 30 21:54:28.161027 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.161009 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361"} err="failed to get container status \"012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361\": rpc error: code = NotFound desc = could not find container \"012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361\": container with ID starting with 012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361 not found: ID does not exist" Oct 30 21:54:28.161096 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.161028 7307 scope.go:122] "RemoveContainer" containerID="20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee" Oct 30 21:54:28.161245 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.161228 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee"} err="failed to get container status \"20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee\": rpc error: code = NotFound desc = could not find container \"20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee\": container with ID starting with 20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee not found: ID does not exist" Oct 30 21:54:28.161313 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.161247 7307 scope.go:122] "RemoveContainer" containerID="1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88" Oct 30 21:54:28.161527 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.161511 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88"} err="failed to get container status \"1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88\": rpc error: code = NotFound desc = could not find container \"1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88\": container with ID starting with 1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88 not found: ID does not exist" Oct 30 21:54:28.161601 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.161527 7307 scope.go:122] "RemoveContainer" containerID="c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a" Oct 30 21:54:28.161760 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.161743 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a"} err="failed to get container status \"c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a\": rpc error: code = NotFound desc = could not find container \"c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a\": container with ID starting with c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a not found: ID does not exist" Oct 30 21:54:28.161853 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.161762 7307 scope.go:122] "RemoveContainer" containerID="6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22" Oct 30 21:54:28.162045 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.162023 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22"} err="failed to get container status \"6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22\": rpc error: code = NotFound desc = could not find container \"6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22\": container with ID starting with 6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22 not found: ID does not exist" Oct 30 21:54:28.162045 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.162042 7307 scope.go:122] "RemoveContainer" containerID="cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056" Oct 30 21:54:28.162294 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.162275 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056"} err="failed to get container status \"cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056\": rpc error: code = NotFound desc = could not find container \"cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056\": container with ID starting with cc4ab75e076e688f41db061c03fcf1a9688d9f4c21b53a632c025ede6e381056 not found: ID does not exist" Oct 30 21:54:28.162360 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.162294 7307 scope.go:122] "RemoveContainer" containerID="a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6" Oct 30 21:54:28.162588 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.162568 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6"} err="failed to get container status \"a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6\": rpc error: code = NotFound desc = could not find container \"a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6\": container with ID starting with a26c47865d324e79c1654a681747b6710764ad72e5323f9768fa1edaa00d74a6 not found: ID does not exist" Oct 30 21:54:28.162681 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.162598 7307 scope.go:122] "RemoveContainer" containerID="012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361" Oct 30 21:54:28.162835 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.162817 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361"} err="failed to get container status \"012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361\": rpc error: code = NotFound desc = could not find container \"012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361\": container with ID starting with 012672f1344252a700904fbd90805e68f5dff875b80f2a63021c99cab976c361 not found: ID does not exist" Oct 30 21:54:28.162835 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.162835 7307 scope.go:122] "RemoveContainer" containerID="20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee" Oct 30 21:54:28.163071 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.163052 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee"} err="failed to get container status \"20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee\": rpc error: code = NotFound desc = could not find container \"20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee\": container with ID starting with 20332125c59ccf4be765061a825a4108e9fc4c66b8fcdddfecd795b6d91218ee not found: ID does not exist" Oct 30 21:54:28.163071 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.163068 7307 scope.go:122] "RemoveContainer" containerID="1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88" Oct 30 21:54:28.163335 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.163315 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88"} err="failed to get container status \"1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88\": rpc error: code = NotFound desc = could not find container \"1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88\": container with ID starting with 1b8b350fa67cb2b4c38a7fcccc6ec0d426771f353265688c492641035356ab88 not found: ID does not exist" Oct 30 21:54:28.163335 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.163333 7307 scope.go:122] "RemoveContainer" containerID="c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a" Oct 30 21:54:28.163583 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.163566 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a"} err="failed to get container status \"c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a\": rpc error: code = NotFound desc = could not find container \"c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a\": container with ID starting with c21480e0b2a13fdca906820bbda4d2a0a6c1b6e9cba925a87f8ec53da47b154a not found: ID does not exist" Oct 30 21:54:28.163583 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.163582 7307 scope.go:122] "RemoveContainer" containerID="6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22" Oct 30 21:54:28.163798 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.163776 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22"} err="failed to get container status \"6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22\": rpc error: code = NotFound desc = could not find container \"6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22\": container with ID starting with 6aeb25ed797332b31f85c651d9f5930696f50f2cfb275cff41c489b1183c6f22 not found: ID does not exist" Oct 30 21:54:28.179624 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.179594 7307 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 30 21:54:28.180308 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.180290 7307 cpu_manager.go:414] "containerMap: removing container" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="config-reloader" Oct 30 21:54:28.180428 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.180312 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="config-reloader" Oct 30 21:54:28.180428 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.180342 7307 cpu_manager.go:414] "containerMap: removing container" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="kube-rbac-proxy" Oct 30 21:54:28.180428 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.180349 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="kube-rbac-proxy" Oct 30 21:54:28.180428 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.180425 7307 cpu_manager.go:414] "containerMap: removing container" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="kube-rbac-proxy-thanos" Oct 30 21:54:28.180649 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.180435 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="kube-rbac-proxy-thanos" Oct 30 21:54:28.180649 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.180450 7307 cpu_manager.go:414] "containerMap: removing container" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="init-config-reloader" Oct 30 21:54:28.180649 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.180457 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="init-config-reloader" Oct 30 21:54:28.180649 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.180475 7307 cpu_manager.go:414] "containerMap: removing container" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="kube-rbac-proxy-web" Oct 30 21:54:28.180649 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.180482 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="kube-rbac-proxy-web" Oct 30 21:54:28.180649 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.180498 7307 cpu_manager.go:414] "containerMap: removing container" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="thanos-sidecar" Oct 30 21:54:28.180649 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.180505 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="thanos-sidecar" Oct 30 21:54:28.180649 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.180525 7307 cpu_manager.go:414] "containerMap: removing container" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="prometheus" Oct 30 21:54:28.180649 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.180532 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="prometheus" Oct 30 21:54:28.183674 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.183651 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="kube-rbac-proxy-thanos" Oct 30 21:54:28.183762 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.183677 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="init-config-reloader" Oct 30 21:54:28.183762 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.183687 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="kube-rbac-proxy-web" Oct 30 21:54:28.183762 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.183696 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="thanos-sidecar" Oct 30 21:54:28.183762 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.183704 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="prometheus" Oct 30 21:54:28.183762 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.183712 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="config-reloader" Oct 30 21:54:28.183762 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.183724 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" containerName="kube-rbac-proxy" Oct 30 21:54:28.189280 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.189259 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.203855 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.203832 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Oct 30 21:54:28.204637 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.204619 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5mpvw\"" Oct 30 21:54:28.204691 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.204635 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Oct 30 21:54:28.204691 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.204669 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Oct 30 21:54:28.204691 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.204673 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Oct 30 21:54:28.204822 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.204664 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Oct 30 21:54:28.204822 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.204726 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Oct 30 21:54:28.204822 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.204731 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Oct 30 21:54:28.204822 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.204802 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Oct 30 21:54:28.205018 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.204971 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Oct 30 21:54:28.205018 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.205002 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Oct 30 21:54:28.205114 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.205084 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Oct 30 21:54:28.205400 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.205366 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-49cblkfdffbbv\"" Oct 30 21:54:28.210544 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.210521 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Oct 30 21:54:28.210900 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.210730 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Oct 30 21:54:28.211636 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.211612 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 30 21:54:28.212495 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.212477 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Oct 30 21:54:28.306199 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.306109 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.306199 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.306162 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/84e8a57d-af63-4447-b0d1-d9adbfb57740-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.306362 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.306255 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.306362 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.306284 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84e8a57d-af63-4447-b0d1-d9adbfb57740-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.306362 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.306303 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.306362 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.306328 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e8a57d-af63-4447-b0d1-d9adbfb57740-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.306514 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.306374 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtfpx\" (UniqueName: \"kubernetes.io/projected/84e8a57d-af63-4447-b0d1-d9adbfb57740-kube-api-access-qtfpx\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.306514 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.306464 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e8a57d-af63-4447-b0d1-d9adbfb57740-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.306514 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.306490 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-config\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.306615 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.306514 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84e8a57d-af63-4447-b0d1-d9adbfb57740-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.306615 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.306532 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.306615 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.306564 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.306704 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.306615 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e8a57d-af63-4447-b0d1-d9adbfb57740-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.306704 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.306659 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-web-config\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.306765 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.306702 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.306765 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.306717 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.306765 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.306735 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/84e8a57d-af63-4447-b0d1-d9adbfb57740-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.306765 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.306757 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/84e8a57d-af63-4447-b0d1-d9adbfb57740-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.306916 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.306794 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84e8a57d-af63-4447-b0d1-d9adbfb57740-config-out\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.306916 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.306863 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/84e8a57d-af63-4447-b0d1-d9adbfb57740-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.407755 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.407717 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.407755 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.407758 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.407913 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.407779 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e8a57d-af63-4447-b0d1-d9adbfb57740-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.407913 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.407804 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-web-config\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.407913 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.407842 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.407913 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.407865 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.407913 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.407890 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/84e8a57d-af63-4447-b0d1-d9adbfb57740-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.408135 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.407916 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/84e8a57d-af63-4447-b0d1-d9adbfb57740-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.408698 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.408667 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/84e8a57d-af63-4447-b0d1-d9adbfb57740-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.408818 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.408760 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84e8a57d-af63-4447-b0d1-d9adbfb57740-config-out\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.408818 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.408795 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/84e8a57d-af63-4447-b0d1-d9adbfb57740-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.408933 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.408837 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.408933 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.408891 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/84e8a57d-af63-4447-b0d1-d9adbfb57740-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.408933 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.408927 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.409094 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.408957 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84e8a57d-af63-4447-b0d1-d9adbfb57740-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.409094 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.408982 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.409094 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.409025 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e8a57d-af63-4447-b0d1-d9adbfb57740-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.409094 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.409049 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtfpx\" (UniqueName: \"kubernetes.io/projected/84e8a57d-af63-4447-b0d1-d9adbfb57740-kube-api-access-qtfpx\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.409094 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.409089 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e8a57d-af63-4447-b0d1-d9adbfb57740-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.409342 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.409127 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-config\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.409342 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.409166 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84e8a57d-af63-4447-b0d1-d9adbfb57740-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.409885 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.409855 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84e8a57d-af63-4447-b0d1-d9adbfb57740-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.410977 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.410950 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.411071 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.411036 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-web-config\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.411229 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.411207 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.411347 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.411327 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.411647 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.411626 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e8a57d-af63-4447-b0d1-d9adbfb57740-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.412001 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.411744 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84e8a57d-af63-4447-b0d1-d9adbfb57740-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.412001 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.411822 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.412001 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.409125 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e8a57d-af63-4447-b0d1-d9adbfb57740-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.412001 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.411880 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e8a57d-af63-4447-b0d1-d9adbfb57740-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.412720 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.412046 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/84e8a57d-af63-4447-b0d1-d9adbfb57740-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.412720 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.412698 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.413095 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.413070 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/84e8a57d-af63-4447-b0d1-d9adbfb57740-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.413546 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.413518 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/84e8a57d-af63-4447-b0d1-d9adbfb57740-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.413724 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.413707 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.413973 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.413954 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-config\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.414131 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.414113 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84e8a57d-af63-4447-b0d1-d9adbfb57740-config-out\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.414295 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.414279 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84e8a57d-af63-4447-b0d1-d9adbfb57740-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.426637 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.426609 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtfpx\" (UniqueName: \"kubernetes.io/projected/84e8a57d-af63-4447-b0d1-d9adbfb57740-kube-api-access-qtfpx\") pod \"prometheus-k8s-0\" (UID: \"84e8a57d-af63-4447-b0d1-d9adbfb57740\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.515734 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.515690 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:28.805581 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.805544 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 30 21:54:28.809207 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:28.809180 7307 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84e8a57d_af63_4447_b0d1_d9adbfb57740.slice/crio-56395cf975c3da3b9b80b47e3d74bb4301849527cb365f55872a73ab91099180 WatchSource:0}: Error finding container 56395cf975c3da3b9b80b47e3d74bb4301849527cb365f55872a73ab91099180: Status 404 returned error can't find the container with id 56395cf975c3da3b9b80b47e3d74bb4301849527cb365f55872a73ab91099180 Oct 30 21:54:28.929241 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:28.929206 7307 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b9ba3773-93d3-4b6b-b45d-a23ce6483e29" path="/var/lib/kubelet/pods/b9ba3773-93d3-4b6b-b45d-a23ce6483e29/volumes" Oct 30 21:54:29.110235 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:29.110152 7307 generic.go:356] "Generic (PLEG): container finished" podID="84e8a57d-af63-4447-b0d1-d9adbfb57740" containerID="037ccb310f25e6160f4e3505ca45da005805733961d70fbd5b5f375f215c05fe" exitCode=0 Oct 30 21:54:29.110698 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:29.110241 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84e8a57d-af63-4447-b0d1-d9adbfb57740","Type":"ContainerDied","Data":"037ccb310f25e6160f4e3505ca45da005805733961d70fbd5b5f375f215c05fe"} Oct 30 21:54:29.110698 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:29.110340 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84e8a57d-af63-4447-b0d1-d9adbfb57740","Type":"ContainerStarted","Data":"56395cf975c3da3b9b80b47e3d74bb4301849527cb365f55872a73ab91099180"} Oct 30 21:54:30.118146 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:30.118114 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84e8a57d-af63-4447-b0d1-d9adbfb57740","Type":"ContainerStarted","Data":"104f6bce74ed367cc9e950bed1d29effecd136e2498129ac664edf84a8b52c10"} Oct 30 21:54:30.118534 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:30.118178 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84e8a57d-af63-4447-b0d1-d9adbfb57740","Type":"ContainerStarted","Data":"4c9e3ef675aae41e0c19165249478e0e7c1dba3ff90619056352b6edcd315bb9"} Oct 30 21:54:30.118534 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:30.118207 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84e8a57d-af63-4447-b0d1-d9adbfb57740","Type":"ContainerStarted","Data":"e41fbe5e828258d98365bdd063a7ef9b819b27e286acc69cd5b7ad30447cc369"} Oct 30 21:54:30.118534 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:30.118231 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84e8a57d-af63-4447-b0d1-d9adbfb57740","Type":"ContainerStarted","Data":"9250c7f4a6e827ec11fe01375a4602b0326400a64d313c86a5d08a353b76c737"} Oct 30 21:54:30.118534 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:30.118255 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84e8a57d-af63-4447-b0d1-d9adbfb57740","Type":"ContainerStarted","Data":"8ce2cd154fbefdd8973ac58a9ba3088b15108fc5966ac918ac439a0e68894b93"} Oct 30 21:54:30.118534 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:30.118279 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84e8a57d-af63-4447-b0d1-d9adbfb57740","Type":"ContainerStarted","Data":"798f4f55971696c2f867be39226e9242cf8dad2538a333d034abbf46f3ea9206"} Oct 30 21:54:30.190338 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:30.190278 7307 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.174880269 podStartE2EDuration="2.190261938s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.381669ms" isStatefulPod=false podCreationTimestamp="2026-10-30 21:54:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:30.18854916 +0000 UTC m=+23.389921381" watchObservedRunningTime="2026-10-30 21:54:30.190261938 +0000 UTC m=+23.391634138" Oct 30 21:54:30.959045 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:30.959013 7307 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6569c68d8-twvr2"] Oct 30 21:54:30.962633 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:30.962609 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:30.973333 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:30.973308 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6569c68d8-twvr2"] Oct 30 21:54:31.026546 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.026514 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92278e7d-d21b-4d81-b97c-3f34f1f517a9-tmp\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.026546 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.026549 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92278e7d-d21b-4d81-b97c-3f34f1f517a9-console-oauth-config\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.026755 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.026612 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92278e7d-d21b-4d81-b97c-3f34f1f517a9-console-serving-cert\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.026755 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.026644 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-oauth-serving-cert\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.026755 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.026691 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw6c4\" (UniqueName: \"kubernetes.io/projected/92278e7d-d21b-4d81-b97c-3f34f1f517a9-kube-api-access-zw6c4\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.026755 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.026712 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-trusted-ca-bundle\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.026755 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.026740 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-service-ca\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.026968 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.026815 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-console-config\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.127857 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.127825 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92278e7d-d21b-4d81-b97c-3f34f1f517a9-tmp\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.128329 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.128153 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92278e7d-d21b-4d81-b97c-3f34f1f517a9-console-oauth-config\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.128411 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.128319 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92278e7d-d21b-4d81-b97c-3f34f1f517a9-console-serving-cert\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.128411 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.128370 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-oauth-serving-cert\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.128527 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.128327 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92278e7d-d21b-4d81-b97c-3f34f1f517a9-tmp\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.128527 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.128488 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw6c4\" (UniqueName: \"kubernetes.io/projected/92278e7d-d21b-4d81-b97c-3f34f1f517a9-kube-api-access-zw6c4\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.128633 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.128604 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-trusted-ca-bundle\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.129247 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.129000 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-service-ca\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.129247 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.129094 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-oauth-serving-cert\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.130396 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.129804 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-console-config\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.130396 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.130039 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-trusted-ca-bundle\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.133405 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.130726 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-service-ca\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.133405 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.130972 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-console-config\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.135514 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.135492 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92278e7d-d21b-4d81-b97c-3f34f1f517a9-console-oauth-config\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.135595 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.135529 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92278e7d-d21b-4d81-b97c-3f34f1f517a9-console-serving-cert\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.140895 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.140875 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw6c4\" (UniqueName: \"kubernetes.io/projected/92278e7d-d21b-4d81-b97c-3f34f1f517a9-kube-api-access-zw6c4\") pod \"console-6569c68d8-twvr2\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.274252 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.274170 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:31.548135 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:31.548059 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6569c68d8-twvr2"] Oct 30 21:54:31.551577 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:54:31.551539 7307 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92278e7d_d21b_4d81_b97c_3f34f1f517a9.slice/crio-d50af37b3e41ca73bc03bafe71021d3cf73aebf49dc5ae4ec458784769c8a203 WatchSource:0}: Error finding container d50af37b3e41ca73bc03bafe71021d3cf73aebf49dc5ae4ec458784769c8a203: Status 404 returned error can't find the container with id d50af37b3e41ca73bc03bafe71021d3cf73aebf49dc5ae4ec458784769c8a203 Oct 30 21:54:32.128006 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:32.127966 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6569c68d8-twvr2" event={"ID":"92278e7d-d21b-4d81-b97c-3f34f1f517a9","Type":"ContainerStarted","Data":"1794eca7e0dc75ec63635cf8a7252915b54ee6da07fd5ff3714cf9ac5f7f41cb"} Oct 30 21:54:32.128426 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:32.128020 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6569c68d8-twvr2" event={"ID":"92278e7d-d21b-4d81-b97c-3f34f1f517a9","Type":"ContainerStarted","Data":"d50af37b3e41ca73bc03bafe71021d3cf73aebf49dc5ae4ec458784769c8a203"} Oct 30 21:54:32.150990 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:32.150936 7307 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-6569c68d8-twvr2" podStartSLOduration=2.1509215680000002 podStartE2EDuration="2.150921568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:54:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:32.150693175 +0000 UTC m=+25.352065386" watchObservedRunningTime="2026-10-30 21:54:32.150921568 +0000 UTC m=+25.352293816" Oct 30 21:54:32.910922 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:32.910876 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-97866b9c9-24hdt" podUID="96b85972-43b4-4ebf-9d98-73905b20aba8" containerName="console" containerID="cri-o://556132bf3e93067bbb1b7db654d63179b8125396b3d4730d659fd38578e75000" gracePeriod=15 Oct 30 21:54:33.134533 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.134497 7307 generic.go:356] "Generic (PLEG): container finished" podID="96b85972-43b4-4ebf-9d98-73905b20aba8" containerID="556132bf3e93067bbb1b7db654d63179b8125396b3d4730d659fd38578e75000" exitCode=0 Oct 30 21:54:33.134987 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.134571 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97866b9c9-24hdt" event={"ID":"96b85972-43b4-4ebf-9d98-73905b20aba8","Type":"ContainerDied","Data":"556132bf3e93067bbb1b7db654d63179b8125396b3d4730d659fd38578e75000"} Oct 30 21:54:33.168871 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.168798 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:54:33.250718 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.250675 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96b85972-43b4-4ebf-9d98-73905b20aba8-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96b85972-43b4-4ebf-9d98-73905b20aba8-console-serving-cert\") pod \"96b85972-43b4-4ebf-9d98-73905b20aba8\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " Oct 30 21:54:33.250894 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.250742 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96b85972-43b4-4ebf-9d98-73905b20aba8-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96b85972-43b4-4ebf-9d98-73905b20aba8-console-oauth-config\") pod \"96b85972-43b4-4ebf-9d98-73905b20aba8\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " Oct 30 21:54:33.250894 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.250840 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-oauth-serving-cert\") pod \"96b85972-43b4-4ebf-9d98-73905b20aba8\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " Oct 30 21:54:33.250894 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.250889 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/96b85972-43b4-4ebf-9d98-73905b20aba8-kube-api-access-npnjz\" (UniqueName: \"kubernetes.io/projected/96b85972-43b4-4ebf-9d98-73905b20aba8-kube-api-access-npnjz\") pod \"96b85972-43b4-4ebf-9d98-73905b20aba8\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " Oct 30 21:54:33.251069 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.250940 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-service-ca\" (UniqueName: \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-service-ca\") pod \"96b85972-43b4-4ebf-9d98-73905b20aba8\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " Oct 30 21:54:33.251069 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.250972 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-console-config\" (UniqueName: \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-console-config\") pod \"96b85972-43b4-4ebf-9d98-73905b20aba8\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " Oct 30 21:54:33.251069 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.250994 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96b85972-43b4-4ebf-9d98-73905b20aba8-tmp\" (UniqueName: \"kubernetes.io/empty-dir/96b85972-43b4-4ebf-9d98-73905b20aba8-tmp\") pod \"96b85972-43b4-4ebf-9d98-73905b20aba8\" (UID: \"96b85972-43b4-4ebf-9d98-73905b20aba8\") " Oct 30 21:54:33.251318 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.251290 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96b85972-43b4-4ebf-9d98-73905b20aba8-tmp" pod "96b85972-43b4-4ebf-9d98-73905b20aba8" (UID: "96b85972-43b4-4ebf-9d98-73905b20aba8"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 21:54:33.251429 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.251316 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-oauth-serving-cert" pod "96b85972-43b4-4ebf-9d98-73905b20aba8" (UID: "96b85972-43b4-4ebf-9d98-73905b20aba8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:54:33.251429 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.251327 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-console-config" pod "96b85972-43b4-4ebf-9d98-73905b20aba8" (UID: "96b85972-43b4-4ebf-9d98-73905b20aba8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:54:33.251429 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.251321 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-service-ca" pod "96b85972-43b4-4ebf-9d98-73905b20aba8" (UID: "96b85972-43b4-4ebf-9d98-73905b20aba8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:54:33.253438 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.253359 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96b85972-43b4-4ebf-9d98-73905b20aba8-console-oauth-config" pod "96b85972-43b4-4ebf-9d98-73905b20aba8" (UID: "96b85972-43b4-4ebf-9d98-73905b20aba8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:54:33.253537 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.253518 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96b85972-43b4-4ebf-9d98-73905b20aba8-console-serving-cert" pod "96b85972-43b4-4ebf-9d98-73905b20aba8" (UID: "96b85972-43b4-4ebf-9d98-73905b20aba8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:54:33.253584 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.253557 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96b85972-43b4-4ebf-9d98-73905b20aba8-kube-api-access-npnjz" pod "96b85972-43b4-4ebf-9d98-73905b20aba8" (UID: "96b85972-43b4-4ebf-9d98-73905b20aba8"). InnerVolumeSpecName "kube-api-access-npnjz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 21:54:33.352205 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.352162 7307 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-oauth-serving-cert\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:33.352205 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.352198 7307 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npnjz\" (UniqueName: \"kubernetes.io/projected/96b85972-43b4-4ebf-9d98-73905b20aba8-kube-api-access-npnjz\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:33.352205 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.352210 7307 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-service-ca\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:33.352473 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.352220 7307 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96b85972-43b4-4ebf-9d98-73905b20aba8-console-config\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:33.352473 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.352229 7307 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96b85972-43b4-4ebf-9d98-73905b20aba8-tmp\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:33.352473 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.352238 7307 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96b85972-43b4-4ebf-9d98-73905b20aba8-console-serving-cert\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:33.352473 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.352247 7307 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96b85972-43b4-4ebf-9d98-73905b20aba8-console-oauth-config\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:54:33.516634 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:33.516537 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:54:34.140612 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:34.140583 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97866b9c9-24hdt" Oct 30 21:54:34.141022 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:34.140582 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97866b9c9-24hdt" event={"ID":"96b85972-43b4-4ebf-9d98-73905b20aba8","Type":"ContainerDied","Data":"67fd2197a77748088e6777d53039591a9625b4d237e2ba8859488fa008cccf6f"} Oct 30 21:54:34.141022 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:34.140713 7307 scope.go:122] "RemoveContainer" containerID="556132bf3e93067bbb1b7db654d63179b8125396b3d4730d659fd38578e75000" Oct 30 21:54:34.164871 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:34.164842 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-97866b9c9-24hdt"] Oct 30 21:54:34.168643 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:34.168618 7307 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-97866b9c9-24hdt"] Oct 30 21:54:34.928912 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:34.928869 7307 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="96b85972-43b4-4ebf-9d98-73905b20aba8" path="/var/lib/kubelet/pods/96b85972-43b4-4ebf-9d98-73905b20aba8/volumes" Oct 30 21:54:35.539700 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:35.539664 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dzt7m" Oct 30 21:54:41.274811 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:41.274772 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:41.275299 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:41.274832 7307 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:41.279497 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:41.279475 7307 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:42.175121 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:42.175085 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:54:42.227336 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:54:42.227303 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cccc5c698-lcpx2"] Oct 30 21:54:44.274529 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:54:44.274488 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 21:55:07.249937 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.249831 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-cccc5c698-lcpx2" podUID="28b52705-cfb1-42c3-8942-e4ec290bf01a" containerName="console" containerID="cri-o://dbba2f86a8b73a9b49e0807aa9b3009a9bcb6618b044eba0f5dc7c19c8807123" gracePeriod=15 Oct 30 21:55:07.510424 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.510362 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:55:07.666371 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.666338 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-config\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-config\") pod \"28b52705-cfb1-42c3-8942-e4ec290bf01a\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " Oct 30 21:55:07.666371 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.666394 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-serving-cert\") pod \"28b52705-cfb1-42c3-8942-e4ec290bf01a\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " Oct 30 21:55:07.666614 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.666428 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-trusted-ca-bundle\") pod \"28b52705-cfb1-42c3-8942-e4ec290bf01a\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " Oct 30 21:55:07.666614 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.666454 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-service-ca\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-service-ca\") pod \"28b52705-cfb1-42c3-8942-e4ec290bf01a\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " Oct 30 21:55:07.666614 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.666525 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-oauth-serving-cert\") pod \"28b52705-cfb1-42c3-8942-e4ec290bf01a\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " Oct 30 21:55:07.666614 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.666560 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-oauth-config\") pod \"28b52705-cfb1-42c3-8942-e4ec290bf01a\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " Oct 30 21:55:07.666813 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.666649 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/28b52705-cfb1-42c3-8942-e4ec290bf01a-tmp\" (UniqueName: \"kubernetes.io/empty-dir/28b52705-cfb1-42c3-8942-e4ec290bf01a-tmp\") pod \"28b52705-cfb1-42c3-8942-e4ec290bf01a\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " Oct 30 21:55:07.666813 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.666705 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/28b52705-cfb1-42c3-8942-e4ec290bf01a-kube-api-access-kjd2f\" (UniqueName: \"kubernetes.io/projected/28b52705-cfb1-42c3-8942-e4ec290bf01a-kube-api-access-kjd2f\") pod \"28b52705-cfb1-42c3-8942-e4ec290bf01a\" (UID: \"28b52705-cfb1-42c3-8942-e4ec290bf01a\") " Oct 30 21:55:07.666949 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.666920 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-config" pod "28b52705-cfb1-42c3-8942-e4ec290bf01a" (UID: "28b52705-cfb1-42c3-8942-e4ec290bf01a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:55:07.667030 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.666950 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-trusted-ca-bundle" pod "28b52705-cfb1-42c3-8942-e4ec290bf01a" (UID: "28b52705-cfb1-42c3-8942-e4ec290bf01a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:55:07.667030 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.666974 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-service-ca" pod "28b52705-cfb1-42c3-8942-e4ec290bf01a" (UID: "28b52705-cfb1-42c3-8942-e4ec290bf01a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:55:07.667030 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.666979 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28b52705-cfb1-42c3-8942-e4ec290bf01a-tmp" pod "28b52705-cfb1-42c3-8942-e4ec290bf01a" (UID: "28b52705-cfb1-42c3-8942-e4ec290bf01a"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 21:55:07.667030 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.667013 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-oauth-serving-cert" pod "28b52705-cfb1-42c3-8942-e4ec290bf01a" (UID: "28b52705-cfb1-42c3-8942-e4ec290bf01a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:55:07.667240 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.667083 7307 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-trusted-ca-bundle\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:55:07.667240 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.667103 7307 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-service-ca\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:55:07.667240 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.667116 7307 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28b52705-cfb1-42c3-8942-e4ec290bf01a-tmp\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:55:07.667240 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.667130 7307 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-config\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:55:07.668927 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.668896 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-serving-cert" pod "28b52705-cfb1-42c3-8942-e4ec290bf01a" (UID: "28b52705-cfb1-42c3-8942-e4ec290bf01a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:55:07.669017 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.668965 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-oauth-config" pod "28b52705-cfb1-42c3-8942-e4ec290bf01a" (UID: "28b52705-cfb1-42c3-8942-e4ec290bf01a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:55:07.669017 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.668971 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28b52705-cfb1-42c3-8942-e4ec290bf01a-kube-api-access-kjd2f" pod "28b52705-cfb1-42c3-8942-e4ec290bf01a" (UID: "28b52705-cfb1-42c3-8942-e4ec290bf01a"). InnerVolumeSpecName "kube-api-access-kjd2f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 21:55:07.768413 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.768294 7307 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjd2f\" (UniqueName: \"kubernetes.io/projected/28b52705-cfb1-42c3-8942-e4ec290bf01a-kube-api-access-kjd2f\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:55:07.768413 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.768326 7307 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-serving-cert\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:55:07.768413 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.768336 7307 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28b52705-cfb1-42c3-8942-e4ec290bf01a-oauth-serving-cert\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:55:07.768413 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:07.768345 7307 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28b52705-cfb1-42c3-8942-e4ec290bf01a-console-oauth-config\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:55:08.270042 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:08.269995 7307 generic.go:356] "Generic (PLEG): container finished" podID="28b52705-cfb1-42c3-8942-e4ec290bf01a" containerID="dbba2f86a8b73a9b49e0807aa9b3009a9bcb6618b044eba0f5dc7c19c8807123" exitCode=0 Oct 30 21:55:08.270042 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:08.270045 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cccc5c698-lcpx2" Oct 30 21:55:08.270560 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:08.270086 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cccc5c698-lcpx2" event={"ID":"28b52705-cfb1-42c3-8942-e4ec290bf01a","Type":"ContainerDied","Data":"dbba2f86a8b73a9b49e0807aa9b3009a9bcb6618b044eba0f5dc7c19c8807123"} Oct 30 21:55:08.270560 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:08.270142 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cccc5c698-lcpx2" event={"ID":"28b52705-cfb1-42c3-8942-e4ec290bf01a","Type":"ContainerDied","Data":"f6de22422c8b2cd9d1a8170c0f5dec8b03935e904af1bc21fb0374ab8023a7cf"} Oct 30 21:55:08.270560 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:08.270165 7307 scope.go:122] "RemoveContainer" containerID="dbba2f86a8b73a9b49e0807aa9b3009a9bcb6618b044eba0f5dc7c19c8807123" Oct 30 21:55:08.279467 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:08.279446 7307 scope.go:122] "RemoveContainer" containerID="dbba2f86a8b73a9b49e0807aa9b3009a9bcb6618b044eba0f5dc7c19c8807123" Oct 30 21:55:08.279773 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:55:08.279752 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbba2f86a8b73a9b49e0807aa9b3009a9bcb6618b044eba0f5dc7c19c8807123\": container with ID starting with dbba2f86a8b73a9b49e0807aa9b3009a9bcb6618b044eba0f5dc7c19c8807123 not found: ID does not exist" containerID="dbba2f86a8b73a9b49e0807aa9b3009a9bcb6618b044eba0f5dc7c19c8807123" Oct 30 21:55:08.279816 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:08.279784 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbba2f86a8b73a9b49e0807aa9b3009a9bcb6618b044eba0f5dc7c19c8807123"} err="failed to get container status \"dbba2f86a8b73a9b49e0807aa9b3009a9bcb6618b044eba0f5dc7c19c8807123\": rpc error: code = NotFound desc = could not find container \"dbba2f86a8b73a9b49e0807aa9b3009a9bcb6618b044eba0f5dc7c19c8807123\": container with ID starting with dbba2f86a8b73a9b49e0807aa9b3009a9bcb6618b044eba0f5dc7c19c8807123 not found: ID does not exist" Oct 30 21:55:08.293790 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:08.293754 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cccc5c698-lcpx2"] Oct 30 21:55:08.300293 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:08.300265 7307 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cccc5c698-lcpx2"] Oct 30 21:55:08.928944 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:08.928905 7307 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="28b52705-cfb1-42c3-8942-e4ec290bf01a" path="/var/lib/kubelet/pods/28b52705-cfb1-42c3-8942-e4ec290bf01a/volumes" Oct 30 21:55:12.507092 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:12.507054 7307 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:55:12.522634 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:12.522611 7307 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:55:13.304344 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:13.304316 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Oct 30 21:55:14.275306 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:55:14.275268 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 21:55:18.567802 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.567767 7307 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-876cf7bcd-ph5v5"] Oct 30 21:55:18.568192 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.568177 7307 cpu_manager.go:414] "containerMap: removing container" podUID="96b85972-43b4-4ebf-9d98-73905b20aba8" containerName="console" Oct 30 21:55:18.568239 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.568194 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96b85972-43b4-4ebf-9d98-73905b20aba8" containerName="console" Oct 30 21:55:18.568239 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.568217 7307 cpu_manager.go:414] "containerMap: removing container" podUID="28b52705-cfb1-42c3-8942-e4ec290bf01a" containerName="console" Oct 30 21:55:18.568239 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.568225 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="28b52705-cfb1-42c3-8942-e4ec290bf01a" containerName="console" Oct 30 21:55:18.568330 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.568299 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="96b85972-43b4-4ebf-9d98-73905b20aba8" containerName="console" Oct 30 21:55:18.568330 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.568313 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="28b52705-cfb1-42c3-8942-e4ec290bf01a" containerName="console" Oct 30 21:55:18.571241 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.571224 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.584644 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.584620 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-876cf7bcd-ph5v5"] Oct 30 21:55:18.642959 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.642920 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-console-serving-cert\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.642959 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.642957 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-console-config\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.643221 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.642987 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-tmp\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.643221 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.643127 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-trusted-ca-bundle\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.643221 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.643196 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxhfn\" (UniqueName: \"kubernetes.io/projected/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-kube-api-access-pxhfn\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.643355 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.643304 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-service-ca\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.643355 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.643337 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-console-oauth-config\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.643474 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.643357 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-oauth-serving-cert\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.744345 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.744302 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-console-oauth-config\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.744345 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.744349 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-oauth-serving-cert\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.744612 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.744418 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-console-serving-cert\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.744612 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.744443 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-console-config\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.744612 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.744482 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-tmp\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.744612 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.744511 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-trusted-ca-bundle\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.744612 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.744537 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxhfn\" (UniqueName: \"kubernetes.io/projected/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-kube-api-access-pxhfn\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.744612 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.744612 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-service-ca\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.745268 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.745238 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-console-config\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.745366 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.745339 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-tmp\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.745626 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.745608 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-oauth-serving-cert\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.745719 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.745699 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-service-ca\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.745932 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.745908 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-trusted-ca-bundle\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.746890 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.746873 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-console-serving-cert\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.747023 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.746975 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-console-oauth-config\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.758322 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.758292 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxhfn\" (UniqueName: \"kubernetes.io/projected/5b1c2ffc-60a1-452d-9dd7-2f28caed8189-kube-api-access-pxhfn\") pod \"console-876cf7bcd-ph5v5\" (UID: \"5b1c2ffc-60a1-452d-9dd7-2f28caed8189\") " pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:18.882971 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:18.882936 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:19.159248 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:19.159156 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-876cf7bcd-ph5v5"] Oct 30 21:55:19.162806 ip-10-0-137-4 kubenswrapper[7307]: W1030 21:55:19.162778 7307 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b1c2ffc_60a1_452d_9dd7_2f28caed8189.slice/crio-5407bd8b50b532acdc1174e4d29675360317d4f46c7c93610c0c5e3bd05e0c24 WatchSource:0}: Error finding container 5407bd8b50b532acdc1174e4d29675360317d4f46c7c93610c0c5e3bd05e0c24: Status 404 returned error can't find the container with id 5407bd8b50b532acdc1174e4d29675360317d4f46c7c93610c0c5e3bd05e0c24 Oct 30 21:55:19.310659 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:19.310626 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-876cf7bcd-ph5v5" event={"ID":"5b1c2ffc-60a1-452d-9dd7-2f28caed8189","Type":"ContainerStarted","Data":"d25491332542da4ede0f9f7db868f2f74f916825620c6d06765cd6480b785be6"} Oct 30 21:55:19.310832 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:19.310673 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-876cf7bcd-ph5v5" event={"ID":"5b1c2ffc-60a1-452d-9dd7-2f28caed8189","Type":"ContainerStarted","Data":"5407bd8b50b532acdc1174e4d29675360317d4f46c7c93610c0c5e3bd05e0c24"} Oct 30 21:55:19.333681 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:19.333634 7307 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-876cf7bcd-ph5v5" podStartSLOduration=1.3336198000000001 podStartE2EDuration="1.3336198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:55:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:55:19.333588474 +0000 UTC m=+72.534960675" watchObservedRunningTime="2026-10-30 21:55:19.3336198 +0000 UTC m=+72.534991998" Oct 30 21:55:28.883062 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:28.883024 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:28.883609 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:28.883098 7307 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:28.888096 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:28.888073 7307 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:29.351743 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:29.351664 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-876cf7bcd-ph5v5" Oct 30 21:55:29.403117 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:29.403082 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6569c68d8-twvr2"] Oct 30 21:55:44.274576 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:55:44.274536 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 21:55:54.424726 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.424620 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-6569c68d8-twvr2" podUID="92278e7d-d21b-4d81-b97c-3f34f1f517a9" containerName="console" containerID="cri-o://1794eca7e0dc75ec63635cf8a7252915b54ee6da07fd5ff3714cf9ac5f7f41cb" gracePeriod=15 Oct 30 21:55:54.668577 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.668550 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:55:54.671565 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.671543 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-trusted-ca-bundle\") pod \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " Oct 30 21:55:54.671684 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.671667 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92278e7d-d21b-4d81-b97c-3f34f1f517a9-tmp\" (UniqueName: \"kubernetes.io/empty-dir/92278e7d-d21b-4d81-b97c-3f34f1f517a9-tmp\") pod \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " Oct 30 21:55:54.671748 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.671706 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92278e7d-d21b-4d81-b97c-3f34f1f517a9-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92278e7d-d21b-4d81-b97c-3f34f1f517a9-console-serving-cert\") pod \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " Oct 30 21:55:54.671804 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.671752 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-oauth-serving-cert\") pod \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " Oct 30 21:55:54.671804 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.671779 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92278e7d-d21b-4d81-b97c-3f34f1f517a9-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92278e7d-d21b-4d81-b97c-3f34f1f517a9-console-oauth-config\") pod \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " Oct 30 21:55:54.671804 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.671795 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-service-ca\" (UniqueName: \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-service-ca\") pod \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " Oct 30 21:55:54.671952 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.671823 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-trusted-ca-bundle" pod "92278e7d-d21b-4d81-b97c-3f34f1f517a9" (UID: "92278e7d-d21b-4d81-b97c-3f34f1f517a9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:55:54.671952 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.671830 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/92278e7d-d21b-4d81-b97c-3f34f1f517a9-kube-api-access-zw6c4\" (UniqueName: \"kubernetes.io/projected/92278e7d-d21b-4d81-b97c-3f34f1f517a9-kube-api-access-zw6c4\") pod \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " Oct 30 21:55:54.672061 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.671957 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-console-config\" (UniqueName: \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-console-config\") pod \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\" (UID: \"92278e7d-d21b-4d81-b97c-3f34f1f517a9\") " Oct 30 21:55:54.672061 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.672006 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92278e7d-d21b-4d81-b97c-3f34f1f517a9-tmp" pod "92278e7d-d21b-4d81-b97c-3f34f1f517a9" (UID: "92278e7d-d21b-4d81-b97c-3f34f1f517a9"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 21:55:54.672224 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.672206 7307 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-trusted-ca-bundle\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:55:54.672270 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.672230 7307 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92278e7d-d21b-4d81-b97c-3f34f1f517a9-tmp\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:55:54.672270 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.672147 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-oauth-serving-cert" pod "92278e7d-d21b-4d81-b97c-3f34f1f517a9" (UID: "92278e7d-d21b-4d81-b97c-3f34f1f517a9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:55:54.672364 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.672306 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-service-ca" pod "92278e7d-d21b-4d81-b97c-3f34f1f517a9" (UID: "92278e7d-d21b-4d81-b97c-3f34f1f517a9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:55:54.672364 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.672327 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-console-config" pod "92278e7d-d21b-4d81-b97c-3f34f1f517a9" (UID: "92278e7d-d21b-4d81-b97c-3f34f1f517a9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 21:55:54.674109 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.674076 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92278e7d-d21b-4d81-b97c-3f34f1f517a9-console-serving-cert" pod "92278e7d-d21b-4d81-b97c-3f34f1f517a9" (UID: "92278e7d-d21b-4d81-b97c-3f34f1f517a9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:55:54.674220 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.674116 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92278e7d-d21b-4d81-b97c-3f34f1f517a9-console-oauth-config" pod "92278e7d-d21b-4d81-b97c-3f34f1f517a9" (UID: "92278e7d-d21b-4d81-b97c-3f34f1f517a9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 21:55:54.674220 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.674178 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92278e7d-d21b-4d81-b97c-3f34f1f517a9-kube-api-access-zw6c4" pod "92278e7d-d21b-4d81-b97c-3f34f1f517a9" (UID: "92278e7d-d21b-4d81-b97c-3f34f1f517a9"). InnerVolumeSpecName "kube-api-access-zw6c4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 21:55:54.772857 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.772816 7307 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw6c4\" (UniqueName: \"kubernetes.io/projected/92278e7d-d21b-4d81-b97c-3f34f1f517a9-kube-api-access-zw6c4\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:55:54.772857 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.772848 7307 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-console-config\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:55:54.772857 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.772863 7307 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92278e7d-d21b-4d81-b97c-3f34f1f517a9-console-serving-cert\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:55:54.773098 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.772874 7307 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-oauth-serving-cert\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:55:54.773098 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.772888 7307 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92278e7d-d21b-4d81-b97c-3f34f1f517a9-console-oauth-config\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:55:54.773098 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:54.772900 7307 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92278e7d-d21b-4d81-b97c-3f34f1f517a9-service-ca\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 21:55:55.444648 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:55.444613 7307 generic.go:356] "Generic (PLEG): container finished" podID="92278e7d-d21b-4d81-b97c-3f34f1f517a9" containerID="1794eca7e0dc75ec63635cf8a7252915b54ee6da07fd5ff3714cf9ac5f7f41cb" exitCode=0 Oct 30 21:55:55.445061 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:55.444665 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6569c68d8-twvr2" Oct 30 21:55:55.445061 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:55.444703 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6569c68d8-twvr2" event={"ID":"92278e7d-d21b-4d81-b97c-3f34f1f517a9","Type":"ContainerDied","Data":"1794eca7e0dc75ec63635cf8a7252915b54ee6da07fd5ff3714cf9ac5f7f41cb"} Oct 30 21:55:55.445061 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:55.444758 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6569c68d8-twvr2" event={"ID":"92278e7d-d21b-4d81-b97c-3f34f1f517a9","Type":"ContainerDied","Data":"d50af37b3e41ca73bc03bafe71021d3cf73aebf49dc5ae4ec458784769c8a203"} Oct 30 21:55:55.445061 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:55.444782 7307 scope.go:122] "RemoveContainer" containerID="1794eca7e0dc75ec63635cf8a7252915b54ee6da07fd5ff3714cf9ac5f7f41cb" Oct 30 21:55:55.452938 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:55.452915 7307 scope.go:122] "RemoveContainer" containerID="1794eca7e0dc75ec63635cf8a7252915b54ee6da07fd5ff3714cf9ac5f7f41cb" Oct 30 21:55:55.453238 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:55:55.453212 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1794eca7e0dc75ec63635cf8a7252915b54ee6da07fd5ff3714cf9ac5f7f41cb\": container with ID starting with 1794eca7e0dc75ec63635cf8a7252915b54ee6da07fd5ff3714cf9ac5f7f41cb not found: ID does not exist" containerID="1794eca7e0dc75ec63635cf8a7252915b54ee6da07fd5ff3714cf9ac5f7f41cb" Oct 30 21:55:55.453312 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:55.453249 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1794eca7e0dc75ec63635cf8a7252915b54ee6da07fd5ff3714cf9ac5f7f41cb"} err="failed to get container status \"1794eca7e0dc75ec63635cf8a7252915b54ee6da07fd5ff3714cf9ac5f7f41cb\": rpc error: code = NotFound desc = could not find container \"1794eca7e0dc75ec63635cf8a7252915b54ee6da07fd5ff3714cf9ac5f7f41cb\": container with ID starting with 1794eca7e0dc75ec63635cf8a7252915b54ee6da07fd5ff3714cf9ac5f7f41cb not found: ID does not exist" Oct 30 21:55:55.465167 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:55.465137 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6569c68d8-twvr2"] Oct 30 21:55:55.469482 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:55.469454 7307 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6569c68d8-twvr2"] Oct 30 21:55:56.928878 ip-10-0-137-4 kubenswrapper[7307]: I1030 21:55:56.928844 7307 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="92278e7d-d21b-4d81-b97c-3f34f1f517a9" path="/var/lib/kubelet/pods/92278e7d-d21b-4d81-b97c-3f34f1f517a9/volumes" Oct 30 21:56:14.272951 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:56:14.272913 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 21:56:44.274634 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:56:44.274595 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 21:57:14.274323 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:57:14.274276 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 21:57:44.273653 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:57:44.273617 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 21:58:14.273804 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:58:14.273761 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 21:58:44.274022 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:58:44.273983 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 21:59:14.273783 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:59:14.273706 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 21:59:44.273975 ip-10-0-137-4 kubenswrapper[7307]: E1030 21:59:44.273939 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:00:14.273515 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:00:14.273477 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:00:44.273451 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:00:44.273400 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:01:14.273987 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:01:14.273943 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:01:19.645057 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:19.645020 7307 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/s3-init-ctc8z"] Oct 30 22:01:19.645689 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:19.645519 7307 cpu_manager.go:414] "containerMap: removing container" podUID="92278e7d-d21b-4d81-b97c-3f34f1f517a9" containerName="console" Oct 30 22:01:19.645689 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:19.645539 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="92278e7d-d21b-4d81-b97c-3f34f1f517a9" containerName="console" Oct 30 22:01:19.645689 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:19.645641 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="92278e7d-d21b-4d81-b97c-3f34f1f517a9" containerName="console" Oct 30 22:01:19.648735 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:19.648713 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-ctc8z" Oct 30 22:01:19.657545 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:19.657522 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Oct 30 22:01:19.657719 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:19.657562 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Oct 30 22:01:19.658001 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:19.657984 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Oct 30 22:01:19.658078 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:19.658047 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"hf-token\"" Oct 30 22:01:19.658538 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:19.658511 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-ctc8z"] Oct 30 22:01:19.662010 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:19.661990 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-mdwsx\"" Oct 30 22:01:19.748851 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:19.748810 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69b224b0-448d-4bbb-ad4f-0095b919a746-model-cache\") pod \"s3-init-ctc8z\" (UID: \"69b224b0-448d-4bbb-ad4f-0095b919a746\") " pod="kserve/s3-init-ctc8z" Oct 30 22:01:19.749022 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:19.748869 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8xvm\" (UniqueName: \"kubernetes.io/projected/69b224b0-448d-4bbb-ad4f-0095b919a746-kube-api-access-r8xvm\") pod \"s3-init-ctc8z\" (UID: \"69b224b0-448d-4bbb-ad4f-0095b919a746\") " pod="kserve/s3-init-ctc8z" Oct 30 22:01:19.849729 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:19.849694 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8xvm\" (UniqueName: \"kubernetes.io/projected/69b224b0-448d-4bbb-ad4f-0095b919a746-kube-api-access-r8xvm\") pod \"s3-init-ctc8z\" (UID: \"69b224b0-448d-4bbb-ad4f-0095b919a746\") " pod="kserve/s3-init-ctc8z" Oct 30 22:01:19.849925 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:19.849776 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69b224b0-448d-4bbb-ad4f-0095b919a746-model-cache\") pod \"s3-init-ctc8z\" (UID: \"69b224b0-448d-4bbb-ad4f-0095b919a746\") " pod="kserve/s3-init-ctc8z" Oct 30 22:01:19.850122 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:19.850104 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69b224b0-448d-4bbb-ad4f-0095b919a746-model-cache\") pod \"s3-init-ctc8z\" (UID: \"69b224b0-448d-4bbb-ad4f-0095b919a746\") " pod="kserve/s3-init-ctc8z" Oct 30 22:01:19.863984 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:19.863950 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8xvm\" (UniqueName: \"kubernetes.io/projected/69b224b0-448d-4bbb-ad4f-0095b919a746-kube-api-access-r8xvm\") pod \"s3-init-ctc8z\" (UID: \"69b224b0-448d-4bbb-ad4f-0095b919a746\") " pod="kserve/s3-init-ctc8z" Oct 30 22:01:19.978196 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:19.978110 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-ctc8z" Oct 30 22:01:20.250326 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:20.250243 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-ctc8z"] Oct 30 22:01:20.253727 ip-10-0-137-4 kubenswrapper[7307]: W1030 22:01:20.253693 7307 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69b224b0_448d_4bbb_ad4f_0095b919a746.slice/crio-c11f04fe1ff63e3cb49ba7b5c8604e07350ed33e1eae82c3fb883223480820ed WatchSource:0}: Error finding container c11f04fe1ff63e3cb49ba7b5c8604e07350ed33e1eae82c3fb883223480820ed: Status 404 returned error can't find the container with id c11f04fe1ff63e3cb49ba7b5c8604e07350ed33e1eae82c3fb883223480820ed Oct 30 22:01:20.255617 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:20.255600 7307 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 22:01:20.622001 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:20.621966 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-ctc8z" event={"ID":"69b224b0-448d-4bbb-ad4f-0095b919a746","Type":"ContainerStarted","Data":"c11f04fe1ff63e3cb49ba7b5c8604e07350ed33e1eae82c3fb883223480820ed"} Oct 30 22:01:28.656256 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:28.656217 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-ctc8z" event={"ID":"69b224b0-448d-4bbb-ad4f-0095b919a746","Type":"ContainerStarted","Data":"8c910b78ce6f57ab41b45d736a74eb2a9f7fa7f74426111997598fd52fdd8091"} Oct 30 22:01:30.665516 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:30.665480 7307 generic.go:356] "Generic (PLEG): container finished" podID="69b224b0-448d-4bbb-ad4f-0095b919a746" containerID="8c910b78ce6f57ab41b45d736a74eb2a9f7fa7f74426111997598fd52fdd8091" exitCode=0 Oct 30 22:01:30.665940 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:30.665555 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-ctc8z" event={"ID":"69b224b0-448d-4bbb-ad4f-0095b919a746","Type":"ContainerDied","Data":"8c910b78ce6f57ab41b45d736a74eb2a9f7fa7f74426111997598fd52fdd8091"} Oct 30 22:01:35.689442 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:35.689405 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-ctc8z" event={"ID":"69b224b0-448d-4bbb-ad4f-0095b919a746","Type":"ContainerStarted","Data":"cb621408154cc97e0027fede2a7c4832e80adaa6ddbc1743f8a58286ff515b99"} Oct 30 22:01:35.713234 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:01:35.713159 7307 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/s3-init-ctc8z" podStartSLOduration=2.8971769739999997 podStartE2EDuration="16.713145892s" totalImagesPullingTime="12.246517212s" totalInitContainerRuntime="1.569451706s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:01:35.711496134 +0000 UTC m=+448.912868332" watchObservedRunningTime="2026-10-30 22:01:35.713145892 +0000 UTC m=+448.914518083" Oct 30 22:01:44.274266 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:01:44.274226 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:02:14.274340 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:02:14.274259 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:02:40.936835 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:02:40.936800 7307 generic.go:356] "Generic (PLEG): container finished" podID="69b224b0-448d-4bbb-ad4f-0095b919a746" containerID="cb621408154cc97e0027fede2a7c4832e80adaa6ddbc1743f8a58286ff515b99" exitCode=0 Oct 30 22:02:40.937237 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:02:40.936869 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-ctc8z" event={"ID":"69b224b0-448d-4bbb-ad4f-0095b919a746","Type":"ContainerDied","Data":"cb621408154cc97e0027fede2a7c4832e80adaa6ddbc1743f8a58286ff515b99"} Oct 30 22:02:42.064123 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:02:42.064097 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-ctc8z" Oct 30 22:02:42.089865 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:02:42.089833 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/69b224b0-448d-4bbb-ad4f-0095b919a746-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69b224b0-448d-4bbb-ad4f-0095b919a746-model-cache\") pod \"69b224b0-448d-4bbb-ad4f-0095b919a746\" (UID: \"69b224b0-448d-4bbb-ad4f-0095b919a746\") " Oct 30 22:02:42.090042 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:02:42.089886 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/69b224b0-448d-4bbb-ad4f-0095b919a746-kube-api-access-r8xvm\" (UniqueName: \"kubernetes.io/projected/69b224b0-448d-4bbb-ad4f-0095b919a746-kube-api-access-r8xvm\") pod \"69b224b0-448d-4bbb-ad4f-0095b919a746\" (UID: \"69b224b0-448d-4bbb-ad4f-0095b919a746\") " Oct 30 22:02:42.092055 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:02:42.092026 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69b224b0-448d-4bbb-ad4f-0095b919a746-kube-api-access-r8xvm" pod "69b224b0-448d-4bbb-ad4f-0095b919a746" (UID: "69b224b0-448d-4bbb-ad4f-0095b919a746"). InnerVolumeSpecName "kube-api-access-r8xvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:02:42.110084 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:02:42.110038 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69b224b0-448d-4bbb-ad4f-0095b919a746-model-cache" pod "69b224b0-448d-4bbb-ad4f-0095b919a746" (UID: "69b224b0-448d-4bbb-ad4f-0095b919a746"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:02:42.190419 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:02:42.190360 7307 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8xvm\" (UniqueName: \"kubernetes.io/projected/69b224b0-448d-4bbb-ad4f-0095b919a746-kube-api-access-r8xvm\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:02:42.190419 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:02:42.190413 7307 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69b224b0-448d-4bbb-ad4f-0095b919a746-model-cache\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:02:42.945669 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:02:42.945637 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-ctc8z" event={"ID":"69b224b0-448d-4bbb-ad4f-0095b919a746","Type":"ContainerDied","Data":"c11f04fe1ff63e3cb49ba7b5c8604e07350ed33e1eae82c3fb883223480820ed"} Oct 30 22:02:42.945669 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:02:42.945675 7307 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c11f04fe1ff63e3cb49ba7b5c8604e07350ed33e1eae82c3fb883223480820ed" Oct 30 22:02:42.945850 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:02:42.945674 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-ctc8z" Oct 30 22:02:44.274176 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:02:44.274142 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:03:02.186550 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.186507 7307 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj"] Oct 30 22:03:02.186989 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.186967 7307 cpu_manager.go:414] "containerMap: removing container" podUID="69b224b0-448d-4bbb-ad4f-0095b919a746" containerName="s3-init" Oct 30 22:03:02.186989 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.186984 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="69b224b0-448d-4bbb-ad4f-0095b919a746" containerName="s3-init" Oct 30 22:03:02.187062 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.186999 7307 cpu_manager.go:414] "containerMap: removing container" podUID="69b224b0-448d-4bbb-ad4f-0095b919a746" containerName="download-hf-model" Oct 30 22:03:02.187062 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.187005 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="69b224b0-448d-4bbb-ad4f-0095b919a746" containerName="download-hf-model" Oct 30 22:03:02.187125 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.187061 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="69b224b0-448d-4bbb-ad4f-0095b919a746" containerName="s3-init" Oct 30 22:03:02.190265 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.190246 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" Oct 30 22:03:02.195029 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.195001 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"kube-root-ca.crt\"" Oct 30 22:03:02.195029 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.195001 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\"" Oct 30 22:03:02.196970 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.196701 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 22:03:02.196970 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.196719 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"openshift-service-ca.crt\"" Oct 30 22:03:02.196970 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.196780 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"seaweedfs-s3-creds\"" Oct 30 22:03:02.196970 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.196847 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"default-dockercfg-kk2z5\"" Oct 30 22:03:02.196970 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.196856 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"isvc-sklearn-graph-1-predictor-serving-cert\"" Oct 30 22:03:02.201219 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.201189 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj"] Oct 30 22:03:02.261961 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.261928 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8113f4de-b914-4522-92ee-bdee65eaa8bb-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj\" (UID: \"8113f4de-b914-4522-92ee-bdee65eaa8bb\") " pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" Oct 30 22:03:02.262142 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.261970 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8113f4de-b914-4522-92ee-bdee65eaa8bb-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj\" (UID: \"8113f4de-b914-4522-92ee-bdee65eaa8bb\") " pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" Oct 30 22:03:02.262142 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.262074 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8113f4de-b914-4522-92ee-bdee65eaa8bb-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj\" (UID: \"8113f4de-b914-4522-92ee-bdee65eaa8bb\") " pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" Oct 30 22:03:02.262142 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.262101 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj8hk\" (UniqueName: \"kubernetes.io/projected/8113f4de-b914-4522-92ee-bdee65eaa8bb-kube-api-access-qj8hk\") pod \"isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj\" (UID: \"8113f4de-b914-4522-92ee-bdee65eaa8bb\") " pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" Oct 30 22:03:02.262245 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.262212 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8113f4de-b914-4522-92ee-bdee65eaa8bb-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj\" (UID: \"8113f4de-b914-4522-92ee-bdee65eaa8bb\") " pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" Oct 30 22:03:02.363317 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.363280 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8113f4de-b914-4522-92ee-bdee65eaa8bb-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj\" (UID: \"8113f4de-b914-4522-92ee-bdee65eaa8bb\") " pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" Oct 30 22:03:02.363562 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.363332 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8113f4de-b914-4522-92ee-bdee65eaa8bb-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj\" (UID: \"8113f4de-b914-4522-92ee-bdee65eaa8bb\") " pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" Oct 30 22:03:02.363562 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.363364 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8113f4de-b914-4522-92ee-bdee65eaa8bb-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj\" (UID: \"8113f4de-b914-4522-92ee-bdee65eaa8bb\") " pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" Oct 30 22:03:02.363562 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.363433 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8113f4de-b914-4522-92ee-bdee65eaa8bb-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj\" (UID: \"8113f4de-b914-4522-92ee-bdee65eaa8bb\") " pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" Oct 30 22:03:02.363562 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.363465 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj8hk\" (UniqueName: \"kubernetes.io/projected/8113f4de-b914-4522-92ee-bdee65eaa8bb-kube-api-access-qj8hk\") pod \"isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj\" (UID: \"8113f4de-b914-4522-92ee-bdee65eaa8bb\") " pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" Oct 30 22:03:02.363974 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.363946 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8113f4de-b914-4522-92ee-bdee65eaa8bb-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj\" (UID: \"8113f4de-b914-4522-92ee-bdee65eaa8bb\") " pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" Oct 30 22:03:02.364177 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.364156 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8113f4de-b914-4522-92ee-bdee65eaa8bb-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj\" (UID: \"8113f4de-b914-4522-92ee-bdee65eaa8bb\") " pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" Oct 30 22:03:02.364249 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.364161 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8113f4de-b914-4522-92ee-bdee65eaa8bb-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj\" (UID: \"8113f4de-b914-4522-92ee-bdee65eaa8bb\") " pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" Oct 30 22:03:02.365854 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.365833 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8113f4de-b914-4522-92ee-bdee65eaa8bb-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj\" (UID: \"8113f4de-b914-4522-92ee-bdee65eaa8bb\") " pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" Oct 30 22:03:02.379414 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.379368 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj8hk\" (UniqueName: \"kubernetes.io/projected/8113f4de-b914-4522-92ee-bdee65eaa8bb-kube-api-access-qj8hk\") pod \"isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj\" (UID: \"8113f4de-b914-4522-92ee-bdee65eaa8bb\") " pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" Oct 30 22:03:02.491047 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.490964 7307 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2"] Oct 30 22:03:02.494778 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.494758 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" Oct 30 22:03:02.499685 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.499652 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\"" Oct 30 22:03:02.499816 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.499736 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"isvc-xgboost-graph-predictor-serving-cert\"" Oct 30 22:03:02.507954 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.507927 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" Oct 30 22:03:02.514708 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.514681 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2"] Oct 30 22:03:02.564620 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.564589 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a028a1b-ec69-435f-b120-d12c5074312b-proxy-tls\") pod \"isvc-xgboost-graph-predictor-74db998dbd-gv7p2\" (UID: \"9a028a1b-ec69-435f-b120-d12c5074312b\") " pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" Oct 30 22:03:02.564706 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.564625 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9a028a1b-ec69-435f-b120-d12c5074312b-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-74db998dbd-gv7p2\" (UID: \"9a028a1b-ec69-435f-b120-d12c5074312b\") " pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" Oct 30 22:03:02.564763 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.564704 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltjkb\" (UniqueName: \"kubernetes.io/projected/9a028a1b-ec69-435f-b120-d12c5074312b-kube-api-access-ltjkb\") pod \"isvc-xgboost-graph-predictor-74db998dbd-gv7p2\" (UID: \"9a028a1b-ec69-435f-b120-d12c5074312b\") " pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" Oct 30 22:03:02.564763 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.564733 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9a028a1b-ec69-435f-b120-d12c5074312b-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-74db998dbd-gv7p2\" (UID: \"9a028a1b-ec69-435f-b120-d12c5074312b\") " pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" Oct 30 22:03:02.564873 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.564776 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9a028a1b-ec69-435f-b120-d12c5074312b-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-74db998dbd-gv7p2\" (UID: \"9a028a1b-ec69-435f-b120-d12c5074312b\") " pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" Oct 30 22:03:02.665762 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.665728 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9a028a1b-ec69-435f-b120-d12c5074312b-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-74db998dbd-gv7p2\" (UID: \"9a028a1b-ec69-435f-b120-d12c5074312b\") " pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" Oct 30 22:03:02.665959 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.665785 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a028a1b-ec69-435f-b120-d12c5074312b-proxy-tls\") pod \"isvc-xgboost-graph-predictor-74db998dbd-gv7p2\" (UID: \"9a028a1b-ec69-435f-b120-d12c5074312b\") " pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" Oct 30 22:03:02.665959 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.665808 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9a028a1b-ec69-435f-b120-d12c5074312b-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-74db998dbd-gv7p2\" (UID: \"9a028a1b-ec69-435f-b120-d12c5074312b\") " pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" Oct 30 22:03:02.665959 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.665835 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltjkb\" (UniqueName: \"kubernetes.io/projected/9a028a1b-ec69-435f-b120-d12c5074312b-kube-api-access-ltjkb\") pod \"isvc-xgboost-graph-predictor-74db998dbd-gv7p2\" (UID: \"9a028a1b-ec69-435f-b120-d12c5074312b\") " pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" Oct 30 22:03:02.665959 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.665855 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9a028a1b-ec69-435f-b120-d12c5074312b-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-74db998dbd-gv7p2\" (UID: \"9a028a1b-ec69-435f-b120-d12c5074312b\") " pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" Oct 30 22:03:02.666244 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.666219 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9a028a1b-ec69-435f-b120-d12c5074312b-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-74db998dbd-gv7p2\" (UID: \"9a028a1b-ec69-435f-b120-d12c5074312b\") " pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" Oct 30 22:03:02.666612 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.666589 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9a028a1b-ec69-435f-b120-d12c5074312b-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-74db998dbd-gv7p2\" (UID: \"9a028a1b-ec69-435f-b120-d12c5074312b\") " pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" Oct 30 22:03:02.666722 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.666622 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9a028a1b-ec69-435f-b120-d12c5074312b-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-74db998dbd-gv7p2\" (UID: \"9a028a1b-ec69-435f-b120-d12c5074312b\") " pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" Oct 30 22:03:02.668481 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.668459 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a028a1b-ec69-435f-b120-d12c5074312b-proxy-tls\") pod \"isvc-xgboost-graph-predictor-74db998dbd-gv7p2\" (UID: \"9a028a1b-ec69-435f-b120-d12c5074312b\") " pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" Oct 30 22:03:02.679174 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.679148 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltjkb\" (UniqueName: \"kubernetes.io/projected/9a028a1b-ec69-435f-b120-d12c5074312b-kube-api-access-ltjkb\") pod \"isvc-xgboost-graph-predictor-74db998dbd-gv7p2\" (UID: \"9a028a1b-ec69-435f-b120-d12c5074312b\") " pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" Oct 30 22:03:02.802002 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.801970 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj"] Oct 30 22:03:02.805338 ip-10-0-137-4 kubenswrapper[7307]: W1030 22:03:02.805310 7307 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8113f4de_b914_4522_92ee_bdee65eaa8bb.slice/crio-8246a280943fff0d1042b2ea6f2f8975c227929f12222ce8c11378a034b33737 WatchSource:0}: Error finding container 8246a280943fff0d1042b2ea6f2f8975c227929f12222ce8c11378a034b33737: Status 404 returned error can't find the container with id 8246a280943fff0d1042b2ea6f2f8975c227929f12222ce8c11378a034b33737 Oct 30 22:03:02.812086 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:02.811971 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" Oct 30 22:03:03.004200 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:03.004153 7307 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb"] Oct 30 22:03:03.007845 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:03.007816 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" Oct 30 22:03:03.017340 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:03.017289 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"openshift-service-ca.crt\"" Oct 30 22:03:03.017571 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:03.017441 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"error-404-isvc-7f5ed-kube-rbac-proxy-sar-config\"" Oct 30 22:03:03.017878 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:03.017857 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"kube-root-ca.crt\"" Oct 30 22:03:03.018089 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:03.018059 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-36e5afb065\"/\"error-404-isvc-7f5ed-predictor-serving-cert\"" Oct 30 22:03:03.018210 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:03.018181 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-36e5afb065\"/\"default-dockercfg-jlnw5\"" Oct 30 22:03:03.019184 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:03.019154 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb"] Oct 30 22:03:03.026226 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:03.026191 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" event={"ID":"8113f4de-b914-4522-92ee-bdee65eaa8bb","Type":"ContainerStarted","Data":"5de79a0f65ccee29dbdd3b45872238d914ccfbb4571631f44dd5026bd78603f8"} Oct 30 22:03:03.026418 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:03.026263 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" event={"ID":"8113f4de-b914-4522-92ee-bdee65eaa8bb","Type":"ContainerStarted","Data":"8246a280943fff0d1042b2ea6f2f8975c227929f12222ce8c11378a034b33737"} Oct 30 22:03:03.069315 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:03.069232 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjxtz\" (UniqueName: \"kubernetes.io/projected/2d4839bd-1ece-4845-abf1-b1bc2945e43a-kube-api-access-wjxtz\") pod \"error-404-isvc-7f5ed-predictor-7c54876699-v6vhb\" (UID: \"2d4839bd-1ece-4845-abf1-b1bc2945e43a\") " pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" Oct 30 22:03:03.069315 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:03.069296 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2d4839bd-1ece-4845-abf1-b1bc2945e43a-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-7f5ed-predictor-7c54876699-v6vhb\" (UID: \"2d4839bd-1ece-4845-abf1-b1bc2945e43a\") " pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" Oct 30 22:03:03.069567 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:03.069338 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2d4839bd-1ece-4845-abf1-b1bc2945e43a-proxy-tls\") pod \"error-404-isvc-7f5ed-predictor-7c54876699-v6vhb\" (UID: \"2d4839bd-1ece-4845-abf1-b1bc2945e43a\") " pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" Oct 30 22:03:03.097270 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:03.097228 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2"] Oct 30 22:03:03.100435 ip-10-0-137-4 kubenswrapper[7307]: W1030 22:03:03.100396 7307 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a028a1b_ec69_435f_b120_d12c5074312b.slice/crio-dc3fc5315a2419d1b208cd03c5bf448d7e63e7379288d6da4fb11de1c511ce81 WatchSource:0}: Error finding container dc3fc5315a2419d1b208cd03c5bf448d7e63e7379288d6da4fb11de1c511ce81: Status 404 returned error can't find the container with id dc3fc5315a2419d1b208cd03c5bf448d7e63e7379288d6da4fb11de1c511ce81 Oct 30 22:03:03.170074 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:03.170037 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2d4839bd-1ece-4845-abf1-b1bc2945e43a-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-7f5ed-predictor-7c54876699-v6vhb\" (UID: \"2d4839bd-1ece-4845-abf1-b1bc2945e43a\") " pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" Oct 30 22:03:03.170312 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:03.170094 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2d4839bd-1ece-4845-abf1-b1bc2945e43a-proxy-tls\") pod \"error-404-isvc-7f5ed-predictor-7c54876699-v6vhb\" (UID: \"2d4839bd-1ece-4845-abf1-b1bc2945e43a\") " pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" Oct 30 22:03:03.170312 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:03.170210 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjxtz\" (UniqueName: \"kubernetes.io/projected/2d4839bd-1ece-4845-abf1-b1bc2945e43a-kube-api-access-wjxtz\") pod \"error-404-isvc-7f5ed-predictor-7c54876699-v6vhb\" (UID: \"2d4839bd-1ece-4845-abf1-b1bc2945e43a\") " pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" Oct 30 22:03:03.170911 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:03.170881 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2d4839bd-1ece-4845-abf1-b1bc2945e43a-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-7f5ed-predictor-7c54876699-v6vhb\" (UID: \"2d4839bd-1ece-4845-abf1-b1bc2945e43a\") " pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" Oct 30 22:03:03.172573 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:03.172551 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2d4839bd-1ece-4845-abf1-b1bc2945e43a-proxy-tls\") pod \"error-404-isvc-7f5ed-predictor-7c54876699-v6vhb\" (UID: \"2d4839bd-1ece-4845-abf1-b1bc2945e43a\") " pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" Oct 30 22:03:03.183866 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:03.183837 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjxtz\" (UniqueName: \"kubernetes.io/projected/2d4839bd-1ece-4845-abf1-b1bc2945e43a-kube-api-access-wjxtz\") pod \"error-404-isvc-7f5ed-predictor-7c54876699-v6vhb\" (UID: \"2d4839bd-1ece-4845-abf1-b1bc2945e43a\") " pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" Oct 30 22:03:03.324839 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:03.324741 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" Oct 30 22:03:03.620018 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:03.619986 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb"] Oct 30 22:03:03.623570 ip-10-0-137-4 kubenswrapper[7307]: W1030 22:03:03.623544 7307 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d4839bd_1ece_4845_abf1_b1bc2945e43a.slice/crio-90ac8c49a44109cc487740baa4ffbf0ea5fb756395110bf0b706f634fc967d1e WatchSource:0}: Error finding container 90ac8c49a44109cc487740baa4ffbf0ea5fb756395110bf0b706f634fc967d1e: Status 404 returned error can't find the container with id 90ac8c49a44109cc487740baa4ffbf0ea5fb756395110bf0b706f634fc967d1e Oct 30 22:03:04.032494 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:04.032394 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" event={"ID":"9a028a1b-ec69-435f-b120-d12c5074312b","Type":"ContainerStarted","Data":"c751b859b653c468fdabf22fc4011039592b12e1e4299926524e4f32ad29f8a3"} Oct 30 22:03:04.032494 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:04.032460 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" event={"ID":"9a028a1b-ec69-435f-b120-d12c5074312b","Type":"ContainerStarted","Data":"dc3fc5315a2419d1b208cd03c5bf448d7e63e7379288d6da4fb11de1c511ce81"} Oct 30 22:03:04.033705 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:04.033677 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" event={"ID":"2d4839bd-1ece-4845-abf1-b1bc2945e43a","Type":"ContainerStarted","Data":"90ac8c49a44109cc487740baa4ffbf0ea5fb756395110bf0b706f634fc967d1e"} Oct 30 22:03:07.054186 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:07.054141 7307 generic.go:356] "Generic (PLEG): container finished" podID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerID="5de79a0f65ccee29dbdd3b45872238d914ccfbb4571631f44dd5026bd78603f8" exitCode=0 Oct 30 22:03:07.054689 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:07.054210 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" event={"ID":"8113f4de-b914-4522-92ee-bdee65eaa8bb","Type":"ContainerDied","Data":"5de79a0f65ccee29dbdd3b45872238d914ccfbb4571631f44dd5026bd78603f8"} Oct 30 22:03:08.064084 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:08.064043 7307 generic.go:356] "Generic (PLEG): container finished" podID="9a028a1b-ec69-435f-b120-d12c5074312b" containerID="c751b859b653c468fdabf22fc4011039592b12e1e4299926524e4f32ad29f8a3" exitCode=0 Oct 30 22:03:08.064654 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:08.064160 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" event={"ID":"9a028a1b-ec69-435f-b120-d12c5074312b","Type":"ContainerDied","Data":"c751b859b653c468fdabf22fc4011039592b12e1e4299926524e4f32ad29f8a3"} Oct 30 22:03:14.288655 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:03:14.288494 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:03:23.167869 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:23.167830 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" event={"ID":"2d4839bd-1ece-4845-abf1-b1bc2945e43a","Type":"ContainerStarted","Data":"bd81d4654f6e245489ba2f5630a60a364ee4360eaad04278ddd01259586208ea"} Oct 30 22:03:27.192472 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:27.192433 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" event={"ID":"8113f4de-b914-4522-92ee-bdee65eaa8bb","Type":"ContainerStarted","Data":"5b92e6287fe907957acf0511ae2a6f319a23e486c54098cac1d846e04af61ffe"} Oct 30 22:03:27.192943 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:27.192554 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" event={"ID":"8113f4de-b914-4522-92ee-bdee65eaa8bb","Type":"ContainerStarted","Data":"2d055f83252e147cf19cfb28878e2a9b731b580287657d6ca7504829225352a8"} Oct 30 22:03:27.193125 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:27.193103 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" Oct 30 22:03:27.193341 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:27.193324 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" Oct 30 22:03:27.194618 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:27.194573 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 30 22:03:27.194724 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:27.194626 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" event={"ID":"2d4839bd-1ece-4845-abf1-b1bc2945e43a","Type":"ContainerStarted","Data":"c3d7e479241a5e40c0a6c04b966f34ff44af6dfeb4a797bb6c916917b5be567e"} Oct 30 22:03:27.194797 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:27.194773 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" Oct 30 22:03:27.194850 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:27.194827 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" Oct 30 22:03:27.195856 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:27.195819 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" podUID="2d4839bd-1ece-4845-abf1-b1bc2945e43a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:03:27.218627 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:27.218580 7307 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" podStartSLOduration=1.4693983720000001 podStartE2EDuration="25.218568197s" totalImagesPullingTime="19.662010572s" totalInitContainerRuntime="4.087159253s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:03:27.218168941 +0000 UTC m=+560.419541143" watchObservedRunningTime="2026-10-30 22:03:27.218568197 +0000 UTC m=+560.419940399" Oct 30 22:03:27.240460 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:27.240403 7307 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" podStartSLOduration=2.244730707 podStartE2EDuration="25.240365107s" totalImagesPullingTime="22.9956344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:03:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:03:27.239123936 +0000 UTC m=+560.440496165" watchObservedRunningTime="2026-10-30 22:03:27.240365107 +0000 UTC m=+560.441737310" Oct 30 22:03:28.199395 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:28.199343 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 30 22:03:28.199395 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:28.199358 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" podUID="2d4839bd-1ece-4845-abf1-b1bc2945e43a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:03:29.203211 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:29.203169 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 30 22:03:33.203878 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:33.203850 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" Oct 30 22:03:33.204414 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:33.204365 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" podUID="2d4839bd-1ece-4845-abf1-b1bc2945e43a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:03:33.222021 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:33.221980 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" event={"ID":"9a028a1b-ec69-435f-b120-d12c5074312b","Type":"ContainerStarted","Data":"adf132061d1a41146465d3fab9e934e43f6d5460a91c3692049c1ccb77479336"} Oct 30 22:03:33.222218 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:33.222047 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" event={"ID":"9a028a1b-ec69-435f-b120-d12c5074312b","Type":"ContainerStarted","Data":"19299d11875ae0662c46eeaacb82c7d32dcf0d3472471e35433457a5e0444996"} Oct 30 22:03:33.222278 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:33.222244 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" Oct 30 22:03:33.250727 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:33.250665 7307 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" podStartSLOduration=2.2993640539999998 podStartE2EDuration="31.250650298s" totalImagesPullingTime="24.952688979s" totalInitContainerRuntime="3.998597265s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:03:33.250521064 +0000 UTC m=+566.451893265" watchObservedRunningTime="2026-10-30 22:03:33.250650298 +0000 UTC m=+566.452022490" Oct 30 22:03:34.208366 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:34.208334 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" Oct 30 22:03:34.208927 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:34.208899 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 30 22:03:34.226325 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:34.226293 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" Oct 30 22:03:34.227816 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:34.227774 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" podUID="9a028a1b-ec69-435f-b120-d12c5074312b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Oct 30 22:03:35.231731 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:35.231692 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" podUID="9a028a1b-ec69-435f-b120-d12c5074312b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Oct 30 22:03:40.236445 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:40.236415 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" Oct 30 22:03:40.237030 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:40.236924 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" podUID="9a028a1b-ec69-435f-b120-d12c5074312b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Oct 30 22:03:43.204355 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:43.204320 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" podUID="2d4839bd-1ece-4845-abf1-b1bc2945e43a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:03:44.209554 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:44.209513 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 30 22:03:44.273618 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:03:44.273580 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:03:50.237035 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:50.236993 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" podUID="9a028a1b-ec69-435f-b120-d12c5074312b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Oct 30 22:03:53.204500 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:53.204439 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" podUID="2d4839bd-1ece-4845-abf1-b1bc2945e43a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:03:54.209832 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:03:54.209792 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 30 22:04:00.237120 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:00.237081 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" podUID="9a028a1b-ec69-435f-b120-d12c5074312b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Oct 30 22:04:03.204773 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:03.204732 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" podUID="2d4839bd-1ece-4845-abf1-b1bc2945e43a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:04:04.209433 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:04.209373 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 30 22:04:10.237143 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:10.237100 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" podUID="9a028a1b-ec69-435f-b120-d12c5074312b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Oct 30 22:04:13.204693 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:13.204654 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" podUID="2d4839bd-1ece-4845-abf1-b1bc2945e43a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:04:14.209245 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:14.209197 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 30 22:04:14.275521 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:04:14.275484 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:04:20.237045 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:20.237005 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" podUID="9a028a1b-ec69-435f-b120-d12c5074312b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Oct 30 22:04:23.205409 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:23.205367 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" Oct 30 22:04:24.209369 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:24.209329 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 30 22:04:30.237155 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:30.237114 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" podUID="9a028a1b-ec69-435f-b120-d12c5074312b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Oct 30 22:04:34.209252 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:34.209213 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 30 22:04:40.237138 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:40.237088 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" podUID="9a028a1b-ec69-435f-b120-d12c5074312b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Oct 30 22:04:44.209530 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:44.209485 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 30 22:04:44.274396 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:04:44.274340 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:04:45.923853 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:45.923811 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 30 22:04:48.102486 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:48.102404 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb"] Oct 30 22:04:48.102951 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:48.102627 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" podUID="2d4839bd-1ece-4845-abf1-b1bc2945e43a" containerName="kserve-container" containerID="cri-o://bd81d4654f6e245489ba2f5630a60a364ee4360eaad04278ddd01259586208ea" gracePeriod=30 Oct 30 22:04:48.102951 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:48.102714 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" podUID="2d4839bd-1ece-4845-abf1-b1bc2945e43a" containerName="kube-rbac-proxy" containerID="cri-o://c3d7e479241a5e40c0a6c04b966f34ff44af6dfeb4a797bb6c916917b5be567e" gracePeriod=30 Oct 30 22:04:48.199456 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:48.199412 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" podUID="2d4839bd-1ece-4845-abf1-b1bc2945e43a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.25:8643/healthz\": dial tcp 10.133.0.25:8643: connect: connection refused" Oct 30 22:04:48.533006 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:48.532973 7307 generic.go:356] "Generic (PLEG): container finished" podID="2d4839bd-1ece-4845-abf1-b1bc2945e43a" containerID="c3d7e479241a5e40c0a6c04b966f34ff44af6dfeb4a797bb6c916917b5be567e" exitCode=0 Oct 30 22:04:48.533195 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:48.533051 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" event={"ID":"2d4839bd-1ece-4845-abf1-b1bc2945e43a","Type":"ContainerDied","Data":"c3d7e479241a5e40c0a6c04b966f34ff44af6dfeb4a797bb6c916917b5be567e"} Oct 30 22:04:50.238416 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:50.238364 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" Oct 30 22:04:51.745223 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:51.745197 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" Oct 30 22:04:51.795237 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:51.795147 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d4839bd-1ece-4845-abf1-b1bc2945e43a-kube-api-access-wjxtz\" (UniqueName: \"kubernetes.io/projected/2d4839bd-1ece-4845-abf1-b1bc2945e43a-kube-api-access-wjxtz\") pod \"2d4839bd-1ece-4845-abf1-b1bc2945e43a\" (UID: \"2d4839bd-1ece-4845-abf1-b1bc2945e43a\") " Oct 30 22:04:51.795237 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:51.795216 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d4839bd-1ece-4845-abf1-b1bc2945e43a-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2d4839bd-1ece-4845-abf1-b1bc2945e43a-kube-rbac-proxy-sar-config\") pod \"2d4839bd-1ece-4845-abf1-b1bc2945e43a\" (UID: \"2d4839bd-1ece-4845-abf1-b1bc2945e43a\") " Oct 30 22:04:51.795489 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:51.795261 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d4839bd-1ece-4845-abf1-b1bc2945e43a-proxy-tls\" (UniqueName: \"kubernetes.io/secret/2d4839bd-1ece-4845-abf1-b1bc2945e43a-proxy-tls\") pod \"2d4839bd-1ece-4845-abf1-b1bc2945e43a\" (UID: \"2d4839bd-1ece-4845-abf1-b1bc2945e43a\") " Oct 30 22:04:51.795637 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:51.795617 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d4839bd-1ece-4845-abf1-b1bc2945e43a-kube-rbac-proxy-sar-config" pod "2d4839bd-1ece-4845-abf1-b1bc2945e43a" (UID: "2d4839bd-1ece-4845-abf1-b1bc2945e43a"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:04:51.797525 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:51.797502 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d4839bd-1ece-4845-abf1-b1bc2945e43a-kube-api-access-wjxtz" pod "2d4839bd-1ece-4845-abf1-b1bc2945e43a" (UID: "2d4839bd-1ece-4845-abf1-b1bc2945e43a"). InnerVolumeSpecName "kube-api-access-wjxtz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:04:51.797609 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:51.797508 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d4839bd-1ece-4845-abf1-b1bc2945e43a-proxy-tls" pod "2d4839bd-1ece-4845-abf1-b1bc2945e43a" (UID: "2d4839bd-1ece-4845-abf1-b1bc2945e43a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:04:51.901373 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:51.896686 7307 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjxtz\" (UniqueName: \"kubernetes.io/projected/2d4839bd-1ece-4845-abf1-b1bc2945e43a-kube-api-access-wjxtz\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:04:51.901373 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:51.896726 7307 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2d4839bd-1ece-4845-abf1-b1bc2945e43a-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:04:51.901373 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:51.896747 7307 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2d4839bd-1ece-4845-abf1-b1bc2945e43a-proxy-tls\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:04:52.550841 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:52.550801 7307 generic.go:356] "Generic (PLEG): container finished" podID="2d4839bd-1ece-4845-abf1-b1bc2945e43a" containerID="bd81d4654f6e245489ba2f5630a60a364ee4360eaad04278ddd01259586208ea" exitCode=0 Oct 30 22:04:52.551011 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:52.550863 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" Oct 30 22:04:52.551011 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:52.550883 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" event={"ID":"2d4839bd-1ece-4845-abf1-b1bc2945e43a","Type":"ContainerDied","Data":"bd81d4654f6e245489ba2f5630a60a364ee4360eaad04278ddd01259586208ea"} Oct 30 22:04:52.551011 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:52.550943 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb" event={"ID":"2d4839bd-1ece-4845-abf1-b1bc2945e43a","Type":"ContainerDied","Data":"90ac8c49a44109cc487740baa4ffbf0ea5fb756395110bf0b706f634fc967d1e"} Oct 30 22:04:52.551011 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:52.550971 7307 scope.go:122] "RemoveContainer" containerID="c3d7e479241a5e40c0a6c04b966f34ff44af6dfeb4a797bb6c916917b5be567e" Oct 30 22:04:52.559207 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:52.559133 7307 scope.go:122] "RemoveContainer" containerID="bd81d4654f6e245489ba2f5630a60a364ee4360eaad04278ddd01259586208ea" Oct 30 22:04:52.566929 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:52.566907 7307 scope.go:122] "RemoveContainer" containerID="c3d7e479241a5e40c0a6c04b966f34ff44af6dfeb4a797bb6c916917b5be567e" Oct 30 22:04:52.567174 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:04:52.567153 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3d7e479241a5e40c0a6c04b966f34ff44af6dfeb4a797bb6c916917b5be567e\": container with ID starting with c3d7e479241a5e40c0a6c04b966f34ff44af6dfeb4a797bb6c916917b5be567e not found: ID does not exist" containerID="c3d7e479241a5e40c0a6c04b966f34ff44af6dfeb4a797bb6c916917b5be567e" Oct 30 22:04:52.567227 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:52.567184 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3d7e479241a5e40c0a6c04b966f34ff44af6dfeb4a797bb6c916917b5be567e"} err="failed to get container status \"c3d7e479241a5e40c0a6c04b966f34ff44af6dfeb4a797bb6c916917b5be567e\": rpc error: code = NotFound desc = could not find container \"c3d7e479241a5e40c0a6c04b966f34ff44af6dfeb4a797bb6c916917b5be567e\": container with ID starting with c3d7e479241a5e40c0a6c04b966f34ff44af6dfeb4a797bb6c916917b5be567e not found: ID does not exist" Oct 30 22:04:52.567227 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:52.567208 7307 scope.go:122] "RemoveContainer" containerID="bd81d4654f6e245489ba2f5630a60a364ee4360eaad04278ddd01259586208ea" Oct 30 22:04:52.567470 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:04:52.567454 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd81d4654f6e245489ba2f5630a60a364ee4360eaad04278ddd01259586208ea\": container with ID starting with bd81d4654f6e245489ba2f5630a60a364ee4360eaad04278ddd01259586208ea not found: ID does not exist" containerID="bd81d4654f6e245489ba2f5630a60a364ee4360eaad04278ddd01259586208ea" Oct 30 22:04:52.567522 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:52.567478 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd81d4654f6e245489ba2f5630a60a364ee4360eaad04278ddd01259586208ea"} err="failed to get container status \"bd81d4654f6e245489ba2f5630a60a364ee4360eaad04278ddd01259586208ea\": rpc error: code = NotFound desc = could not find container \"bd81d4654f6e245489ba2f5630a60a364ee4360eaad04278ddd01259586208ea\": container with ID starting with bd81d4654f6e245489ba2f5630a60a364ee4360eaad04278ddd01259586208ea not found: ID does not exist" Oct 30 22:04:52.573751 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:52.573728 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb"] Oct 30 22:04:52.577476 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:52.577457 7307 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-7f5ed-predictor-7c54876699-v6vhb"] Oct 30 22:04:52.928617 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:52.928582 7307 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d4839bd-1ece-4845-abf1-b1bc2945e43a" path="/var/lib/kubelet/pods/2d4839bd-1ece-4845-abf1-b1bc2945e43a/volumes" Oct 30 22:04:53.719612 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:53.719573 7307 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt"] Oct 30 22:04:53.720009 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:53.719991 7307 cpu_manager.go:414] "containerMap: removing container" podUID="2d4839bd-1ece-4845-abf1-b1bc2945e43a" containerName="kube-rbac-proxy" Oct 30 22:04:53.720111 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:53.720012 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d4839bd-1ece-4845-abf1-b1bc2945e43a" containerName="kube-rbac-proxy" Oct 30 22:04:53.720111 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:53.720028 7307 cpu_manager.go:414] "containerMap: removing container" podUID="2d4839bd-1ece-4845-abf1-b1bc2945e43a" containerName="kserve-container" Oct 30 22:04:53.720111 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:53.720036 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d4839bd-1ece-4845-abf1-b1bc2945e43a" containerName="kserve-container" Oct 30 22:04:53.720271 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:53.720134 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d4839bd-1ece-4845-abf1-b1bc2945e43a" containerName="kube-rbac-proxy" Oct 30 22:04:53.720271 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:53.720148 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d4839bd-1ece-4845-abf1-b1bc2945e43a" containerName="kserve-container" Oct 30 22:04:53.724726 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:53.724704 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" Oct 30 22:04:53.734106 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:53.734087 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-36e5afb065\"/\"default-dockercfg-jlnw5\"" Oct 30 22:04:53.734222 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:53.734115 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-36e5afb065\"/\"error-404-isvc-3c7da-predictor-serving-cert\"" Oct 30 22:04:53.738410 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:53.737656 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"openshift-service-ca.crt\"" Oct 30 22:04:53.738410 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:53.737663 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"error-404-isvc-3c7da-kube-rbac-proxy-sar-config\"" Oct 30 22:04:53.738410 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:53.737756 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"kube-root-ca.crt\"" Oct 30 22:04:53.738410 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:53.738087 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt"] Oct 30 22:04:53.815299 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:53.815258 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/30824715-02da-4fa0-89f1-3b6c7c4f0e01-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt\" (UID: \"30824715-02da-4fa0-89f1-3b6c7c4f0e01\") " pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" Oct 30 22:04:53.815299 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:53.815300 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/30824715-02da-4fa0-89f1-3b6c7c4f0e01-proxy-tls\") pod \"error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt\" (UID: \"30824715-02da-4fa0-89f1-3b6c7c4f0e01\") " pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" Oct 30 22:04:53.815544 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:53.815423 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5qtn\" (UniqueName: \"kubernetes.io/projected/30824715-02da-4fa0-89f1-3b6c7c4f0e01-kube-api-access-z5qtn\") pod \"error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt\" (UID: \"30824715-02da-4fa0-89f1-3b6c7c4f0e01\") " pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" Oct 30 22:04:53.916457 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:53.916415 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/30824715-02da-4fa0-89f1-3b6c7c4f0e01-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt\" (UID: \"30824715-02da-4fa0-89f1-3b6c7c4f0e01\") " pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" Oct 30 22:04:53.916457 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:53.916461 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/30824715-02da-4fa0-89f1-3b6c7c4f0e01-proxy-tls\") pod \"error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt\" (UID: \"30824715-02da-4fa0-89f1-3b6c7c4f0e01\") " pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" Oct 30 22:04:53.916720 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:53.916516 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5qtn\" (UniqueName: \"kubernetes.io/projected/30824715-02da-4fa0-89f1-3b6c7c4f0e01-kube-api-access-z5qtn\") pod \"error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt\" (UID: \"30824715-02da-4fa0-89f1-3b6c7c4f0e01\") " pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" Oct 30 22:04:53.917151 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:53.917128 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/30824715-02da-4fa0-89f1-3b6c7c4f0e01-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt\" (UID: \"30824715-02da-4fa0-89f1-3b6c7c4f0e01\") " pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" Oct 30 22:04:53.918841 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:53.918823 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/30824715-02da-4fa0-89f1-3b6c7c4f0e01-proxy-tls\") pod \"error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt\" (UID: \"30824715-02da-4fa0-89f1-3b6c7c4f0e01\") " pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" Oct 30 22:04:53.938413 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:53.938388 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5qtn\" (UniqueName: \"kubernetes.io/projected/30824715-02da-4fa0-89f1-3b6c7c4f0e01-kube-api-access-z5qtn\") pod \"error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt\" (UID: \"30824715-02da-4fa0-89f1-3b6c7c4f0e01\") " pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" Oct 30 22:04:54.039623 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:54.039532 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" Oct 30 22:04:54.312415 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:54.312305 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt"] Oct 30 22:04:54.315445 ip-10-0-137-4 kubenswrapper[7307]: W1030 22:04:54.315410 7307 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30824715_02da_4fa0_89f1_3b6c7c4f0e01.slice/crio-f39fbfb1c992c20a6a3fbd6e310bc96e259d427ee2e8183c68622cde9213e1bf WatchSource:0}: Error finding container f39fbfb1c992c20a6a3fbd6e310bc96e259d427ee2e8183c68622cde9213e1bf: Status 404 returned error can't find the container with id f39fbfb1c992c20a6a3fbd6e310bc96e259d427ee2e8183c68622cde9213e1bf Oct 30 22:04:54.563096 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:54.563004 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" event={"ID":"30824715-02da-4fa0-89f1-3b6c7c4f0e01","Type":"ContainerStarted","Data":"3d22449837e95b194759c378deb065dce17f81c853ffce0b99705589d2e2332e"} Oct 30 22:04:54.563096 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:54.563061 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" event={"ID":"30824715-02da-4fa0-89f1-3b6c7c4f0e01","Type":"ContainerStarted","Data":"6a7f2e3d56965544c2bff9c4492b77069874bdc534b2de9ed0655d6685c7077b"} Oct 30 22:04:54.563096 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:54.563081 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" event={"ID":"30824715-02da-4fa0-89f1-3b6c7c4f0e01","Type":"ContainerStarted","Data":"f39fbfb1c992c20a6a3fbd6e310bc96e259d427ee2e8183c68622cde9213e1bf"} Oct 30 22:04:54.563362 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:54.563111 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" Oct 30 22:04:54.563362 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:54.563132 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" Oct 30 22:04:54.564526 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:54.564500 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" podUID="30824715-02da-4fa0-89f1-3b6c7c4f0e01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:04:54.584887 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:54.584840 7307 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" podStartSLOduration=1.584827455 podStartE2EDuration="1.584827455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:04:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:04:54.584147545 +0000 UTC m=+647.785519746" watchObservedRunningTime="2026-10-30 22:04:54.584827455 +0000 UTC m=+647.786199650" Oct 30 22:04:55.567335 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:55.567297 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" podUID="30824715-02da-4fa0-89f1-3b6c7c4f0e01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:04:55.925191 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:04:55.925152 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" Oct 30 22:05:00.572453 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:00.572420 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" Oct 30 22:05:00.572922 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:00.572847 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" podUID="30824715-02da-4fa0-89f1-3b6c7c4f0e01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:05:10.573517 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:10.573474 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" podUID="30824715-02da-4fa0-89f1-3b6c7c4f0e01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:05:14.274592 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:05:14.274557 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:05:20.573139 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:20.573084 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" podUID="30824715-02da-4fa0-89f1-3b6c7c4f0e01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:05:30.573306 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:30.573263 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" podUID="30824715-02da-4fa0-89f1-3b6c7c4f0e01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:05:34.028557 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:34.028524 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj"] Oct 30 22:05:34.029078 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:34.028752 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="kserve-container" containerID="cri-o://2d055f83252e147cf19cfb28878e2a9b731b580287657d6ca7504829225352a8" gracePeriod=30 Oct 30 22:05:34.029078 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:34.028819 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="kube-rbac-proxy" containerID="cri-o://5b92e6287fe907957acf0511ae2a6f319a23e486c54098cac1d846e04af61ffe" gracePeriod=30 Oct 30 22:05:34.059861 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:34.059825 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2"] Oct 30 22:05:34.060038 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:34.060019 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" podUID="9a028a1b-ec69-435f-b120-d12c5074312b" containerName="kserve-container" containerID="cri-o://19299d11875ae0662c46eeaacb82c7d32dcf0d3472471e35433457a5e0444996" gracePeriod=30 Oct 30 22:05:34.060350 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:34.060320 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" podUID="9a028a1b-ec69-435f-b120-d12c5074312b" containerName="kube-rbac-proxy" containerID="cri-o://adf132061d1a41146465d3fab9e934e43f6d5460a91c3692049c1ccb77479336" gracePeriod=30 Oct 30 22:05:34.203534 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:34.203499 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.23:8643/healthz\": dial tcp 10.133.0.23:8643: connect: connection refused" Oct 30 22:05:34.721425 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:34.721394 7307 generic.go:356] "Generic (PLEG): container finished" podID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerID="5b92e6287fe907957acf0511ae2a6f319a23e486c54098cac1d846e04af61ffe" exitCode=0 Oct 30 22:05:34.721612 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:34.721459 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" event={"ID":"8113f4de-b914-4522-92ee-bdee65eaa8bb","Type":"ContainerDied","Data":"5b92e6287fe907957acf0511ae2a6f319a23e486c54098cac1d846e04af61ffe"} Oct 30 22:05:34.723295 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:34.723275 7307 generic.go:356] "Generic (PLEG): container finished" podID="9a028a1b-ec69-435f-b120-d12c5074312b" containerID="adf132061d1a41146465d3fab9e934e43f6d5460a91c3692049c1ccb77479336" exitCode=0 Oct 30 22:05:34.723428 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:34.723335 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" event={"ID":"9a028a1b-ec69-435f-b120-d12c5074312b","Type":"ContainerDied","Data":"adf132061d1a41146465d3fab9e934e43f6d5460a91c3692049c1ccb77479336"} Oct 30 22:05:35.232653 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:35.232601 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" podUID="9a028a1b-ec69-435f-b120-d12c5074312b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.24:8643/healthz\": dial tcp 10.133.0.24:8643: connect: connection refused" Oct 30 22:05:35.924114 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:35.924062 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Oct 30 22:05:38.605372 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.605349 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" Oct 30 22:05:38.717958 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.717873 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9a028a1b-ec69-435f-b120-d12c5074312b-kube-api-access-ltjkb\" (UniqueName: \"kubernetes.io/projected/9a028a1b-ec69-435f-b120-d12c5074312b-kube-api-access-ltjkb\") pod \"9a028a1b-ec69-435f-b120-d12c5074312b\" (UID: \"9a028a1b-ec69-435f-b120-d12c5074312b\") " Oct 30 22:05:38.717958 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.717923 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9a028a1b-ec69-435f-b120-d12c5074312b-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9a028a1b-ec69-435f-b120-d12c5074312b-cabundle-cert\") pod \"9a028a1b-ec69-435f-b120-d12c5074312b\" (UID: \"9a028a1b-ec69-435f-b120-d12c5074312b\") " Oct 30 22:05:38.718141 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.718076 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a028a1b-ec69-435f-b120-d12c5074312b-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9a028a1b-ec69-435f-b120-d12c5074312b-kserve-provision-location\") pod \"9a028a1b-ec69-435f-b120-d12c5074312b\" (UID: \"9a028a1b-ec69-435f-b120-d12c5074312b\") " Oct 30 22:05:38.718184 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.718154 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9a028a1b-ec69-435f-b120-d12c5074312b-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9a028a1b-ec69-435f-b120-d12c5074312b-kube-rbac-proxy-sar-config\") pod \"9a028a1b-ec69-435f-b120-d12c5074312b\" (UID: \"9a028a1b-ec69-435f-b120-d12c5074312b\") " Oct 30 22:05:38.718236 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.718189 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9a028a1b-ec69-435f-b120-d12c5074312b-proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a028a1b-ec69-435f-b120-d12c5074312b-proxy-tls\") pod \"9a028a1b-ec69-435f-b120-d12c5074312b\" (UID: \"9a028a1b-ec69-435f-b120-d12c5074312b\") " Oct 30 22:05:38.718335 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.718313 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a028a1b-ec69-435f-b120-d12c5074312b-cabundle-cert" pod "9a028a1b-ec69-435f-b120-d12c5074312b" (UID: "9a028a1b-ec69-435f-b120-d12c5074312b"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:05:38.718451 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.718358 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a028a1b-ec69-435f-b120-d12c5074312b-kserve-provision-location" pod "9a028a1b-ec69-435f-b120-d12c5074312b" (UID: "9a028a1b-ec69-435f-b120-d12c5074312b"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:05:38.718538 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.718514 7307 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9a028a1b-ec69-435f-b120-d12c5074312b-cabundle-cert\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:05:38.718538 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.718529 7307 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9a028a1b-ec69-435f-b120-d12c5074312b-kserve-provision-location\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:05:38.718632 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.718563 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a028a1b-ec69-435f-b120-d12c5074312b-kube-rbac-proxy-sar-config" pod "9a028a1b-ec69-435f-b120-d12c5074312b" (UID: "9a028a1b-ec69-435f-b120-d12c5074312b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:05:38.720206 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.720183 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a028a1b-ec69-435f-b120-d12c5074312b-kube-api-access-ltjkb" pod "9a028a1b-ec69-435f-b120-d12c5074312b" (UID: "9a028a1b-ec69-435f-b120-d12c5074312b"). InnerVolumeSpecName "kube-api-access-ltjkb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:05:38.720290 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.720261 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a028a1b-ec69-435f-b120-d12c5074312b-proxy-tls" pod "9a028a1b-ec69-435f-b120-d12c5074312b" (UID: "9a028a1b-ec69-435f-b120-d12c5074312b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:05:38.741671 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.741635 7307 generic.go:356] "Generic (PLEG): container finished" podID="9a028a1b-ec69-435f-b120-d12c5074312b" containerID="19299d11875ae0662c46eeaacb82c7d32dcf0d3472471e35433457a5e0444996" exitCode=0 Oct 30 22:05:38.741817 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.741693 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" Oct 30 22:05:38.741817 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.741711 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" event={"ID":"9a028a1b-ec69-435f-b120-d12c5074312b","Type":"ContainerDied","Data":"19299d11875ae0662c46eeaacb82c7d32dcf0d3472471e35433457a5e0444996"} Oct 30 22:05:38.741817 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.741800 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2" event={"ID":"9a028a1b-ec69-435f-b120-d12c5074312b","Type":"ContainerDied","Data":"dc3fc5315a2419d1b208cd03c5bf448d7e63e7379288d6da4fb11de1c511ce81"} Oct 30 22:05:38.741916 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.741827 7307 scope.go:122] "RemoveContainer" containerID="adf132061d1a41146465d3fab9e934e43f6d5460a91c3692049c1ccb77479336" Oct 30 22:05:38.750042 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.750015 7307 scope.go:122] "RemoveContainer" containerID="19299d11875ae0662c46eeaacb82c7d32dcf0d3472471e35433457a5e0444996" Oct 30 22:05:38.757600 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.757583 7307 scope.go:122] "RemoveContainer" containerID="c751b859b653c468fdabf22fc4011039592b12e1e4299926524e4f32ad29f8a3" Oct 30 22:05:38.764535 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.764517 7307 scope.go:122] "RemoveContainer" containerID="adf132061d1a41146465d3fab9e934e43f6d5460a91c3692049c1ccb77479336" Oct 30 22:05:38.764871 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:05:38.764835 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adf132061d1a41146465d3fab9e934e43f6d5460a91c3692049c1ccb77479336\": container with ID starting with adf132061d1a41146465d3fab9e934e43f6d5460a91c3692049c1ccb77479336 not found: ID does not exist" containerID="adf132061d1a41146465d3fab9e934e43f6d5460a91c3692049c1ccb77479336" Oct 30 22:05:38.765023 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.764885 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adf132061d1a41146465d3fab9e934e43f6d5460a91c3692049c1ccb77479336"} err="failed to get container status \"adf132061d1a41146465d3fab9e934e43f6d5460a91c3692049c1ccb77479336\": rpc error: code = NotFound desc = could not find container \"adf132061d1a41146465d3fab9e934e43f6d5460a91c3692049c1ccb77479336\": container with ID starting with adf132061d1a41146465d3fab9e934e43f6d5460a91c3692049c1ccb77479336 not found: ID does not exist" Oct 30 22:05:38.765023 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.764909 7307 scope.go:122] "RemoveContainer" containerID="19299d11875ae0662c46eeaacb82c7d32dcf0d3472471e35433457a5e0444996" Oct 30 22:05:38.765447 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:05:38.765419 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19299d11875ae0662c46eeaacb82c7d32dcf0d3472471e35433457a5e0444996\": container with ID starting with 19299d11875ae0662c46eeaacb82c7d32dcf0d3472471e35433457a5e0444996 not found: ID does not exist" containerID="19299d11875ae0662c46eeaacb82c7d32dcf0d3472471e35433457a5e0444996" Oct 30 22:05:38.765547 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.765455 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19299d11875ae0662c46eeaacb82c7d32dcf0d3472471e35433457a5e0444996"} err="failed to get container status \"19299d11875ae0662c46eeaacb82c7d32dcf0d3472471e35433457a5e0444996\": rpc error: code = NotFound desc = could not find container \"19299d11875ae0662c46eeaacb82c7d32dcf0d3472471e35433457a5e0444996\": container with ID starting with 19299d11875ae0662c46eeaacb82c7d32dcf0d3472471e35433457a5e0444996 not found: ID does not exist" Oct 30 22:05:38.765547 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.765477 7307 scope.go:122] "RemoveContainer" containerID="c751b859b653c468fdabf22fc4011039592b12e1e4299926524e4f32ad29f8a3" Oct 30 22:05:38.765779 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:05:38.765760 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c751b859b653c468fdabf22fc4011039592b12e1e4299926524e4f32ad29f8a3\": container with ID starting with c751b859b653c468fdabf22fc4011039592b12e1e4299926524e4f32ad29f8a3 not found: ID does not exist" containerID="c751b859b653c468fdabf22fc4011039592b12e1e4299926524e4f32ad29f8a3" Oct 30 22:05:38.765828 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.765787 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c751b859b653c468fdabf22fc4011039592b12e1e4299926524e4f32ad29f8a3"} err="failed to get container status \"c751b859b653c468fdabf22fc4011039592b12e1e4299926524e4f32ad29f8a3\": rpc error: code = NotFound desc = could not find container \"c751b859b653c468fdabf22fc4011039592b12e1e4299926524e4f32ad29f8a3\": container with ID starting with c751b859b653c468fdabf22fc4011039592b12e1e4299926524e4f32ad29f8a3 not found: ID does not exist" Oct 30 22:05:38.766335 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.766318 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2"] Oct 30 22:05:38.768470 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.768450 7307 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-a3ce8b9d69/isvc-xgboost-graph-predictor-74db998dbd-gv7p2"] Oct 30 22:05:38.819640 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.819609 7307 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltjkb\" (UniqueName: \"kubernetes.io/projected/9a028a1b-ec69-435f-b120-d12c5074312b-kube-api-access-ltjkb\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:05:38.819640 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.819635 7307 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9a028a1b-ec69-435f-b120-d12c5074312b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:05:38.819835 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.819649 7307 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a028a1b-ec69-435f-b120-d12c5074312b-proxy-tls\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:05:38.929683 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:38.929644 7307 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9a028a1b-ec69-435f-b120-d12c5074312b" path="/var/lib/kubelet/pods/9a028a1b-ec69-435f-b120-d12c5074312b/volumes" Oct 30 22:05:39.203936 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.203895 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.23:8643/healthz\": dial tcp 10.133.0.23:8643: connect: connection refused" Oct 30 22:05:39.483676 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.483649 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" Oct 30 22:05:39.526482 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.526451 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8113f4de-b914-4522-92ee-bdee65eaa8bb-kube-api-access-qj8hk\" (UniqueName: \"kubernetes.io/projected/8113f4de-b914-4522-92ee-bdee65eaa8bb-kube-api-access-qj8hk\") pod \"8113f4de-b914-4522-92ee-bdee65eaa8bb\" (UID: \"8113f4de-b914-4522-92ee-bdee65eaa8bb\") " Oct 30 22:05:39.526482 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.526490 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8113f4de-b914-4522-92ee-bdee65eaa8bb-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8113f4de-b914-4522-92ee-bdee65eaa8bb-cabundle-cert\") pod \"8113f4de-b914-4522-92ee-bdee65eaa8bb\" (UID: \"8113f4de-b914-4522-92ee-bdee65eaa8bb\") " Oct 30 22:05:39.526706 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.526686 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8113f4de-b914-4522-92ee-bdee65eaa8bb-proxy-tls\" (UniqueName: \"kubernetes.io/secret/8113f4de-b914-4522-92ee-bdee65eaa8bb-proxy-tls\") pod \"8113f4de-b914-4522-92ee-bdee65eaa8bb\" (UID: \"8113f4de-b914-4522-92ee-bdee65eaa8bb\") " Oct 30 22:05:39.526776 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.526760 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8113f4de-b914-4522-92ee-bdee65eaa8bb-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8113f4de-b914-4522-92ee-bdee65eaa8bb-kserve-provision-location\") pod \"8113f4de-b914-4522-92ee-bdee65eaa8bb\" (UID: \"8113f4de-b914-4522-92ee-bdee65eaa8bb\") " Oct 30 22:05:39.526830 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.526800 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8113f4de-b914-4522-92ee-bdee65eaa8bb-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8113f4de-b914-4522-92ee-bdee65eaa8bb-kube-rbac-proxy-sar-config\") pod \"8113f4de-b914-4522-92ee-bdee65eaa8bb\" (UID: \"8113f4de-b914-4522-92ee-bdee65eaa8bb\") " Oct 30 22:05:39.526896 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.526865 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8113f4de-b914-4522-92ee-bdee65eaa8bb-cabundle-cert" pod "8113f4de-b914-4522-92ee-bdee65eaa8bb" (UID: "8113f4de-b914-4522-92ee-bdee65eaa8bb"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:05:39.527118 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.527095 7307 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8113f4de-b914-4522-92ee-bdee65eaa8bb-cabundle-cert\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:05:39.527118 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.527088 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8113f4de-b914-4522-92ee-bdee65eaa8bb-kserve-provision-location" pod "8113f4de-b914-4522-92ee-bdee65eaa8bb" (UID: "8113f4de-b914-4522-92ee-bdee65eaa8bb"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:05:39.527372 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.527354 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8113f4de-b914-4522-92ee-bdee65eaa8bb-kube-rbac-proxy-sar-config" pod "8113f4de-b914-4522-92ee-bdee65eaa8bb" (UID: "8113f4de-b914-4522-92ee-bdee65eaa8bb"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:05:39.528694 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.528669 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8113f4de-b914-4522-92ee-bdee65eaa8bb-kube-api-access-qj8hk" pod "8113f4de-b914-4522-92ee-bdee65eaa8bb" (UID: "8113f4de-b914-4522-92ee-bdee65eaa8bb"). InnerVolumeSpecName "kube-api-access-qj8hk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:05:39.528780 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.528742 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8113f4de-b914-4522-92ee-bdee65eaa8bb-proxy-tls" pod "8113f4de-b914-4522-92ee-bdee65eaa8bb" (UID: "8113f4de-b914-4522-92ee-bdee65eaa8bb"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:05:39.628026 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.627989 7307 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qj8hk\" (UniqueName: \"kubernetes.io/projected/8113f4de-b914-4522-92ee-bdee65eaa8bb-kube-api-access-qj8hk\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:05:39.628026 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.628022 7307 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8113f4de-b914-4522-92ee-bdee65eaa8bb-proxy-tls\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:05:39.628026 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.628035 7307 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8113f4de-b914-4522-92ee-bdee65eaa8bb-kserve-provision-location\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:05:39.628491 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.628050 7307 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8113f4de-b914-4522-92ee-bdee65eaa8bb-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:05:39.747819 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.747735 7307 generic.go:356] "Generic (PLEG): container finished" podID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerID="2d055f83252e147cf19cfb28878e2a9b731b580287657d6ca7504829225352a8" exitCode=0 Oct 30 22:05:39.747819 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.747803 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" Oct 30 22:05:39.748015 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.747823 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" event={"ID":"8113f4de-b914-4522-92ee-bdee65eaa8bb","Type":"ContainerDied","Data":"2d055f83252e147cf19cfb28878e2a9b731b580287657d6ca7504829225352a8"} Oct 30 22:05:39.748015 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.747894 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj" event={"ID":"8113f4de-b914-4522-92ee-bdee65eaa8bb","Type":"ContainerDied","Data":"8246a280943fff0d1042b2ea6f2f8975c227929f12222ce8c11378a034b33737"} Oct 30 22:05:39.748015 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.747925 7307 scope.go:122] "RemoveContainer" containerID="5b92e6287fe907957acf0511ae2a6f319a23e486c54098cac1d846e04af61ffe" Oct 30 22:05:39.756362 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.756342 7307 scope.go:122] "RemoveContainer" containerID="2d055f83252e147cf19cfb28878e2a9b731b580287657d6ca7504829225352a8" Oct 30 22:05:39.765958 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.765935 7307 scope.go:122] "RemoveContainer" containerID="5de79a0f65ccee29dbdd3b45872238d914ccfbb4571631f44dd5026bd78603f8" Oct 30 22:05:39.772501 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.772475 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj"] Oct 30 22:05:39.774535 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.774518 7307 scope.go:122] "RemoveContainer" containerID="5b92e6287fe907957acf0511ae2a6f319a23e486c54098cac1d846e04af61ffe" Oct 30 22:05:39.774957 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:05:39.774938 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b92e6287fe907957acf0511ae2a6f319a23e486c54098cac1d846e04af61ffe\": container with ID starting with 5b92e6287fe907957acf0511ae2a6f319a23e486c54098cac1d846e04af61ffe not found: ID does not exist" containerID="5b92e6287fe907957acf0511ae2a6f319a23e486c54098cac1d846e04af61ffe" Oct 30 22:05:39.774999 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.774966 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b92e6287fe907957acf0511ae2a6f319a23e486c54098cac1d846e04af61ffe"} err="failed to get container status \"5b92e6287fe907957acf0511ae2a6f319a23e486c54098cac1d846e04af61ffe\": rpc error: code = NotFound desc = could not find container \"5b92e6287fe907957acf0511ae2a6f319a23e486c54098cac1d846e04af61ffe\": container with ID starting with 5b92e6287fe907957acf0511ae2a6f319a23e486c54098cac1d846e04af61ffe not found: ID does not exist" Oct 30 22:05:39.774999 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.774986 7307 scope.go:122] "RemoveContainer" containerID="2d055f83252e147cf19cfb28878e2a9b731b580287657d6ca7504829225352a8" Oct 30 22:05:39.775256 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:05:39.775238 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d055f83252e147cf19cfb28878e2a9b731b580287657d6ca7504829225352a8\": container with ID starting with 2d055f83252e147cf19cfb28878e2a9b731b580287657d6ca7504829225352a8 not found: ID does not exist" containerID="2d055f83252e147cf19cfb28878e2a9b731b580287657d6ca7504829225352a8" Oct 30 22:05:39.775309 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.775262 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d055f83252e147cf19cfb28878e2a9b731b580287657d6ca7504829225352a8"} err="failed to get container status \"2d055f83252e147cf19cfb28878e2a9b731b580287657d6ca7504829225352a8\": rpc error: code = NotFound desc = could not find container \"2d055f83252e147cf19cfb28878e2a9b731b580287657d6ca7504829225352a8\": container with ID starting with 2d055f83252e147cf19cfb28878e2a9b731b580287657d6ca7504829225352a8 not found: ID does not exist" Oct 30 22:05:39.775309 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.775279 7307 scope.go:122] "RemoveContainer" containerID="5de79a0f65ccee29dbdd3b45872238d914ccfbb4571631f44dd5026bd78603f8" Oct 30 22:05:39.775543 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:05:39.775528 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5de79a0f65ccee29dbdd3b45872238d914ccfbb4571631f44dd5026bd78603f8\": container with ID starting with 5de79a0f65ccee29dbdd3b45872238d914ccfbb4571631f44dd5026bd78603f8 not found: ID does not exist" containerID="5de79a0f65ccee29dbdd3b45872238d914ccfbb4571631f44dd5026bd78603f8" Oct 30 22:05:39.775601 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.775544 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5de79a0f65ccee29dbdd3b45872238d914ccfbb4571631f44dd5026bd78603f8"} err="failed to get container status \"5de79a0f65ccee29dbdd3b45872238d914ccfbb4571631f44dd5026bd78603f8\": rpc error: code = NotFound desc = could not find container \"5de79a0f65ccee29dbdd3b45872238d914ccfbb4571631f44dd5026bd78603f8\": container with ID starting with 5de79a0f65ccee29dbdd3b45872238d914ccfbb4571631f44dd5026bd78603f8 not found: ID does not exist" Oct 30 22:05:39.779676 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:39.779654 7307 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-a3ce8b9d69/isvc-sklearn-graph-1-predictor-5fb958cf9f-v8qlj"] Oct 30 22:05:40.573123 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:40.573084 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" podUID="30824715-02da-4fa0-89f1-3b6c7c4f0e01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:05:40.935895 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:40.935858 7307 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" path="/var/lib/kubelet/pods/8113f4de-b914-4522-92ee-bdee65eaa8bb/volumes" Oct 30 22:05:41.803910 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.803876 7307 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm"] Oct 30 22:05:41.804224 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.804211 7307 cpu_manager.go:414] "containerMap: removing container" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="storage-initializer" Oct 30 22:05:41.804267 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.804226 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="storage-initializer" Oct 30 22:05:41.804267 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.804241 7307 cpu_manager.go:414] "containerMap: removing container" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="kserve-container" Oct 30 22:05:41.804267 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.804246 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="kserve-container" Oct 30 22:05:41.804267 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.804254 7307 cpu_manager.go:414] "containerMap: removing container" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="kube-rbac-proxy" Oct 30 22:05:41.804267 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.804259 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="kube-rbac-proxy" Oct 30 22:05:41.804460 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.804270 7307 cpu_manager.go:414] "containerMap: removing container" podUID="9a028a1b-ec69-435f-b120-d12c5074312b" containerName="storage-initializer" Oct 30 22:05:41.804460 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.804275 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9a028a1b-ec69-435f-b120-d12c5074312b" containerName="storage-initializer" Oct 30 22:05:41.804460 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.804284 7307 cpu_manager.go:414] "containerMap: removing container" podUID="9a028a1b-ec69-435f-b120-d12c5074312b" containerName="kserve-container" Oct 30 22:05:41.804460 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.804289 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9a028a1b-ec69-435f-b120-d12c5074312b" containerName="kserve-container" Oct 30 22:05:41.804460 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.804306 7307 cpu_manager.go:414] "containerMap: removing container" podUID="9a028a1b-ec69-435f-b120-d12c5074312b" containerName="kube-rbac-proxy" Oct 30 22:05:41.804460 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.804310 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9a028a1b-ec69-435f-b120-d12c5074312b" containerName="kube-rbac-proxy" Oct 30 22:05:41.804460 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.804355 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="9a028a1b-ec69-435f-b120-d12c5074312b" containerName="kserve-container" Oct 30 22:05:41.804460 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.804364 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="9a028a1b-ec69-435f-b120-d12c5074312b" containerName="kube-rbac-proxy" Oct 30 22:05:41.804460 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.804372 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="kserve-container" Oct 30 22:05:41.804460 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.804393 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="8113f4de-b914-4522-92ee-bdee65eaa8bb" containerName="kube-rbac-proxy" Oct 30 22:05:41.808860 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.808840 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" Oct 30 22:05:41.813169 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.813148 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"kube-root-ca.crt\"" Oct 30 22:05:41.813169 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.813148 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"error-404-isvc-e9913-kube-rbac-proxy-sar-config\"" Oct 30 22:05:41.818080 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.818052 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"error-404-isvc-e9913-predictor-serving-cert\"" Oct 30 22:05:41.819505 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.819480 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm"] Oct 30 22:05:41.819619 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.819596 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"default-dockercfg-kk2z5\"" Oct 30 22:05:41.846202 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.846167 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg22g\" (UniqueName: \"kubernetes.io/projected/f14fe42d-bc52-4d5b-a918-04b2ccc30018-kube-api-access-wg22g\") pod \"error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm\" (UID: \"f14fe42d-bc52-4d5b-a918-04b2ccc30018\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" Oct 30 22:05:41.846202 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.846210 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f14fe42d-bc52-4d5b-a918-04b2ccc30018-proxy-tls\") pod \"error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm\" (UID: \"f14fe42d-bc52-4d5b-a918-04b2ccc30018\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" Oct 30 22:05:41.846479 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.846232 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f14fe42d-bc52-4d5b-a918-04b2ccc30018-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm\" (UID: \"f14fe42d-bc52-4d5b-a918-04b2ccc30018\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" Oct 30 22:05:41.914137 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.914102 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"openshift-service-ca.crt\"" Oct 30 22:05:41.947284 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.947242 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg22g\" (UniqueName: \"kubernetes.io/projected/f14fe42d-bc52-4d5b-a918-04b2ccc30018-kube-api-access-wg22g\") pod \"error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm\" (UID: \"f14fe42d-bc52-4d5b-a918-04b2ccc30018\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" Oct 30 22:05:41.947877 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.947307 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f14fe42d-bc52-4d5b-a918-04b2ccc30018-proxy-tls\") pod \"error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm\" (UID: \"f14fe42d-bc52-4d5b-a918-04b2ccc30018\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" Oct 30 22:05:41.947877 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.947357 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f14fe42d-bc52-4d5b-a918-04b2ccc30018-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm\" (UID: \"f14fe42d-bc52-4d5b-a918-04b2ccc30018\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" Oct 30 22:05:41.948208 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.948187 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f14fe42d-bc52-4d5b-a918-04b2ccc30018-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm\" (UID: \"f14fe42d-bc52-4d5b-a918-04b2ccc30018\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" Oct 30 22:05:41.950054 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.950029 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f14fe42d-bc52-4d5b-a918-04b2ccc30018-proxy-tls\") pod \"error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm\" (UID: \"f14fe42d-bc52-4d5b-a918-04b2ccc30018\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" Oct 30 22:05:41.962793 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:41.962774 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg22g\" (UniqueName: \"kubernetes.io/projected/f14fe42d-bc52-4d5b-a918-04b2ccc30018-kube-api-access-wg22g\") pod \"error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm\" (UID: \"f14fe42d-bc52-4d5b-a918-04b2ccc30018\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" Oct 30 22:05:42.124269 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:42.124237 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" Oct 30 22:05:42.397631 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:42.397553 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm"] Oct 30 22:05:42.400907 ip-10-0-137-4 kubenswrapper[7307]: W1030 22:05:42.400871 7307 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf14fe42d_bc52_4d5b_a918_04b2ccc30018.slice/crio-8476be294d62b0bd0b13422b56a1dac944748504baee3362134f5c757deb725c WatchSource:0}: Error finding container 8476be294d62b0bd0b13422b56a1dac944748504baee3362134f5c757deb725c: Status 404 returned error can't find the container with id 8476be294d62b0bd0b13422b56a1dac944748504baee3362134f5c757deb725c Oct 30 22:05:42.762753 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:42.762668 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" event={"ID":"f14fe42d-bc52-4d5b-a918-04b2ccc30018","Type":"ContainerStarted","Data":"dc0ca934ac6b290aa8a4297ee0abaa61b4ae73cf6067727d3fd6dad1fe0253be"} Oct 30 22:05:42.762753 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:42.762726 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" event={"ID":"f14fe42d-bc52-4d5b-a918-04b2ccc30018","Type":"ContainerStarted","Data":"e37fae3ab6409a2fec0982d79430446d1c7704f73587a28e2f2453ca0e45303b"} Oct 30 22:05:42.762753 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:42.762751 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" event={"ID":"f14fe42d-bc52-4d5b-a918-04b2ccc30018","Type":"ContainerStarted","Data":"8476be294d62b0bd0b13422b56a1dac944748504baee3362134f5c757deb725c"} Oct 30 22:05:42.762983 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:42.762777 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" Oct 30 22:05:42.785973 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:42.785923 7307 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" podStartSLOduration=1.7859068809999998 podStartE2EDuration="1.785906881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:05:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:05:42.784164456 +0000 UTC m=+695.985536684" watchObservedRunningTime="2026-10-30 22:05:42.785906881 +0000 UTC m=+695.987279060" Oct 30 22:05:43.767700 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:43.767667 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" Oct 30 22:05:43.768910 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:43.768885 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" podUID="f14fe42d-bc52-4d5b-a918-04b2ccc30018" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 30 22:05:44.275108 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:05:44.275071 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:05:44.772073 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:44.772033 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" podUID="f14fe42d-bc52-4d5b-a918-04b2ccc30018" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 30 22:05:49.776947 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:49.776917 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" Oct 30 22:05:49.777474 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:49.777448 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" podUID="f14fe42d-bc52-4d5b-a918-04b2ccc30018" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 30 22:05:50.574084 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:50.574049 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" Oct 30 22:05:59.777830 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:05:59.777788 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" podUID="f14fe42d-bc52-4d5b-a918-04b2ccc30018" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 30 22:06:09.778298 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:06:09.778255 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" podUID="f14fe42d-bc52-4d5b-a918-04b2ccc30018" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 30 22:06:14.274950 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:06:14.274909 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:06:19.778430 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:06:19.778335 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" podUID="f14fe42d-bc52-4d5b-a918-04b2ccc30018" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 30 22:06:29.778187 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:06:29.778141 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" podUID="f14fe42d-bc52-4d5b-a918-04b2ccc30018" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 30 22:06:39.778394 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:06:39.778352 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" Oct 30 22:06:44.273839 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:06:44.273807 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:07:14.274024 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:07:14.273968 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:07:44.274208 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:07:44.274172 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:08:14.273451 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:08:14.273414 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:08:44.272272 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:08:44.272228 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:09:14.273572 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:09:14.273535 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:09:44.274099 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:09:44.274051 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:10:14.273676 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:10:14.273635 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:10:44.273769 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:10:44.273731 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:11:14.274543 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:11:14.274463 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:11:44.273178 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:11:44.273142 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:12:14.279437 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:12:14.279400 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:12:44.274189 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:12:44.274153 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:13:14.274480 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:13:14.274432 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:13:44.274031 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:13:44.273921 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:14:14.273960 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:14:14.273877 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:14:19.398833 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:19.398796 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt"] Oct 30 22:14:19.399446 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:19.399051 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" podUID="30824715-02da-4fa0-89f1-3b6c7c4f0e01" containerName="kserve-container" containerID="cri-o://6a7f2e3d56965544c2bff9c4492b77069874bdc534b2de9ed0655d6685c7077b" gracePeriod=30 Oct 30 22:14:19.399446 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:19.399085 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" podUID="30824715-02da-4fa0-89f1-3b6c7c4f0e01" containerName="kube-rbac-proxy" containerID="cri-o://3d22449837e95b194759c378deb065dce17f81c853ffce0b99705589d2e2332e" gracePeriod=30 Oct 30 22:14:19.710288 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:19.710191 7307 generic.go:356] "Generic (PLEG): container finished" podID="30824715-02da-4fa0-89f1-3b6c7c4f0e01" containerID="3d22449837e95b194759c378deb065dce17f81c853ffce0b99705589d2e2332e" exitCode=0 Oct 30 22:14:19.710288 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:19.710270 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" event={"ID":"30824715-02da-4fa0-89f1-3b6c7c4f0e01","Type":"ContainerDied","Data":"3d22449837e95b194759c378deb065dce17f81c853ffce0b99705589d2e2332e"} Oct 30 22:14:20.567525 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:20.567487 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" podUID="30824715-02da-4fa0-89f1-3b6c7c4f0e01" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.26:8643/healthz\": dial tcp 10.133.0.26:8643: connect: connection refused" Oct 30 22:14:20.572830 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:20.572801 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" podUID="30824715-02da-4fa0-89f1-3b6c7c4f0e01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:14:23.035418 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:23.035392 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" Oct 30 22:14:23.174890 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:23.174851 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/30824715-02da-4fa0-89f1-3b6c7c4f0e01-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/30824715-02da-4fa0-89f1-3b6c7c4f0e01-kube-rbac-proxy-sar-config\") pod \"30824715-02da-4fa0-89f1-3b6c7c4f0e01\" (UID: \"30824715-02da-4fa0-89f1-3b6c7c4f0e01\") " Oct 30 22:14:23.175089 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:23.174898 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/30824715-02da-4fa0-89f1-3b6c7c4f0e01-proxy-tls\" (UniqueName: \"kubernetes.io/secret/30824715-02da-4fa0-89f1-3b6c7c4f0e01-proxy-tls\") pod \"30824715-02da-4fa0-89f1-3b6c7c4f0e01\" (UID: \"30824715-02da-4fa0-89f1-3b6c7c4f0e01\") " Oct 30 22:14:23.175089 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:23.175024 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/30824715-02da-4fa0-89f1-3b6c7c4f0e01-kube-api-access-z5qtn\" (UniqueName: \"kubernetes.io/projected/30824715-02da-4fa0-89f1-3b6c7c4f0e01-kube-api-access-z5qtn\") pod \"30824715-02da-4fa0-89f1-3b6c7c4f0e01\" (UID: \"30824715-02da-4fa0-89f1-3b6c7c4f0e01\") " Oct 30 22:14:23.175245 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:23.175215 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30824715-02da-4fa0-89f1-3b6c7c4f0e01-kube-rbac-proxy-sar-config" pod "30824715-02da-4fa0-89f1-3b6c7c4f0e01" (UID: "30824715-02da-4fa0-89f1-3b6c7c4f0e01"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:14:23.175337 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:23.175320 7307 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/30824715-02da-4fa0-89f1-3b6c7c4f0e01-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:14:23.177134 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:23.177099 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30824715-02da-4fa0-89f1-3b6c7c4f0e01-proxy-tls" pod "30824715-02da-4fa0-89f1-3b6c7c4f0e01" (UID: "30824715-02da-4fa0-89f1-3b6c7c4f0e01"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:14:23.177134 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:23.177109 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30824715-02da-4fa0-89f1-3b6c7c4f0e01-kube-api-access-z5qtn" pod "30824715-02da-4fa0-89f1-3b6c7c4f0e01" (UID: "30824715-02da-4fa0-89f1-3b6c7c4f0e01"). InnerVolumeSpecName "kube-api-access-z5qtn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:14:23.276388 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:23.276338 7307 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5qtn\" (UniqueName: \"kubernetes.io/projected/30824715-02da-4fa0-89f1-3b6c7c4f0e01-kube-api-access-z5qtn\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:14:23.276388 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:23.276369 7307 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/30824715-02da-4fa0-89f1-3b6c7c4f0e01-proxy-tls\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:14:23.725315 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:23.725271 7307 generic.go:356] "Generic (PLEG): container finished" podID="30824715-02da-4fa0-89f1-3b6c7c4f0e01" containerID="6a7f2e3d56965544c2bff9c4492b77069874bdc534b2de9ed0655d6685c7077b" exitCode=0 Oct 30 22:14:23.725506 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:23.725349 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" Oct 30 22:14:23.725506 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:23.725356 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" event={"ID":"30824715-02da-4fa0-89f1-3b6c7c4f0e01","Type":"ContainerDied","Data":"6a7f2e3d56965544c2bff9c4492b77069874bdc534b2de9ed0655d6685c7077b"} Oct 30 22:14:23.725506 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:23.725462 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt" event={"ID":"30824715-02da-4fa0-89f1-3b6c7c4f0e01","Type":"ContainerDied","Data":"f39fbfb1c992c20a6a3fbd6e310bc96e259d427ee2e8183c68622cde9213e1bf"} Oct 30 22:14:23.725506 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:23.725490 7307 scope.go:122] "RemoveContainer" containerID="3d22449837e95b194759c378deb065dce17f81c853ffce0b99705589d2e2332e" Oct 30 22:14:23.734143 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:23.734125 7307 scope.go:122] "RemoveContainer" containerID="6a7f2e3d56965544c2bff9c4492b77069874bdc534b2de9ed0655d6685c7077b" Oct 30 22:14:23.741767 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:23.741749 7307 scope.go:122] "RemoveContainer" containerID="3d22449837e95b194759c378deb065dce17f81c853ffce0b99705589d2e2332e" Oct 30 22:14:23.742036 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:14:23.742013 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d22449837e95b194759c378deb065dce17f81c853ffce0b99705589d2e2332e\": container with ID starting with 3d22449837e95b194759c378deb065dce17f81c853ffce0b99705589d2e2332e not found: ID does not exist" containerID="3d22449837e95b194759c378deb065dce17f81c853ffce0b99705589d2e2332e" Oct 30 22:14:23.742081 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:23.742047 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d22449837e95b194759c378deb065dce17f81c853ffce0b99705589d2e2332e"} err="failed to get container status \"3d22449837e95b194759c378deb065dce17f81c853ffce0b99705589d2e2332e\": rpc error: code = NotFound desc = could not find container \"3d22449837e95b194759c378deb065dce17f81c853ffce0b99705589d2e2332e\": container with ID starting with 3d22449837e95b194759c378deb065dce17f81c853ffce0b99705589d2e2332e not found: ID does not exist" Oct 30 22:14:23.742081 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:23.742065 7307 scope.go:122] "RemoveContainer" containerID="6a7f2e3d56965544c2bff9c4492b77069874bdc534b2de9ed0655d6685c7077b" Oct 30 22:14:23.742295 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:14:23.742275 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a7f2e3d56965544c2bff9c4492b77069874bdc534b2de9ed0655d6685c7077b\": container with ID starting with 6a7f2e3d56965544c2bff9c4492b77069874bdc534b2de9ed0655d6685c7077b not found: ID does not exist" containerID="6a7f2e3d56965544c2bff9c4492b77069874bdc534b2de9ed0655d6685c7077b" Oct 30 22:14:23.742354 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:23.742306 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a7f2e3d56965544c2bff9c4492b77069874bdc534b2de9ed0655d6685c7077b"} err="failed to get container status \"6a7f2e3d56965544c2bff9c4492b77069874bdc534b2de9ed0655d6685c7077b\": rpc error: code = NotFound desc = could not find container \"6a7f2e3d56965544c2bff9c4492b77069874bdc534b2de9ed0655d6685c7077b\": container with ID starting with 6a7f2e3d56965544c2bff9c4492b77069874bdc534b2de9ed0655d6685c7077b not found: ID does not exist" Oct 30 22:14:23.748176 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:23.748154 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt"] Oct 30 22:14:23.752281 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:23.752260 7307 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-3c7da-predictor-76ff89dfc7-hv7dt"] Oct 30 22:14:24.929244 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:24.929206 7307 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="30824715-02da-4fa0-89f1-3b6c7c4f0e01" path="/var/lib/kubelet/pods/30824715-02da-4fa0-89f1-3b6c7c4f0e01/volumes" Oct 30 22:14:24.989491 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:24.989462 7307 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx"] Oct 30 22:14:24.989822 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:24.989786 7307 cpu_manager.go:414] "containerMap: removing container" podUID="30824715-02da-4fa0-89f1-3b6c7c4f0e01" containerName="kserve-container" Oct 30 22:14:24.989822 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:24.989800 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="30824715-02da-4fa0-89f1-3b6c7c4f0e01" containerName="kserve-container" Oct 30 22:14:24.989904 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:24.989829 7307 cpu_manager.go:414] "containerMap: removing container" podUID="30824715-02da-4fa0-89f1-3b6c7c4f0e01" containerName="kube-rbac-proxy" Oct 30 22:14:24.989904 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:24.989835 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="30824715-02da-4fa0-89f1-3b6c7c4f0e01" containerName="kube-rbac-proxy" Oct 30 22:14:24.989904 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:24.989884 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="30824715-02da-4fa0-89f1-3b6c7c4f0e01" containerName="kserve-container" Oct 30 22:14:24.989904 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:24.989896 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="30824715-02da-4fa0-89f1-3b6c7c4f0e01" containerName="kube-rbac-proxy" Oct 30 22:14:24.993157 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:24.993140 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" Oct 30 22:14:24.999878 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:24.999632 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"kube-root-ca.crt\"" Oct 30 22:14:24.999878 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:24.999832 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"openshift-service-ca.crt\"" Oct 30 22:14:24.999878 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:24.999872 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"error-404-isvc-08888-kube-rbac-proxy-sar-config\"" Oct 30 22:14:25.000003 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:24.999929 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-36e5afb065\"/\"error-404-isvc-08888-predictor-serving-cert\"" Oct 30 22:14:25.000003 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:24.999996 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-36e5afb065\"/\"default-dockercfg-jlnw5\"" Oct 30 22:14:25.004367 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:25.004342 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx"] Oct 30 22:14:25.090181 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:25.090148 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3d13661a-f964-4c64-88a9-07e326f509ad-proxy-tls\") pod \"error-404-isvc-08888-predictor-6857cd4fc7-4vhqx\" (UID: \"3d13661a-f964-4c64-88a9-07e326f509ad\") " pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" Oct 30 22:14:25.090358 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:25.090329 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3d13661a-f964-4c64-88a9-07e326f509ad-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-08888-predictor-6857cd4fc7-4vhqx\" (UID: \"3d13661a-f964-4c64-88a9-07e326f509ad\") " pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" Oct 30 22:14:25.090461 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:25.090441 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff42h\" (UniqueName: \"kubernetes.io/projected/3d13661a-f964-4c64-88a9-07e326f509ad-kube-api-access-ff42h\") pod \"error-404-isvc-08888-predictor-6857cd4fc7-4vhqx\" (UID: \"3d13661a-f964-4c64-88a9-07e326f509ad\") " pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" Oct 30 22:14:25.191700 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:25.191611 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3d13661a-f964-4c64-88a9-07e326f509ad-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-08888-predictor-6857cd4fc7-4vhqx\" (UID: \"3d13661a-f964-4c64-88a9-07e326f509ad\") " pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" Oct 30 22:14:25.191700 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:25.191653 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff42h\" (UniqueName: \"kubernetes.io/projected/3d13661a-f964-4c64-88a9-07e326f509ad-kube-api-access-ff42h\") pod \"error-404-isvc-08888-predictor-6857cd4fc7-4vhqx\" (UID: \"3d13661a-f964-4c64-88a9-07e326f509ad\") " pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" Oct 30 22:14:25.191700 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:25.191702 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3d13661a-f964-4c64-88a9-07e326f509ad-proxy-tls\") pod \"error-404-isvc-08888-predictor-6857cd4fc7-4vhqx\" (UID: \"3d13661a-f964-4c64-88a9-07e326f509ad\") " pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" Oct 30 22:14:25.192261 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:25.192241 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3d13661a-f964-4c64-88a9-07e326f509ad-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-08888-predictor-6857cd4fc7-4vhqx\" (UID: \"3d13661a-f964-4c64-88a9-07e326f509ad\") " pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" Oct 30 22:14:25.194159 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:25.194136 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3d13661a-f964-4c64-88a9-07e326f509ad-proxy-tls\") pod \"error-404-isvc-08888-predictor-6857cd4fc7-4vhqx\" (UID: \"3d13661a-f964-4c64-88a9-07e326f509ad\") " pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" Oct 30 22:14:25.207234 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:25.207209 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff42h\" (UniqueName: \"kubernetes.io/projected/3d13661a-f964-4c64-88a9-07e326f509ad-kube-api-access-ff42h\") pod \"error-404-isvc-08888-predictor-6857cd4fc7-4vhqx\" (UID: \"3d13661a-f964-4c64-88a9-07e326f509ad\") " pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" Oct 30 22:14:25.308077 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:25.308046 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" Oct 30 22:14:25.585409 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:25.585296 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx"] Oct 30 22:14:25.588116 ip-10-0-137-4 kubenswrapper[7307]: W1030 22:14:25.588087 7307 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d13661a_f964_4c64_88a9_07e326f509ad.slice/crio-6b29c7330d0a241a473d9fe0180e5841382a3fe2b6cf0a443bcc11e352adcae7 WatchSource:0}: Error finding container 6b29c7330d0a241a473d9fe0180e5841382a3fe2b6cf0a443bcc11e352adcae7: Status 404 returned error can't find the container with id 6b29c7330d0a241a473d9fe0180e5841382a3fe2b6cf0a443bcc11e352adcae7 Oct 30 22:14:25.737760 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:25.737721 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" event={"ID":"3d13661a-f964-4c64-88a9-07e326f509ad","Type":"ContainerStarted","Data":"2de5db95dd77624c2d3717dd119f819f2515526b6015ddb28160083525ae1f02"} Oct 30 22:14:25.737935 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:25.737783 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" event={"ID":"3d13661a-f964-4c64-88a9-07e326f509ad","Type":"ContainerStarted","Data":"ea7aeefaeefd3cdb032aa8a134a6842e1a46c534f0b4fdd0d5dee2e686bdf0a4"} Oct 30 22:14:25.737935 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:25.737805 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" event={"ID":"3d13661a-f964-4c64-88a9-07e326f509ad","Type":"ContainerStarted","Data":"6b29c7330d0a241a473d9fe0180e5841382a3fe2b6cf0a443bcc11e352adcae7"} Oct 30 22:14:25.737935 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:25.737878 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" Oct 30 22:14:25.760066 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:25.759996 7307 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" podStartSLOduration=1.7599828610000001 podStartE2EDuration="1.759982861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:14:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:14:25.758553747 +0000 UTC m=+1218.959925952" watchObservedRunningTime="2026-10-30 22:14:25.759982861 +0000 UTC m=+1218.961355061" Oct 30 22:14:26.741929 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:26.741887 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" Oct 30 22:14:26.743036 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:26.743016 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" podUID="3d13661a-f964-4c64-88a9-07e326f509ad" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:14:27.745651 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:27.745608 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" podUID="3d13661a-f964-4c64-88a9-07e326f509ad" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:14:32.750964 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:32.750935 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" Oct 30 22:14:32.751366 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:32.751311 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" podUID="3d13661a-f964-4c64-88a9-07e326f509ad" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:14:42.751465 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:42.751428 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" podUID="3d13661a-f964-4c64-88a9-07e326f509ad" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:14:44.274439 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:14:44.274402 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:14:52.751847 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:14:52.751803 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" podUID="3d13661a-f964-4c64-88a9-07e326f509ad" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:15:02.752258 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:02.752215 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" podUID="3d13661a-f964-4c64-88a9-07e326f509ad" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:15:07.748619 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:07.748583 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm"] Oct 30 22:15:07.749055 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:07.748867 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" podUID="f14fe42d-bc52-4d5b-a918-04b2ccc30018" containerName="kserve-container" containerID="cri-o://e37fae3ab6409a2fec0982d79430446d1c7704f73587a28e2f2453ca0e45303b" gracePeriod=30 Oct 30 22:15:07.749055 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:07.748909 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" podUID="f14fe42d-bc52-4d5b-a918-04b2ccc30018" containerName="kube-rbac-proxy" containerID="cri-o://dc0ca934ac6b290aa8a4297ee0abaa61b4ae73cf6067727d3fd6dad1fe0253be" gracePeriod=30 Oct 30 22:15:07.899461 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:07.899427 7307 generic.go:356] "Generic (PLEG): container finished" podID="f14fe42d-bc52-4d5b-a918-04b2ccc30018" containerID="dc0ca934ac6b290aa8a4297ee0abaa61b4ae73cf6067727d3fd6dad1fe0253be" exitCode=0 Oct 30 22:15:07.899617 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:07.899476 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" event={"ID":"f14fe42d-bc52-4d5b-a918-04b2ccc30018","Type":"ContainerDied","Data":"dc0ca934ac6b290aa8a4297ee0abaa61b4ae73cf6067727d3fd6dad1fe0253be"} Oct 30 22:15:09.772568 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:09.772527 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" podUID="f14fe42d-bc52-4d5b-a918-04b2ccc30018" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.27:8643/healthz\": dial tcp 10.133.0.27:8643: connect: connection refused" Oct 30 22:15:09.777912 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:09.777879 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" podUID="f14fe42d-bc52-4d5b-a918-04b2ccc30018" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 30 22:15:11.496302 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:11.496276 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" Oct 30 22:15:11.600481 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:11.600358 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f14fe42d-bc52-4d5b-a918-04b2ccc30018-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f14fe42d-bc52-4d5b-a918-04b2ccc30018-kube-rbac-proxy-sar-config\") pod \"f14fe42d-bc52-4d5b-a918-04b2ccc30018\" (UID: \"f14fe42d-bc52-4d5b-a918-04b2ccc30018\") " Oct 30 22:15:11.600658 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:11.600497 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f14fe42d-bc52-4d5b-a918-04b2ccc30018-proxy-tls\" (UniqueName: \"kubernetes.io/secret/f14fe42d-bc52-4d5b-a918-04b2ccc30018-proxy-tls\") pod \"f14fe42d-bc52-4d5b-a918-04b2ccc30018\" (UID: \"f14fe42d-bc52-4d5b-a918-04b2ccc30018\") " Oct 30 22:15:11.600658 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:11.600552 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f14fe42d-bc52-4d5b-a918-04b2ccc30018-kube-api-access-wg22g\" (UniqueName: \"kubernetes.io/projected/f14fe42d-bc52-4d5b-a918-04b2ccc30018-kube-api-access-wg22g\") pod \"f14fe42d-bc52-4d5b-a918-04b2ccc30018\" (UID: \"f14fe42d-bc52-4d5b-a918-04b2ccc30018\") " Oct 30 22:15:11.600786 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:11.600718 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f14fe42d-bc52-4d5b-a918-04b2ccc30018-kube-rbac-proxy-sar-config" pod "f14fe42d-bc52-4d5b-a918-04b2ccc30018" (UID: "f14fe42d-bc52-4d5b-a918-04b2ccc30018"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:15:11.602686 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:11.602651 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f14fe42d-bc52-4d5b-a918-04b2ccc30018-kube-api-access-wg22g" pod "f14fe42d-bc52-4d5b-a918-04b2ccc30018" (UID: "f14fe42d-bc52-4d5b-a918-04b2ccc30018"). InnerVolumeSpecName "kube-api-access-wg22g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:15:11.602789 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:11.602695 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f14fe42d-bc52-4d5b-a918-04b2ccc30018-proxy-tls" pod "f14fe42d-bc52-4d5b-a918-04b2ccc30018" (UID: "f14fe42d-bc52-4d5b-a918-04b2ccc30018"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:15:11.701179 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:11.701145 7307 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wg22g\" (UniqueName: \"kubernetes.io/projected/f14fe42d-bc52-4d5b-a918-04b2ccc30018-kube-api-access-wg22g\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:15:11.701179 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:11.701173 7307 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f14fe42d-bc52-4d5b-a918-04b2ccc30018-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:15:11.701179 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:11.701184 7307 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f14fe42d-bc52-4d5b-a918-04b2ccc30018-proxy-tls\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:15:11.916524 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:11.916488 7307 generic.go:356] "Generic (PLEG): container finished" podID="f14fe42d-bc52-4d5b-a918-04b2ccc30018" containerID="e37fae3ab6409a2fec0982d79430446d1c7704f73587a28e2f2453ca0e45303b" exitCode=0 Oct 30 22:15:11.916703 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:11.916542 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" Oct 30 22:15:11.916703 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:11.916573 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" event={"ID":"f14fe42d-bc52-4d5b-a918-04b2ccc30018","Type":"ContainerDied","Data":"e37fae3ab6409a2fec0982d79430446d1c7704f73587a28e2f2453ca0e45303b"} Oct 30 22:15:11.916703 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:11.916638 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm" event={"ID":"f14fe42d-bc52-4d5b-a918-04b2ccc30018","Type":"ContainerDied","Data":"8476be294d62b0bd0b13422b56a1dac944748504baee3362134f5c757deb725c"} Oct 30 22:15:11.916703 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:11.916664 7307 scope.go:122] "RemoveContainer" containerID="dc0ca934ac6b290aa8a4297ee0abaa61b4ae73cf6067727d3fd6dad1fe0253be" Oct 30 22:15:11.925501 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:11.925481 7307 scope.go:122] "RemoveContainer" containerID="e37fae3ab6409a2fec0982d79430446d1c7704f73587a28e2f2453ca0e45303b" Oct 30 22:15:11.933711 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:11.933689 7307 scope.go:122] "RemoveContainer" containerID="dc0ca934ac6b290aa8a4297ee0abaa61b4ae73cf6067727d3fd6dad1fe0253be" Oct 30 22:15:11.934027 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:15:11.934008 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc0ca934ac6b290aa8a4297ee0abaa61b4ae73cf6067727d3fd6dad1fe0253be\": container with ID starting with dc0ca934ac6b290aa8a4297ee0abaa61b4ae73cf6067727d3fd6dad1fe0253be not found: ID does not exist" containerID="dc0ca934ac6b290aa8a4297ee0abaa61b4ae73cf6067727d3fd6dad1fe0253be" Oct 30 22:15:11.934073 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:11.934038 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc0ca934ac6b290aa8a4297ee0abaa61b4ae73cf6067727d3fd6dad1fe0253be"} err="failed to get container status \"dc0ca934ac6b290aa8a4297ee0abaa61b4ae73cf6067727d3fd6dad1fe0253be\": rpc error: code = NotFound desc = could not find container \"dc0ca934ac6b290aa8a4297ee0abaa61b4ae73cf6067727d3fd6dad1fe0253be\": container with ID starting with dc0ca934ac6b290aa8a4297ee0abaa61b4ae73cf6067727d3fd6dad1fe0253be not found: ID does not exist" Oct 30 22:15:11.934073 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:11.934057 7307 scope.go:122] "RemoveContainer" containerID="e37fae3ab6409a2fec0982d79430446d1c7704f73587a28e2f2453ca0e45303b" Oct 30 22:15:11.934284 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:15:11.934266 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e37fae3ab6409a2fec0982d79430446d1c7704f73587a28e2f2453ca0e45303b\": container with ID starting with e37fae3ab6409a2fec0982d79430446d1c7704f73587a28e2f2453ca0e45303b not found: ID does not exist" containerID="e37fae3ab6409a2fec0982d79430446d1c7704f73587a28e2f2453ca0e45303b" Oct 30 22:15:11.934327 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:11.934292 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e37fae3ab6409a2fec0982d79430446d1c7704f73587a28e2f2453ca0e45303b"} err="failed to get container status \"e37fae3ab6409a2fec0982d79430446d1c7704f73587a28e2f2453ca0e45303b\": rpc error: code = NotFound desc = could not find container \"e37fae3ab6409a2fec0982d79430446d1c7704f73587a28e2f2453ca0e45303b\": container with ID starting with e37fae3ab6409a2fec0982d79430446d1c7704f73587a28e2f2453ca0e45303b not found: ID does not exist" Oct 30 22:15:11.939630 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:11.939606 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm"] Oct 30 22:15:11.946009 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:11.945986 7307 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-e9913-predictor-6c79bcdf7f-ls4xm"] Oct 30 22:15:12.752395 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:12.752345 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" podUID="3d13661a-f964-4c64-88a9-07e326f509ad" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:15:12.928229 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:12.928185 7307 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f14fe42d-bc52-4d5b-a918-04b2ccc30018" path="/var/lib/kubelet/pods/f14fe42d-bc52-4d5b-a918-04b2ccc30018/volumes" Oct 30 22:15:13.380232 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.380199 7307 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4"] Oct 30 22:15:13.380533 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.380521 7307 cpu_manager.go:414] "containerMap: removing container" podUID="f14fe42d-bc52-4d5b-a918-04b2ccc30018" containerName="kube-rbac-proxy" Oct 30 22:15:13.380582 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.380534 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f14fe42d-bc52-4d5b-a918-04b2ccc30018" containerName="kube-rbac-proxy" Oct 30 22:15:13.380582 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.380555 7307 cpu_manager.go:414] "containerMap: removing container" podUID="f14fe42d-bc52-4d5b-a918-04b2ccc30018" containerName="kserve-container" Oct 30 22:15:13.380582 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.380560 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f14fe42d-bc52-4d5b-a918-04b2ccc30018" containerName="kserve-container" Oct 30 22:15:13.380678 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.380622 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="f14fe42d-bc52-4d5b-a918-04b2ccc30018" containerName="kserve-container" Oct 30 22:15:13.380678 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.380634 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="f14fe42d-bc52-4d5b-a918-04b2ccc30018" containerName="kube-rbac-proxy" Oct 30 22:15:13.384699 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.384680 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" Oct 30 22:15:13.391518 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.391501 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"error-404-isvc-47126-predictor-serving-cert\"" Oct 30 22:15:13.397181 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.397116 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"kube-root-ca.crt\"" Oct 30 22:15:13.397181 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.397149 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"error-404-isvc-47126-kube-rbac-proxy-sar-config\"" Oct 30 22:15:13.397181 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.397162 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"openshift-service-ca.crt\"" Oct 30 22:15:13.398211 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.398192 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4"] Oct 30 22:15:13.423522 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.423496 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"default-dockercfg-kk2z5\"" Oct 30 22:15:13.516567 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.516535 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz4sv\" (UniqueName: \"kubernetes.io/projected/7eb3170b-29d1-4336-8ddb-bd75d1e4e133-kube-api-access-hz4sv\") pod \"error-404-isvc-47126-predictor-75575b7677-6f6r4\" (UID: \"7eb3170b-29d1-4336-8ddb-bd75d1e4e133\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" Oct 30 22:15:13.516743 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.516629 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7eb3170b-29d1-4336-8ddb-bd75d1e4e133-proxy-tls\") pod \"error-404-isvc-47126-predictor-75575b7677-6f6r4\" (UID: \"7eb3170b-29d1-4336-8ddb-bd75d1e4e133\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" Oct 30 22:15:13.516743 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.516708 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7eb3170b-29d1-4336-8ddb-bd75d1e4e133-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-47126-predictor-75575b7677-6f6r4\" (UID: \"7eb3170b-29d1-4336-8ddb-bd75d1e4e133\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" Oct 30 22:15:13.618132 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.618091 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz4sv\" (UniqueName: \"kubernetes.io/projected/7eb3170b-29d1-4336-8ddb-bd75d1e4e133-kube-api-access-hz4sv\") pod \"error-404-isvc-47126-predictor-75575b7677-6f6r4\" (UID: \"7eb3170b-29d1-4336-8ddb-bd75d1e4e133\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" Oct 30 22:15:13.618132 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.618132 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7eb3170b-29d1-4336-8ddb-bd75d1e4e133-proxy-tls\") pod \"error-404-isvc-47126-predictor-75575b7677-6f6r4\" (UID: \"7eb3170b-29d1-4336-8ddb-bd75d1e4e133\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" Oct 30 22:15:13.618413 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.618155 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7eb3170b-29d1-4336-8ddb-bd75d1e4e133-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-47126-predictor-75575b7677-6f6r4\" (UID: \"7eb3170b-29d1-4336-8ddb-bd75d1e4e133\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" Oct 30 22:15:13.618826 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.618805 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7eb3170b-29d1-4336-8ddb-bd75d1e4e133-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-47126-predictor-75575b7677-6f6r4\" (UID: \"7eb3170b-29d1-4336-8ddb-bd75d1e4e133\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" Oct 30 22:15:13.620691 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.620670 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7eb3170b-29d1-4336-8ddb-bd75d1e4e133-proxy-tls\") pod \"error-404-isvc-47126-predictor-75575b7677-6f6r4\" (UID: \"7eb3170b-29d1-4336-8ddb-bd75d1e4e133\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" Oct 30 22:15:13.631806 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.631743 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz4sv\" (UniqueName: \"kubernetes.io/projected/7eb3170b-29d1-4336-8ddb-bd75d1e4e133-kube-api-access-hz4sv\") pod \"error-404-isvc-47126-predictor-75575b7677-6f6r4\" (UID: \"7eb3170b-29d1-4336-8ddb-bd75d1e4e133\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" Oct 30 22:15:13.699661 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.699617 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" Oct 30 22:15:13.976288 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:13.976207 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4"] Oct 30 22:15:13.979828 ip-10-0-137-4 kubenswrapper[7307]: W1030 22:15:13.979798 7307 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eb3170b_29d1_4336_8ddb_bd75d1e4e133.slice/crio-1171d05e6f9849bcf3f3de3d080702d963b309ffa2c6ca6c5c126a988cdf41a3 WatchSource:0}: Error finding container 1171d05e6f9849bcf3f3de3d080702d963b309ffa2c6ca6c5c126a988cdf41a3: Status 404 returned error can't find the container with id 1171d05e6f9849bcf3f3de3d080702d963b309ffa2c6ca6c5c126a988cdf41a3 Oct 30 22:15:14.274349 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:15:14.274249 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:15:14.931322 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:14.931286 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" event={"ID":"7eb3170b-29d1-4336-8ddb-bd75d1e4e133","Type":"ContainerStarted","Data":"bfaee8e36be9ec575592702f43b8fd9d77d8d42419b797ea452e589329d9bcda"} Oct 30 22:15:14.931554 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:14.931357 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" event={"ID":"7eb3170b-29d1-4336-8ddb-bd75d1e4e133","Type":"ContainerStarted","Data":"ab4ecc13ddb243885d4e4638b1ecc114dd6ece6f4e152c25286209102c3001d0"} Oct 30 22:15:14.931554 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:14.931407 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" event={"ID":"7eb3170b-29d1-4336-8ddb-bd75d1e4e133","Type":"ContainerStarted","Data":"1171d05e6f9849bcf3f3de3d080702d963b309ffa2c6ca6c5c126a988cdf41a3"} Oct 30 22:15:14.931554 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:14.931443 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" Oct 30 22:15:14.931554 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:14.931480 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" Oct 30 22:15:14.932481 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:14.932459 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" podUID="7eb3170b-29d1-4336-8ddb-bd75d1e4e133" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:15:15.935308 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:15.935266 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" podUID="7eb3170b-29d1-4336-8ddb-bd75d1e4e133" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:15:20.939845 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:20.939774 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" Oct 30 22:15:20.940229 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:20.940108 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" podUID="7eb3170b-29d1-4336-8ddb-bd75d1e4e133" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:15:20.961317 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:20.961264 7307 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" podStartSLOduration=7.961254228 podStartE2EDuration="7.961254228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:14.958257459 +0000 UTC m=+1268.159629677" watchObservedRunningTime="2026-10-30 22:15:20.961254228 +0000 UTC m=+1274.162626428" Oct 30 22:15:22.752148 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:22.752115 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" Oct 30 22:15:30.940508 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:30.940469 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" podUID="7eb3170b-29d1-4336-8ddb-bd75d1e4e133" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:15:40.940486 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:40.940447 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" podUID="7eb3170b-29d1-4336-8ddb-bd75d1e4e133" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:15:44.274033 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:15:44.273992 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:15:45.825774 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:45.825738 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx"] Oct 30 22:15:45.826636 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:45.826578 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" podUID="3d13661a-f964-4c64-88a9-07e326f509ad" containerName="kserve-container" containerID="cri-o://ea7aeefaeefd3cdb032aa8a134a6842e1a46c534f0b4fdd0d5dee2e686bdf0a4" gracePeriod=30 Oct 30 22:15:45.826978 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:45.826955 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" podUID="3d13661a-f964-4c64-88a9-07e326f509ad" containerName="kube-rbac-proxy" containerID="cri-o://2de5db95dd77624c2d3717dd119f819f2515526b6015ddb28160083525ae1f02" gracePeriod=30 Oct 30 22:15:46.049555 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:46.049522 7307 generic.go:356] "Generic (PLEG): container finished" podID="3d13661a-f964-4c64-88a9-07e326f509ad" containerID="2de5db95dd77624c2d3717dd119f819f2515526b6015ddb28160083525ae1f02" exitCode=0 Oct 30 22:15:46.049713 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:46.049596 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" event={"ID":"3d13661a-f964-4c64-88a9-07e326f509ad","Type":"ContainerDied","Data":"2de5db95dd77624c2d3717dd119f819f2515526b6015ddb28160083525ae1f02"} Oct 30 22:15:47.746732 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:47.746689 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" podUID="3d13661a-f964-4c64-88a9-07e326f509ad" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.28:8643/healthz\": dial tcp 10.133.0.28:8643: connect: connection refused" Oct 30 22:15:49.668408 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:49.668367 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" Oct 30 22:15:49.835521 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:49.835427 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3d13661a-f964-4c64-88a9-07e326f509ad-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3d13661a-f964-4c64-88a9-07e326f509ad-kube-rbac-proxy-sar-config\") pod \"3d13661a-f964-4c64-88a9-07e326f509ad\" (UID: \"3d13661a-f964-4c64-88a9-07e326f509ad\") " Oct 30 22:15:49.835521 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:49.835481 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3d13661a-f964-4c64-88a9-07e326f509ad-kube-api-access-ff42h\" (UniqueName: \"kubernetes.io/projected/3d13661a-f964-4c64-88a9-07e326f509ad-kube-api-access-ff42h\") pod \"3d13661a-f964-4c64-88a9-07e326f509ad\" (UID: \"3d13661a-f964-4c64-88a9-07e326f509ad\") " Oct 30 22:15:49.835752 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:49.835537 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3d13661a-f964-4c64-88a9-07e326f509ad-proxy-tls\" (UniqueName: \"kubernetes.io/secret/3d13661a-f964-4c64-88a9-07e326f509ad-proxy-tls\") pod \"3d13661a-f964-4c64-88a9-07e326f509ad\" (UID: \"3d13661a-f964-4c64-88a9-07e326f509ad\") " Oct 30 22:15:49.835806 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:49.835781 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d13661a-f964-4c64-88a9-07e326f509ad-kube-rbac-proxy-sar-config" pod "3d13661a-f964-4c64-88a9-07e326f509ad" (UID: "3d13661a-f964-4c64-88a9-07e326f509ad"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:15:49.837585 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:49.837545 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d13661a-f964-4c64-88a9-07e326f509ad-proxy-tls" pod "3d13661a-f964-4c64-88a9-07e326f509ad" (UID: "3d13661a-f964-4c64-88a9-07e326f509ad"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:15:49.837714 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:49.837643 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d13661a-f964-4c64-88a9-07e326f509ad-kube-api-access-ff42h" pod "3d13661a-f964-4c64-88a9-07e326f509ad" (UID: "3d13661a-f964-4c64-88a9-07e326f509ad"). InnerVolumeSpecName "kube-api-access-ff42h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:15:49.936625 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:49.936594 7307 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3d13661a-f964-4c64-88a9-07e326f509ad-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:15:49.936625 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:49.936622 7307 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ff42h\" (UniqueName: \"kubernetes.io/projected/3d13661a-f964-4c64-88a9-07e326f509ad-kube-api-access-ff42h\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:15:49.936819 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:49.936635 7307 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3d13661a-f964-4c64-88a9-07e326f509ad-proxy-tls\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:15:50.064936 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:50.064908 7307 generic.go:356] "Generic (PLEG): container finished" podID="3d13661a-f964-4c64-88a9-07e326f509ad" containerID="ea7aeefaeefd3cdb032aa8a134a6842e1a46c534f0b4fdd0d5dee2e686bdf0a4" exitCode=0 Oct 30 22:15:50.065084 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:50.064957 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" Oct 30 22:15:50.065084 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:50.064963 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" event={"ID":"3d13661a-f964-4c64-88a9-07e326f509ad","Type":"ContainerDied","Data":"ea7aeefaeefd3cdb032aa8a134a6842e1a46c534f0b4fdd0d5dee2e686bdf0a4"} Oct 30 22:15:50.065084 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:50.065017 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx" event={"ID":"3d13661a-f964-4c64-88a9-07e326f509ad","Type":"ContainerDied","Data":"6b29c7330d0a241a473d9fe0180e5841382a3fe2b6cf0a443bcc11e352adcae7"} Oct 30 22:15:50.065084 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:50.065045 7307 scope.go:122] "RemoveContainer" containerID="2de5db95dd77624c2d3717dd119f819f2515526b6015ddb28160083525ae1f02" Oct 30 22:15:50.073515 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:50.073495 7307 scope.go:122] "RemoveContainer" containerID="ea7aeefaeefd3cdb032aa8a134a6842e1a46c534f0b4fdd0d5dee2e686bdf0a4" Oct 30 22:15:50.080840 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:50.080819 7307 scope.go:122] "RemoveContainer" containerID="2de5db95dd77624c2d3717dd119f819f2515526b6015ddb28160083525ae1f02" Oct 30 22:15:50.081103 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:15:50.081083 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2de5db95dd77624c2d3717dd119f819f2515526b6015ddb28160083525ae1f02\": container with ID starting with 2de5db95dd77624c2d3717dd119f819f2515526b6015ddb28160083525ae1f02 not found: ID does not exist" containerID="2de5db95dd77624c2d3717dd119f819f2515526b6015ddb28160083525ae1f02" Oct 30 22:15:50.081147 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:50.081114 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2de5db95dd77624c2d3717dd119f819f2515526b6015ddb28160083525ae1f02"} err="failed to get container status \"2de5db95dd77624c2d3717dd119f819f2515526b6015ddb28160083525ae1f02\": rpc error: code = NotFound desc = could not find container \"2de5db95dd77624c2d3717dd119f819f2515526b6015ddb28160083525ae1f02\": container with ID starting with 2de5db95dd77624c2d3717dd119f819f2515526b6015ddb28160083525ae1f02 not found: ID does not exist" Oct 30 22:15:50.081147 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:50.081131 7307 scope.go:122] "RemoveContainer" containerID="ea7aeefaeefd3cdb032aa8a134a6842e1a46c534f0b4fdd0d5dee2e686bdf0a4" Oct 30 22:15:50.081368 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:15:50.081354 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea7aeefaeefd3cdb032aa8a134a6842e1a46c534f0b4fdd0d5dee2e686bdf0a4\": container with ID starting with ea7aeefaeefd3cdb032aa8a134a6842e1a46c534f0b4fdd0d5dee2e686bdf0a4 not found: ID does not exist" containerID="ea7aeefaeefd3cdb032aa8a134a6842e1a46c534f0b4fdd0d5dee2e686bdf0a4" Oct 30 22:15:50.081489 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:50.081373 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea7aeefaeefd3cdb032aa8a134a6842e1a46c534f0b4fdd0d5dee2e686bdf0a4"} err="failed to get container status \"ea7aeefaeefd3cdb032aa8a134a6842e1a46c534f0b4fdd0d5dee2e686bdf0a4\": rpc error: code = NotFound desc = could not find container \"ea7aeefaeefd3cdb032aa8a134a6842e1a46c534f0b4fdd0d5dee2e686bdf0a4\": container with ID starting with ea7aeefaeefd3cdb032aa8a134a6842e1a46c534f0b4fdd0d5dee2e686bdf0a4 not found: ID does not exist" Oct 30 22:15:50.087020 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:50.086969 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx"] Oct 30 22:15:50.091257 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:50.091237 7307 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-08888-predictor-6857cd4fc7-4vhqx"] Oct 30 22:15:50.928230 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:50.928193 7307 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3d13661a-f964-4c64-88a9-07e326f509ad" path="/var/lib/kubelet/pods/3d13661a-f964-4c64-88a9-07e326f509ad/volumes" Oct 30 22:15:50.940219 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:50.940180 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" podUID="7eb3170b-29d1-4336-8ddb-bd75d1e4e133" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:15:51.409182 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.409150 7307 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x"] Oct 30 22:15:51.409500 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.409486 7307 cpu_manager.go:414] "containerMap: removing container" podUID="3d13661a-f964-4c64-88a9-07e326f509ad" containerName="kserve-container" Oct 30 22:15:51.409559 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.409501 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3d13661a-f964-4c64-88a9-07e326f509ad" containerName="kserve-container" Oct 30 22:15:51.409559 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.409516 7307 cpu_manager.go:414] "containerMap: removing container" podUID="3d13661a-f964-4c64-88a9-07e326f509ad" containerName="kube-rbac-proxy" Oct 30 22:15:51.409559 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.409521 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3d13661a-f964-4c64-88a9-07e326f509ad" containerName="kube-rbac-proxy" Oct 30 22:15:51.409650 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.409586 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="3d13661a-f964-4c64-88a9-07e326f509ad" containerName="kserve-container" Oct 30 22:15:51.409650 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.409597 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="3d13661a-f964-4c64-88a9-07e326f509ad" containerName="kube-rbac-proxy" Oct 30 22:15:51.414016 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.413998 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" Oct 30 22:15:51.419792 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.419766 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"error-404-isvc-a2e00-kube-rbac-proxy-sar-config\"" Oct 30 22:15:51.419792 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.419775 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"openshift-service-ca.crt\"" Oct 30 22:15:51.420037 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.420016 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"kube-root-ca.crt\"" Oct 30 22:15:51.420165 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.420063 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-36e5afb065\"/\"default-dockercfg-jlnw5\"" Oct 30 22:15:51.420518 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.420177 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-36e5afb065\"/\"error-404-isvc-a2e00-predictor-serving-cert\"" Oct 30 22:15:51.423110 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.423089 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x"] Oct 30 22:15:51.549016 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.548979 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5vtj\" (UniqueName: \"kubernetes.io/projected/592ad196-b8dc-4554-bb6c-adb3544e15a0-kube-api-access-n5vtj\") pod \"error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x\" (UID: \"592ad196-b8dc-4554-bb6c-adb3544e15a0\") " pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" Oct 30 22:15:51.549189 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.549036 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/592ad196-b8dc-4554-bb6c-adb3544e15a0-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x\" (UID: \"592ad196-b8dc-4554-bb6c-adb3544e15a0\") " pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" Oct 30 22:15:51.549189 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.549166 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/592ad196-b8dc-4554-bb6c-adb3544e15a0-proxy-tls\") pod \"error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x\" (UID: \"592ad196-b8dc-4554-bb6c-adb3544e15a0\") " pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" Oct 30 22:15:51.650293 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.650248 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/592ad196-b8dc-4554-bb6c-adb3544e15a0-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x\" (UID: \"592ad196-b8dc-4554-bb6c-adb3544e15a0\") " pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" Oct 30 22:15:51.650495 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.650331 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/592ad196-b8dc-4554-bb6c-adb3544e15a0-proxy-tls\") pod \"error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x\" (UID: \"592ad196-b8dc-4554-bb6c-adb3544e15a0\") " pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" Oct 30 22:15:51.650495 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.650413 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5vtj\" (UniqueName: \"kubernetes.io/projected/592ad196-b8dc-4554-bb6c-adb3544e15a0-kube-api-access-n5vtj\") pod \"error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x\" (UID: \"592ad196-b8dc-4554-bb6c-adb3544e15a0\") " pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" Oct 30 22:15:51.651044 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.651021 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/592ad196-b8dc-4554-bb6c-adb3544e15a0-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x\" (UID: \"592ad196-b8dc-4554-bb6c-adb3544e15a0\") " pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" Oct 30 22:15:51.652951 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.652922 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/592ad196-b8dc-4554-bb6c-adb3544e15a0-proxy-tls\") pod \"error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x\" (UID: \"592ad196-b8dc-4554-bb6c-adb3544e15a0\") " pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" Oct 30 22:15:51.663955 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.663897 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5vtj\" (UniqueName: \"kubernetes.io/projected/592ad196-b8dc-4554-bb6c-adb3544e15a0-kube-api-access-n5vtj\") pod \"error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x\" (UID: \"592ad196-b8dc-4554-bb6c-adb3544e15a0\") " pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" Oct 30 22:15:51.729759 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:51.729727 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" Oct 30 22:15:52.005226 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:52.005196 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x"] Oct 30 22:15:52.007904 ip-10-0-137-4 kubenswrapper[7307]: W1030 22:15:52.007859 7307 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592ad196_b8dc_4554_bb6c_adb3544e15a0.slice/crio-613a4eb9cfd4a3a306011694382af87b521fe4c2ff68c2085f2a18543d3dd5e9 WatchSource:0}: Error finding container 613a4eb9cfd4a3a306011694382af87b521fe4c2ff68c2085f2a18543d3dd5e9: Status 404 returned error can't find the container with id 613a4eb9cfd4a3a306011694382af87b521fe4c2ff68c2085f2a18543d3dd5e9 Oct 30 22:15:52.074796 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:52.074768 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" event={"ID":"592ad196-b8dc-4554-bb6c-adb3544e15a0","Type":"ContainerStarted","Data":"a427e4c64b7e6168f0b7e25d384af9f49abb927ed80002a93037d41ff80a68d2"} Oct 30 22:15:52.074911 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:52.074838 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" event={"ID":"592ad196-b8dc-4554-bb6c-adb3544e15a0","Type":"ContainerStarted","Data":"613a4eb9cfd4a3a306011694382af87b521fe4c2ff68c2085f2a18543d3dd5e9"} Oct 30 22:15:53.079816 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:53.079776 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" event={"ID":"592ad196-b8dc-4554-bb6c-adb3544e15a0","Type":"ContainerStarted","Data":"867736c20273d822b23daf508e62888297773ef7ed940cd2c43c13e646d15976"} Oct 30 22:15:53.080186 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:53.079844 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" Oct 30 22:15:53.080186 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:53.079895 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" Oct 30 22:15:53.081212 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:53.081188 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" podUID="592ad196-b8dc-4554-bb6c-adb3544e15a0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 30 22:15:54.084291 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:54.084256 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" podUID="592ad196-b8dc-4554-bb6c-adb3544e15a0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 30 22:15:59.088727 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:59.088693 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" Oct 30 22:15:59.089187 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:59.089098 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" podUID="592ad196-b8dc-4554-bb6c-adb3544e15a0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 30 22:15:59.111738 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:15:59.111689 7307 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" podStartSLOduration=8.111676002 podStartE2EDuration="8.111676002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:53.102134247 +0000 UTC m=+1306.303506447" watchObservedRunningTime="2026-10-30 22:15:59.111676002 +0000 UTC m=+1312.313048200" Oct 30 22:16:00.941115 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:00.941074 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" podUID="7eb3170b-29d1-4336-8ddb-bd75d1e4e133" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:16:09.089164 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:09.089114 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" podUID="592ad196-b8dc-4554-bb6c-adb3544e15a0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 30 22:16:10.940535 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:10.940503 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" Oct 30 22:16:14.273508 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:16:14.273470 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:16:19.089928 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:19.089886 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" podUID="592ad196-b8dc-4554-bb6c-adb3544e15a0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 30 22:16:29.089818 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:29.089779 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" podUID="592ad196-b8dc-4554-bb6c-adb3544e15a0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 30 22:16:34.617730 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:34.617698 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4"] Oct 30 22:16:34.618217 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:34.617988 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" podUID="7eb3170b-29d1-4336-8ddb-bd75d1e4e133" containerName="kserve-container" containerID="cri-o://ab4ecc13ddb243885d4e4638b1ecc114dd6ece6f4e152c25286209102c3001d0" gracePeriod=30 Oct 30 22:16:34.618217 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:34.617993 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" podUID="7eb3170b-29d1-4336-8ddb-bd75d1e4e133" containerName="kube-rbac-proxy" containerID="cri-o://bfaee8e36be9ec575592702f43b8fd9d77d8d42419b797ea452e589329d9bcda" gracePeriod=30 Oct 30 22:16:35.240325 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:35.240291 7307 generic.go:356] "Generic (PLEG): container finished" podID="7eb3170b-29d1-4336-8ddb-bd75d1e4e133" containerID="bfaee8e36be9ec575592702f43b8fd9d77d8d42419b797ea452e589329d9bcda" exitCode=0 Oct 30 22:16:35.240505 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:35.240362 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" event={"ID":"7eb3170b-29d1-4336-8ddb-bd75d1e4e133","Type":"ContainerDied","Data":"bfaee8e36be9ec575592702f43b8fd9d77d8d42419b797ea452e589329d9bcda"} Oct 30 22:16:35.936103 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:35.936060 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" podUID="7eb3170b-29d1-4336-8ddb-bd75d1e4e133" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.29:8643/healthz\": dial tcp 10.133.0.29:8643: connect: connection refused" Oct 30 22:16:38.459634 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:38.459611 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" Oct 30 22:16:38.551293 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:38.551218 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7eb3170b-29d1-4336-8ddb-bd75d1e4e133-proxy-tls\" (UniqueName: \"kubernetes.io/secret/7eb3170b-29d1-4336-8ddb-bd75d1e4e133-proxy-tls\") pod \"7eb3170b-29d1-4336-8ddb-bd75d1e4e133\" (UID: \"7eb3170b-29d1-4336-8ddb-bd75d1e4e133\") " Oct 30 22:16:38.551293 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:38.551270 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7eb3170b-29d1-4336-8ddb-bd75d1e4e133-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7eb3170b-29d1-4336-8ddb-bd75d1e4e133-kube-rbac-proxy-sar-config\") pod \"7eb3170b-29d1-4336-8ddb-bd75d1e4e133\" (UID: \"7eb3170b-29d1-4336-8ddb-bd75d1e4e133\") " Oct 30 22:16:38.551481 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:38.551326 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7eb3170b-29d1-4336-8ddb-bd75d1e4e133-kube-api-access-hz4sv\" (UniqueName: \"kubernetes.io/projected/7eb3170b-29d1-4336-8ddb-bd75d1e4e133-kube-api-access-hz4sv\") pod \"7eb3170b-29d1-4336-8ddb-bd75d1e4e133\" (UID: \"7eb3170b-29d1-4336-8ddb-bd75d1e4e133\") " Oct 30 22:16:38.551684 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:38.551663 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7eb3170b-29d1-4336-8ddb-bd75d1e4e133-kube-rbac-proxy-sar-config" pod "7eb3170b-29d1-4336-8ddb-bd75d1e4e133" (UID: "7eb3170b-29d1-4336-8ddb-bd75d1e4e133"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:16:38.553225 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:38.553202 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7eb3170b-29d1-4336-8ddb-bd75d1e4e133-proxy-tls" pod "7eb3170b-29d1-4336-8ddb-bd75d1e4e133" (UID: "7eb3170b-29d1-4336-8ddb-bd75d1e4e133"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:16:38.553454 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:38.553433 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7eb3170b-29d1-4336-8ddb-bd75d1e4e133-kube-api-access-hz4sv" pod "7eb3170b-29d1-4336-8ddb-bd75d1e4e133" (UID: "7eb3170b-29d1-4336-8ddb-bd75d1e4e133"). InnerVolumeSpecName "kube-api-access-hz4sv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:16:38.652455 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:38.652416 7307 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7eb3170b-29d1-4336-8ddb-bd75d1e4e133-proxy-tls\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:16:38.652455 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:38.652447 7307 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7eb3170b-29d1-4336-8ddb-bd75d1e4e133-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:16:38.652455 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:38.652463 7307 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hz4sv\" (UniqueName: \"kubernetes.io/projected/7eb3170b-29d1-4336-8ddb-bd75d1e4e133-kube-api-access-hz4sv\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:16:39.089615 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:39.089574 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" podUID="592ad196-b8dc-4554-bb6c-adb3544e15a0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 30 22:16:39.256224 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:39.256139 7307 generic.go:356] "Generic (PLEG): container finished" podID="7eb3170b-29d1-4336-8ddb-bd75d1e4e133" containerID="ab4ecc13ddb243885d4e4638b1ecc114dd6ece6f4e152c25286209102c3001d0" exitCode=0 Oct 30 22:16:39.256224 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:39.256190 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" Oct 30 22:16:39.256547 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:39.256230 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" event={"ID":"7eb3170b-29d1-4336-8ddb-bd75d1e4e133","Type":"ContainerDied","Data":"ab4ecc13ddb243885d4e4638b1ecc114dd6ece6f4e152c25286209102c3001d0"} Oct 30 22:16:39.256547 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:39.256302 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4" event={"ID":"7eb3170b-29d1-4336-8ddb-bd75d1e4e133","Type":"ContainerDied","Data":"1171d05e6f9849bcf3f3de3d080702d963b309ffa2c6ca6c5c126a988cdf41a3"} Oct 30 22:16:39.256547 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:39.256338 7307 scope.go:122] "RemoveContainer" containerID="bfaee8e36be9ec575592702f43b8fd9d77d8d42419b797ea452e589329d9bcda" Oct 30 22:16:39.264387 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:39.264363 7307 scope.go:122] "RemoveContainer" containerID="ab4ecc13ddb243885d4e4638b1ecc114dd6ece6f4e152c25286209102c3001d0" Oct 30 22:16:39.271642 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:39.271621 7307 scope.go:122] "RemoveContainer" containerID="bfaee8e36be9ec575592702f43b8fd9d77d8d42419b797ea452e589329d9bcda" Oct 30 22:16:39.271899 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:16:39.271869 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfaee8e36be9ec575592702f43b8fd9d77d8d42419b797ea452e589329d9bcda\": container with ID starting with bfaee8e36be9ec575592702f43b8fd9d77d8d42419b797ea452e589329d9bcda not found: ID does not exist" containerID="bfaee8e36be9ec575592702f43b8fd9d77d8d42419b797ea452e589329d9bcda" Oct 30 22:16:39.271955 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:39.271899 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfaee8e36be9ec575592702f43b8fd9d77d8d42419b797ea452e589329d9bcda"} err="failed to get container status \"bfaee8e36be9ec575592702f43b8fd9d77d8d42419b797ea452e589329d9bcda\": rpc error: code = NotFound desc = could not find container \"bfaee8e36be9ec575592702f43b8fd9d77d8d42419b797ea452e589329d9bcda\": container with ID starting with bfaee8e36be9ec575592702f43b8fd9d77d8d42419b797ea452e589329d9bcda not found: ID does not exist" Oct 30 22:16:39.271955 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:39.271916 7307 scope.go:122] "RemoveContainer" containerID="ab4ecc13ddb243885d4e4638b1ecc114dd6ece6f4e152c25286209102c3001d0" Oct 30 22:16:39.272195 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:16:39.272178 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab4ecc13ddb243885d4e4638b1ecc114dd6ece6f4e152c25286209102c3001d0\": container with ID starting with ab4ecc13ddb243885d4e4638b1ecc114dd6ece6f4e152c25286209102c3001d0 not found: ID does not exist" containerID="ab4ecc13ddb243885d4e4638b1ecc114dd6ece6f4e152c25286209102c3001d0" Oct 30 22:16:39.272234 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:39.272203 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab4ecc13ddb243885d4e4638b1ecc114dd6ece6f4e152c25286209102c3001d0"} err="failed to get container status \"ab4ecc13ddb243885d4e4638b1ecc114dd6ece6f4e152c25286209102c3001d0\": rpc error: code = NotFound desc = could not find container \"ab4ecc13ddb243885d4e4638b1ecc114dd6ece6f4e152c25286209102c3001d0\": container with ID starting with ab4ecc13ddb243885d4e4638b1ecc114dd6ece6f4e152c25286209102c3001d0 not found: ID does not exist" Oct 30 22:16:39.275459 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:39.275435 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4"] Oct 30 22:16:39.279938 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:39.279914 7307 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-47126-predictor-75575b7677-6f6r4"] Oct 30 22:16:40.224766 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.224730 7307 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8"] Oct 30 22:16:40.225229 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.225058 7307 cpu_manager.go:414] "containerMap: removing container" podUID="7eb3170b-29d1-4336-8ddb-bd75d1e4e133" containerName="kube-rbac-proxy" Oct 30 22:16:40.225229 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.225069 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7eb3170b-29d1-4336-8ddb-bd75d1e4e133" containerName="kube-rbac-proxy" Oct 30 22:16:40.225229 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.225082 7307 cpu_manager.go:414] "containerMap: removing container" podUID="7eb3170b-29d1-4336-8ddb-bd75d1e4e133" containerName="kserve-container" Oct 30 22:16:40.225229 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.225087 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7eb3170b-29d1-4336-8ddb-bd75d1e4e133" containerName="kserve-container" Oct 30 22:16:40.225229 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.225143 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="7eb3170b-29d1-4336-8ddb-bd75d1e4e133" containerName="kube-rbac-proxy" Oct 30 22:16:40.225229 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.225152 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="7eb3170b-29d1-4336-8ddb-bd75d1e4e133" containerName="kserve-container" Oct 30 22:16:40.234076 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.234053 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" Oct 30 22:16:40.238744 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.238710 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"kube-root-ca.crt\"" Oct 30 22:16:40.240481 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.240458 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"error-404-isvc-32399-predictor-serving-cert\"" Oct 30 22:16:40.240606 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.240506 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"openshift-service-ca.crt\"" Oct 30 22:16:40.240606 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.240565 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"default-dockercfg-kk2z5\"" Oct 30 22:16:40.241008 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.240983 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8"] Oct 30 22:16:40.241092 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.241056 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"error-404-isvc-32399-kube-rbac-proxy-sar-config\"" Oct 30 22:16:40.367227 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.367191 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwdpz\" (UniqueName: \"kubernetes.io/projected/d5734d6d-afa3-43eb-a10f-43d4da8d2494-kube-api-access-dwdpz\") pod \"error-404-isvc-32399-predictor-96655cc85-knlc8\" (UID: \"d5734d6d-afa3-43eb-a10f-43d4da8d2494\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" Oct 30 22:16:40.367456 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.367241 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d5734d6d-afa3-43eb-a10f-43d4da8d2494-proxy-tls\") pod \"error-404-isvc-32399-predictor-96655cc85-knlc8\" (UID: \"d5734d6d-afa3-43eb-a10f-43d4da8d2494\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" Oct 30 22:16:40.367456 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.367360 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d5734d6d-afa3-43eb-a10f-43d4da8d2494-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-32399-predictor-96655cc85-knlc8\" (UID: \"d5734d6d-afa3-43eb-a10f-43d4da8d2494\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" Oct 30 22:16:40.468731 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.468678 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d5734d6d-afa3-43eb-a10f-43d4da8d2494-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-32399-predictor-96655cc85-knlc8\" (UID: \"d5734d6d-afa3-43eb-a10f-43d4da8d2494\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" Oct 30 22:16:40.468929 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.468753 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwdpz\" (UniqueName: \"kubernetes.io/projected/d5734d6d-afa3-43eb-a10f-43d4da8d2494-kube-api-access-dwdpz\") pod \"error-404-isvc-32399-predictor-96655cc85-knlc8\" (UID: \"d5734d6d-afa3-43eb-a10f-43d4da8d2494\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" Oct 30 22:16:40.468929 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.468780 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d5734d6d-afa3-43eb-a10f-43d4da8d2494-proxy-tls\") pod \"error-404-isvc-32399-predictor-96655cc85-knlc8\" (UID: \"d5734d6d-afa3-43eb-a10f-43d4da8d2494\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" Oct 30 22:16:40.469360 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.469339 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d5734d6d-afa3-43eb-a10f-43d4da8d2494-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-32399-predictor-96655cc85-knlc8\" (UID: \"d5734d6d-afa3-43eb-a10f-43d4da8d2494\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" Oct 30 22:16:40.471286 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.471267 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d5734d6d-afa3-43eb-a10f-43d4da8d2494-proxy-tls\") pod \"error-404-isvc-32399-predictor-96655cc85-knlc8\" (UID: \"d5734d6d-afa3-43eb-a10f-43d4da8d2494\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" Oct 30 22:16:40.482086 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.482024 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwdpz\" (UniqueName: \"kubernetes.io/projected/d5734d6d-afa3-43eb-a10f-43d4da8d2494-kube-api-access-dwdpz\") pod \"error-404-isvc-32399-predictor-96655cc85-knlc8\" (UID: \"d5734d6d-afa3-43eb-a10f-43d4da8d2494\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" Oct 30 22:16:40.550225 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.550162 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" Oct 30 22:16:40.824015 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.823926 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8"] Oct 30 22:16:40.828218 ip-10-0-137-4 kubenswrapper[7307]: W1030 22:16:40.828185 7307 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5734d6d_afa3_43eb_a10f_43d4da8d2494.slice/crio-75b890511c4875fb585e8cd0a83e5cca2477485df4a85780f7719e30cfdb34c0 WatchSource:0}: Error finding container 75b890511c4875fb585e8cd0a83e5cca2477485df4a85780f7719e30cfdb34c0: Status 404 returned error can't find the container with id 75b890511c4875fb585e8cd0a83e5cca2477485df4a85780f7719e30cfdb34c0 Oct 30 22:16:40.931032 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:40.930991 7307 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7eb3170b-29d1-4336-8ddb-bd75d1e4e133" path="/var/lib/kubelet/pods/7eb3170b-29d1-4336-8ddb-bd75d1e4e133/volumes" Oct 30 22:16:41.266055 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:41.266017 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" event={"ID":"d5734d6d-afa3-43eb-a10f-43d4da8d2494","Type":"ContainerStarted","Data":"9d8e9366cba34672a6b8b0ddebff0ef9d68947fe625195aaae7252e39035369c"} Oct 30 22:16:41.266495 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:41.266074 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" event={"ID":"d5734d6d-afa3-43eb-a10f-43d4da8d2494","Type":"ContainerStarted","Data":"f83fcb75b86e2bccc6103c38f3d38dd53c1ee80bee732e7014489301b1142443"} Oct 30 22:16:41.266495 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:41.266097 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" event={"ID":"d5734d6d-afa3-43eb-a10f-43d4da8d2494","Type":"ContainerStarted","Data":"75b890511c4875fb585e8cd0a83e5cca2477485df4a85780f7719e30cfdb34c0"} Oct 30 22:16:41.266495 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:41.266119 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" Oct 30 22:16:41.289502 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:41.289442 7307 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" podStartSLOduration=1.289426642 podStartE2EDuration="1.289426642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:16:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:16:41.288436495 +0000 UTC m=+1354.489808699" watchObservedRunningTime="2026-10-30 22:16:41.289426642 +0000 UTC m=+1354.490798835" Oct 30 22:16:42.270461 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:42.270427 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" Oct 30 22:16:42.271653 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:42.271630 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" podUID="d5734d6d-afa3-43eb-a10f-43d4da8d2494" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:16:43.274236 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:43.274192 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" podUID="d5734d6d-afa3-43eb-a10f-43d4da8d2494" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:16:44.273855 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:16:44.273819 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:16:48.279535 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:48.279457 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" Oct 30 22:16:48.280073 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:48.280045 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" podUID="d5734d6d-afa3-43eb-a10f-43d4da8d2494" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:16:49.090273 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:49.090244 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" Oct 30 22:16:58.280267 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:16:58.280228 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" podUID="d5734d6d-afa3-43eb-a10f-43d4da8d2494" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:17:08.279957 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:17:08.279916 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" podUID="d5734d6d-afa3-43eb-a10f-43d4da8d2494" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:17:14.275065 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:17:14.275027 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:17:18.280594 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:17:18.280553 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" podUID="d5734d6d-afa3-43eb-a10f-43d4da8d2494" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:17:28.280885 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:17:28.280847 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" podUID="d5734d6d-afa3-43eb-a10f-43d4da8d2494" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:17:38.280527 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:17:38.280495 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" Oct 30 22:17:44.272685 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:17:44.272648 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:18:14.273463 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:18:14.273424 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:18:44.274206 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:18:44.274100 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:19:14.274880 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:19:14.274832 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:19:44.277757 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:19:44.277712 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:20:14.274840 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:20:14.274749 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:20:44.274453 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:20:44.274413 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:21:14.274317 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:21:14.274278 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:21:44.273952 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:21:44.273915 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:22:14.273794 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:22:14.273756 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:22:44.273220 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:22:44.273182 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:23:14.272215 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:23:14.272173 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:23:44.273116 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:23:44.273072 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:24:14.273086 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:24:14.273041 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:24:44.275638 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:24:44.275595 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:25:14.273151 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:25:14.273115 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:25:17.110054 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:17.110012 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x"] Oct 30 22:25:17.110716 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:17.110367 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" podUID="592ad196-b8dc-4554-bb6c-adb3544e15a0" containerName="kserve-container" containerID="cri-o://a427e4c64b7e6168f0b7e25d384af9f49abb927ed80002a93037d41ff80a68d2" gracePeriod=30 Oct 30 22:25:17.110716 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:17.110427 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" podUID="592ad196-b8dc-4554-bb6c-adb3544e15a0" containerName="kube-rbac-proxy" containerID="cri-o://867736c20273d822b23daf508e62888297773ef7ed940cd2c43c13e646d15976" gracePeriod=30 Oct 30 22:25:18.205890 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:18.205854 7307 generic.go:356] "Generic (PLEG): container finished" podID="592ad196-b8dc-4554-bb6c-adb3544e15a0" containerID="867736c20273d822b23daf508e62888297773ef7ed940cd2c43c13e646d15976" exitCode=0 Oct 30 22:25:18.206278 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:18.205916 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" event={"ID":"592ad196-b8dc-4554-bb6c-adb3544e15a0","Type":"ContainerDied","Data":"867736c20273d822b23daf508e62888297773ef7ed940cd2c43c13e646d15976"} Oct 30 22:25:19.085376 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:19.085339 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" podUID="592ad196-b8dc-4554-bb6c-adb3544e15a0" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.30:8643/healthz\": dial tcp 10.133.0.30:8643: connect: connection refused" Oct 30 22:25:19.089623 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:19.089601 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" podUID="592ad196-b8dc-4554-bb6c-adb3544e15a0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.30:8080: connect: connection refused" Oct 30 22:25:20.448083 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:20.448058 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" Oct 30 22:25:20.559965 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:20.559893 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/592ad196-b8dc-4554-bb6c-adb3544e15a0-kube-api-access-n5vtj\" (UniqueName: \"kubernetes.io/projected/592ad196-b8dc-4554-bb6c-adb3544e15a0-kube-api-access-n5vtj\") pod \"592ad196-b8dc-4554-bb6c-adb3544e15a0\" (UID: \"592ad196-b8dc-4554-bb6c-adb3544e15a0\") " Oct 30 22:25:20.559965 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:20.559931 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/592ad196-b8dc-4554-bb6c-adb3544e15a0-proxy-tls\" (UniqueName: \"kubernetes.io/secret/592ad196-b8dc-4554-bb6c-adb3544e15a0-proxy-tls\") pod \"592ad196-b8dc-4554-bb6c-adb3544e15a0\" (UID: \"592ad196-b8dc-4554-bb6c-adb3544e15a0\") " Oct 30 22:25:20.559965 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:20.559958 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/592ad196-b8dc-4554-bb6c-adb3544e15a0-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/592ad196-b8dc-4554-bb6c-adb3544e15a0-kube-rbac-proxy-sar-config\") pod \"592ad196-b8dc-4554-bb6c-adb3544e15a0\" (UID: \"592ad196-b8dc-4554-bb6c-adb3544e15a0\") " Oct 30 22:25:20.560328 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:20.560308 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/592ad196-b8dc-4554-bb6c-adb3544e15a0-kube-rbac-proxy-sar-config" pod "592ad196-b8dc-4554-bb6c-adb3544e15a0" (UID: "592ad196-b8dc-4554-bb6c-adb3544e15a0"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:25:20.561973 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:20.561952 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/592ad196-b8dc-4554-bb6c-adb3544e15a0-proxy-tls" pod "592ad196-b8dc-4554-bb6c-adb3544e15a0" (UID: "592ad196-b8dc-4554-bb6c-adb3544e15a0"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:25:20.562066 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:20.562044 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/592ad196-b8dc-4554-bb6c-adb3544e15a0-kube-api-access-n5vtj" pod "592ad196-b8dc-4554-bb6c-adb3544e15a0" (UID: "592ad196-b8dc-4554-bb6c-adb3544e15a0"). InnerVolumeSpecName "kube-api-access-n5vtj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:25:20.661284 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:20.661254 7307 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5vtj\" (UniqueName: \"kubernetes.io/projected/592ad196-b8dc-4554-bb6c-adb3544e15a0-kube-api-access-n5vtj\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:25:20.661284 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:20.661279 7307 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/592ad196-b8dc-4554-bb6c-adb3544e15a0-proxy-tls\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:25:20.661284 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:20.661289 7307 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/592ad196-b8dc-4554-bb6c-adb3544e15a0-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:25:21.218532 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:21.218444 7307 generic.go:356] "Generic (PLEG): container finished" podID="592ad196-b8dc-4554-bb6c-adb3544e15a0" containerID="a427e4c64b7e6168f0b7e25d384af9f49abb927ed80002a93037d41ff80a68d2" exitCode=0 Oct 30 22:25:21.218532 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:21.218492 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" event={"ID":"592ad196-b8dc-4554-bb6c-adb3544e15a0","Type":"ContainerDied","Data":"a427e4c64b7e6168f0b7e25d384af9f49abb927ed80002a93037d41ff80a68d2"} Oct 30 22:25:21.218532 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:21.218500 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" Oct 30 22:25:21.218827 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:21.218538 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x" event={"ID":"592ad196-b8dc-4554-bb6c-adb3544e15a0","Type":"ContainerDied","Data":"613a4eb9cfd4a3a306011694382af87b521fe4c2ff68c2085f2a18543d3dd5e9"} Oct 30 22:25:21.218827 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:21.218565 7307 scope.go:122] "RemoveContainer" containerID="867736c20273d822b23daf508e62888297773ef7ed940cd2c43c13e646d15976" Oct 30 22:25:21.226831 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:21.226813 7307 scope.go:122] "RemoveContainer" containerID="a427e4c64b7e6168f0b7e25d384af9f49abb927ed80002a93037d41ff80a68d2" Oct 30 22:25:21.234180 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:21.234162 7307 scope.go:122] "RemoveContainer" containerID="867736c20273d822b23daf508e62888297773ef7ed940cd2c43c13e646d15976" Oct 30 22:25:21.234455 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:25:21.234438 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"867736c20273d822b23daf508e62888297773ef7ed940cd2c43c13e646d15976\": container with ID starting with 867736c20273d822b23daf508e62888297773ef7ed940cd2c43c13e646d15976 not found: ID does not exist" containerID="867736c20273d822b23daf508e62888297773ef7ed940cd2c43c13e646d15976" Oct 30 22:25:21.234510 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:21.234466 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"867736c20273d822b23daf508e62888297773ef7ed940cd2c43c13e646d15976"} err="failed to get container status \"867736c20273d822b23daf508e62888297773ef7ed940cd2c43c13e646d15976\": rpc error: code = NotFound desc = could not find container \"867736c20273d822b23daf508e62888297773ef7ed940cd2c43c13e646d15976\": container with ID starting with 867736c20273d822b23daf508e62888297773ef7ed940cd2c43c13e646d15976 not found: ID does not exist" Oct 30 22:25:21.234510 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:21.234482 7307 scope.go:122] "RemoveContainer" containerID="a427e4c64b7e6168f0b7e25d384af9f49abb927ed80002a93037d41ff80a68d2" Oct 30 22:25:21.234718 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:25:21.234701 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a427e4c64b7e6168f0b7e25d384af9f49abb927ed80002a93037d41ff80a68d2\": container with ID starting with a427e4c64b7e6168f0b7e25d384af9f49abb927ed80002a93037d41ff80a68d2 not found: ID does not exist" containerID="a427e4c64b7e6168f0b7e25d384af9f49abb927ed80002a93037d41ff80a68d2" Oct 30 22:25:21.234760 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:21.234726 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a427e4c64b7e6168f0b7e25d384af9f49abb927ed80002a93037d41ff80a68d2"} err="failed to get container status \"a427e4c64b7e6168f0b7e25d384af9f49abb927ed80002a93037d41ff80a68d2\": rpc error: code = NotFound desc = could not find container \"a427e4c64b7e6168f0b7e25d384af9f49abb927ed80002a93037d41ff80a68d2\": container with ID starting with a427e4c64b7e6168f0b7e25d384af9f49abb927ed80002a93037d41ff80a68d2 not found: ID does not exist" Oct 30 22:25:21.237462 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:21.237438 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x"] Oct 30 22:25:21.241500 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:21.241477 7307 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-a2e00-predictor-6c8bf574d5-phs5x"] Oct 30 22:25:22.574289 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.574254 7307 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m"] Oct 30 22:25:22.574694 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.574650 7307 cpu_manager.go:414] "containerMap: removing container" podUID="592ad196-b8dc-4554-bb6c-adb3544e15a0" containerName="kube-rbac-proxy" Oct 30 22:25:22.574694 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.574663 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="592ad196-b8dc-4554-bb6c-adb3544e15a0" containerName="kube-rbac-proxy" Oct 30 22:25:22.574694 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.574693 7307 cpu_manager.go:414] "containerMap: removing container" podUID="592ad196-b8dc-4554-bb6c-adb3544e15a0" containerName="kserve-container" Oct 30 22:25:22.574798 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.574698 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="592ad196-b8dc-4554-bb6c-adb3544e15a0" containerName="kserve-container" Oct 30 22:25:22.574798 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.574746 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="592ad196-b8dc-4554-bb6c-adb3544e15a0" containerName="kserve-container" Oct 30 22:25:22.574798 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.574755 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="592ad196-b8dc-4554-bb6c-adb3544e15a0" containerName="kube-rbac-proxy" Oct 30 22:25:22.578684 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.578668 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" Oct 30 22:25:22.584567 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.584544 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"error-404-isvc-b14c2-kube-rbac-proxy-sar-config\"" Oct 30 22:25:22.584691 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.584611 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"kube-root-ca.crt\"" Oct 30 22:25:22.586127 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.586108 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"openshift-service-ca.crt\"" Oct 30 22:25:22.586197 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.586108 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-36e5afb065\"/\"error-404-isvc-b14c2-predictor-serving-cert\"" Oct 30 22:25:22.586239 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.586200 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-36e5afb065\"/\"default-dockercfg-jlnw5\"" Oct 30 22:25:22.590035 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.590014 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m"] Oct 30 22:25:22.677534 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.677492 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/62177765-9991-4fb4-b5ff-b5b39bafcb1d-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-b14c2-predictor-7bc78958fc-bz78m\" (UID: \"62177765-9991-4fb4-b5ff-b5b39bafcb1d\") " pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" Oct 30 22:25:22.677680 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.677548 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62177765-9991-4fb4-b5ff-b5b39bafcb1d-proxy-tls\") pod \"error-404-isvc-b14c2-predictor-7bc78958fc-bz78m\" (UID: \"62177765-9991-4fb4-b5ff-b5b39bafcb1d\") " pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" Oct 30 22:25:22.677680 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.677654 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hdv4\" (UniqueName: \"kubernetes.io/projected/62177765-9991-4fb4-b5ff-b5b39bafcb1d-kube-api-access-6hdv4\") pod \"error-404-isvc-b14c2-predictor-7bc78958fc-bz78m\" (UID: \"62177765-9991-4fb4-b5ff-b5b39bafcb1d\") " pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" Oct 30 22:25:22.779003 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.778966 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/62177765-9991-4fb4-b5ff-b5b39bafcb1d-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-b14c2-predictor-7bc78958fc-bz78m\" (UID: \"62177765-9991-4fb4-b5ff-b5b39bafcb1d\") " pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" Oct 30 22:25:22.779182 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.779019 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62177765-9991-4fb4-b5ff-b5b39bafcb1d-proxy-tls\") pod \"error-404-isvc-b14c2-predictor-7bc78958fc-bz78m\" (UID: \"62177765-9991-4fb4-b5ff-b5b39bafcb1d\") " pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" Oct 30 22:25:22.779182 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.779056 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hdv4\" (UniqueName: \"kubernetes.io/projected/62177765-9991-4fb4-b5ff-b5b39bafcb1d-kube-api-access-6hdv4\") pod \"error-404-isvc-b14c2-predictor-7bc78958fc-bz78m\" (UID: \"62177765-9991-4fb4-b5ff-b5b39bafcb1d\") " pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" Oct 30 22:25:22.779614 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.779591 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/62177765-9991-4fb4-b5ff-b5b39bafcb1d-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-b14c2-predictor-7bc78958fc-bz78m\" (UID: \"62177765-9991-4fb4-b5ff-b5b39bafcb1d\") " pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" Oct 30 22:25:22.781440 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.781403 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62177765-9991-4fb4-b5ff-b5b39bafcb1d-proxy-tls\") pod \"error-404-isvc-b14c2-predictor-7bc78958fc-bz78m\" (UID: \"62177765-9991-4fb4-b5ff-b5b39bafcb1d\") " pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" Oct 30 22:25:22.791704 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.791679 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hdv4\" (UniqueName: \"kubernetes.io/projected/62177765-9991-4fb4-b5ff-b5b39bafcb1d-kube-api-access-6hdv4\") pod \"error-404-isvc-b14c2-predictor-7bc78958fc-bz78m\" (UID: \"62177765-9991-4fb4-b5ff-b5b39bafcb1d\") " pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" Oct 30 22:25:22.893771 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.893731 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" Oct 30 22:25:22.928266 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:22.928233 7307 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="592ad196-b8dc-4554-bb6c-adb3544e15a0" path="/var/lib/kubelet/pods/592ad196-b8dc-4554-bb6c-adb3544e15a0/volumes" Oct 30 22:25:23.168481 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:23.168406 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m"] Oct 30 22:25:23.174552 ip-10-0-137-4 kubenswrapper[7307]: W1030 22:25:23.174507 7307 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62177765_9991_4fb4_b5ff_b5b39bafcb1d.slice/crio-d8a5e3bf957a41111d412920f2cc012a7d48fccfba074e0f57498f225612c374 WatchSource:0}: Error finding container d8a5e3bf957a41111d412920f2cc012a7d48fccfba074e0f57498f225612c374: Status 404 returned error can't find the container with id d8a5e3bf957a41111d412920f2cc012a7d48fccfba074e0f57498f225612c374 Oct 30 22:25:23.233851 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:23.233818 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" event={"ID":"62177765-9991-4fb4-b5ff-b5b39bafcb1d","Type":"ContainerStarted","Data":"d8a5e3bf957a41111d412920f2cc012a7d48fccfba074e0f57498f225612c374"} Oct 30 22:25:24.239106 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:24.239070 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" event={"ID":"62177765-9991-4fb4-b5ff-b5b39bafcb1d","Type":"ContainerStarted","Data":"1bb2cf97bae65785a5c25f6df556f2f07073674bf622991c38486954cab8df5d"} Oct 30 22:25:24.239562 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:24.239126 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" event={"ID":"62177765-9991-4fb4-b5ff-b5b39bafcb1d","Type":"ContainerStarted","Data":"7c17de6557b2700aafb1a35d27f80702c61957eed333ed054faf91cf9f10c569"} Oct 30 22:25:24.239562 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:24.239201 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" Oct 30 22:25:24.260214 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:24.260158 7307 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" podStartSLOduration=2.26014259 podStartE2EDuration="2.26014259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:25:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:25:24.259402908 +0000 UTC m=+1877.460775108" watchObservedRunningTime="2026-10-30 22:25:24.26014259 +0000 UTC m=+1877.461514790" Oct 30 22:25:25.243323 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:25.243293 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" Oct 30 22:25:25.244550 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:25.244524 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" podUID="62177765-9991-4fb4-b5ff-b5b39bafcb1d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:25:26.246746 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:26.246704 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" podUID="62177765-9991-4fb4-b5ff-b5b39bafcb1d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:25:31.250774 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:31.250744 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" Oct 30 22:25:31.251213 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:31.251188 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" podUID="62177765-9991-4fb4-b5ff-b5b39bafcb1d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:25:41.252067 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:41.252030 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" podUID="62177765-9991-4fb4-b5ff-b5b39bafcb1d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:25:44.275227 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:25:44.275186 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:25:51.251298 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:25:51.251216 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" podUID="62177765-9991-4fb4-b5ff-b5b39bafcb1d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:26:01.251739 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:01.251695 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" podUID="62177765-9991-4fb4-b5ff-b5b39bafcb1d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:26:05.606784 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:05.606748 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8"] Oct 30 22:26:05.607229 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:05.606993 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" podUID="d5734d6d-afa3-43eb-a10f-43d4da8d2494" containerName="kserve-container" containerID="cri-o://f83fcb75b86e2bccc6103c38f3d38dd53c1ee80bee732e7014489301b1142443" gracePeriod=30 Oct 30 22:26:05.607229 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:05.607096 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" podUID="d5734d6d-afa3-43eb-a10f-43d4da8d2494" containerName="kube-rbac-proxy" containerID="cri-o://9d8e9366cba34672a6b8b0ddebff0ef9d68947fe625195aaae7252e39035369c" gracePeriod=30 Oct 30 22:26:06.401011 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:06.400972 7307 generic.go:356] "Generic (PLEG): container finished" podID="d5734d6d-afa3-43eb-a10f-43d4da8d2494" containerID="9d8e9366cba34672a6b8b0ddebff0ef9d68947fe625195aaae7252e39035369c" exitCode=0 Oct 30 22:26:06.401209 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:06.401038 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" event={"ID":"d5734d6d-afa3-43eb-a10f-43d4da8d2494","Type":"ContainerDied","Data":"9d8e9366cba34672a6b8b0ddebff0ef9d68947fe625195aaae7252e39035369c"} Oct 30 22:26:08.274473 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:08.274429 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" podUID="d5734d6d-afa3-43eb-a10f-43d4da8d2494" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.31:8643/healthz\": dial tcp 10.133.0.31:8643: connect: connection refused" Oct 30 22:26:08.280304 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:08.280275 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" podUID="d5734d6d-afa3-43eb-a10f-43d4da8d2494" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:26:09.051534 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:09.051506 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" Oct 30 22:26:09.157268 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:09.157231 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d5734d6d-afa3-43eb-a10f-43d4da8d2494-proxy-tls\" (UniqueName: \"kubernetes.io/secret/d5734d6d-afa3-43eb-a10f-43d4da8d2494-proxy-tls\") pod \"d5734d6d-afa3-43eb-a10f-43d4da8d2494\" (UID: \"d5734d6d-afa3-43eb-a10f-43d4da8d2494\") " Oct 30 22:26:09.157490 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:09.157297 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d5734d6d-afa3-43eb-a10f-43d4da8d2494-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d5734d6d-afa3-43eb-a10f-43d4da8d2494-kube-rbac-proxy-sar-config\") pod \"d5734d6d-afa3-43eb-a10f-43d4da8d2494\" (UID: \"d5734d6d-afa3-43eb-a10f-43d4da8d2494\") " Oct 30 22:26:09.157490 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:09.157351 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d5734d6d-afa3-43eb-a10f-43d4da8d2494-kube-api-access-dwdpz\" (UniqueName: \"kubernetes.io/projected/d5734d6d-afa3-43eb-a10f-43d4da8d2494-kube-api-access-dwdpz\") pod \"d5734d6d-afa3-43eb-a10f-43d4da8d2494\" (UID: \"d5734d6d-afa3-43eb-a10f-43d4da8d2494\") " Oct 30 22:26:09.157728 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:09.157707 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5734d6d-afa3-43eb-a10f-43d4da8d2494-kube-rbac-proxy-sar-config" pod "d5734d6d-afa3-43eb-a10f-43d4da8d2494" (UID: "d5734d6d-afa3-43eb-a10f-43d4da8d2494"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:26:09.159486 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:09.159437 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5734d6d-afa3-43eb-a10f-43d4da8d2494-kube-api-access-dwdpz" pod "d5734d6d-afa3-43eb-a10f-43d4da8d2494" (UID: "d5734d6d-afa3-43eb-a10f-43d4da8d2494"). InnerVolumeSpecName "kube-api-access-dwdpz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:26:09.159486 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:09.159444 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5734d6d-afa3-43eb-a10f-43d4da8d2494-proxy-tls" pod "d5734d6d-afa3-43eb-a10f-43d4da8d2494" (UID: "d5734d6d-afa3-43eb-a10f-43d4da8d2494"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:26:09.258770 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:09.258725 7307 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d5734d6d-afa3-43eb-a10f-43d4da8d2494-proxy-tls\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:26:09.258770 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:09.258762 7307 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d5734d6d-afa3-43eb-a10f-43d4da8d2494-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:26:09.258770 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:09.258773 7307 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwdpz\" (UniqueName: \"kubernetes.io/projected/d5734d6d-afa3-43eb-a10f-43d4da8d2494-kube-api-access-dwdpz\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:26:09.414215 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:09.414122 7307 generic.go:356] "Generic (PLEG): container finished" podID="d5734d6d-afa3-43eb-a10f-43d4da8d2494" containerID="f83fcb75b86e2bccc6103c38f3d38dd53c1ee80bee732e7014489301b1142443" exitCode=0 Oct 30 22:26:09.414215 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:09.414179 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" Oct 30 22:26:09.414738 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:09.414209 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" event={"ID":"d5734d6d-afa3-43eb-a10f-43d4da8d2494","Type":"ContainerDied","Data":"f83fcb75b86e2bccc6103c38f3d38dd53c1ee80bee732e7014489301b1142443"} Oct 30 22:26:09.414738 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:09.414280 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8" event={"ID":"d5734d6d-afa3-43eb-a10f-43d4da8d2494","Type":"ContainerDied","Data":"75b890511c4875fb585e8cd0a83e5cca2477485df4a85780f7719e30cfdb34c0"} Oct 30 22:26:09.414738 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:09.414319 7307 scope.go:122] "RemoveContainer" containerID="9d8e9366cba34672a6b8b0ddebff0ef9d68947fe625195aaae7252e39035369c" Oct 30 22:26:09.422914 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:09.422889 7307 scope.go:122] "RemoveContainer" containerID="f83fcb75b86e2bccc6103c38f3d38dd53c1ee80bee732e7014489301b1142443" Oct 30 22:26:09.430713 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:09.430693 7307 scope.go:122] "RemoveContainer" containerID="9d8e9366cba34672a6b8b0ddebff0ef9d68947fe625195aaae7252e39035369c" Oct 30 22:26:09.431027 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:26:09.431006 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d8e9366cba34672a6b8b0ddebff0ef9d68947fe625195aaae7252e39035369c\": container with ID starting with 9d8e9366cba34672a6b8b0ddebff0ef9d68947fe625195aaae7252e39035369c not found: ID does not exist" containerID="9d8e9366cba34672a6b8b0ddebff0ef9d68947fe625195aaae7252e39035369c" Oct 30 22:26:09.431082 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:09.431039 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d8e9366cba34672a6b8b0ddebff0ef9d68947fe625195aaae7252e39035369c"} err="failed to get container status \"9d8e9366cba34672a6b8b0ddebff0ef9d68947fe625195aaae7252e39035369c\": rpc error: code = NotFound desc = could not find container \"9d8e9366cba34672a6b8b0ddebff0ef9d68947fe625195aaae7252e39035369c\": container with ID starting with 9d8e9366cba34672a6b8b0ddebff0ef9d68947fe625195aaae7252e39035369c not found: ID does not exist" Oct 30 22:26:09.431082 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:09.431057 7307 scope.go:122] "RemoveContainer" containerID="f83fcb75b86e2bccc6103c38f3d38dd53c1ee80bee732e7014489301b1142443" Oct 30 22:26:09.431339 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:26:09.431319 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f83fcb75b86e2bccc6103c38f3d38dd53c1ee80bee732e7014489301b1142443\": container with ID starting with f83fcb75b86e2bccc6103c38f3d38dd53c1ee80bee732e7014489301b1142443 not found: ID does not exist" containerID="f83fcb75b86e2bccc6103c38f3d38dd53c1ee80bee732e7014489301b1142443" Oct 30 22:26:09.432053 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:09.431342 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f83fcb75b86e2bccc6103c38f3d38dd53c1ee80bee732e7014489301b1142443"} err="failed to get container status \"f83fcb75b86e2bccc6103c38f3d38dd53c1ee80bee732e7014489301b1142443\": rpc error: code = NotFound desc = could not find container \"f83fcb75b86e2bccc6103c38f3d38dd53c1ee80bee732e7014489301b1142443\": container with ID starting with f83fcb75b86e2bccc6103c38f3d38dd53c1ee80bee732e7014489301b1142443 not found: ID does not exist" Oct 30 22:26:09.437988 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:09.437955 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8"] Oct 30 22:26:09.442481 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:09.442444 7307 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-32399-predictor-96655cc85-knlc8"] Oct 30 22:26:10.928578 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:10.928546 7307 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d5734d6d-afa3-43eb-a10f-43d4da8d2494" path="/var/lib/kubelet/pods/d5734d6d-afa3-43eb-a10f-43d4da8d2494/volumes" Oct 30 22:26:11.225810 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.225730 7307 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5"] Oct 30 22:26:11.226069 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.226054 7307 cpu_manager.go:414] "containerMap: removing container" podUID="d5734d6d-afa3-43eb-a10f-43d4da8d2494" containerName="kube-rbac-proxy" Oct 30 22:26:11.226134 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.226068 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d5734d6d-afa3-43eb-a10f-43d4da8d2494" containerName="kube-rbac-proxy" Oct 30 22:26:11.226134 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.226085 7307 cpu_manager.go:414] "containerMap: removing container" podUID="d5734d6d-afa3-43eb-a10f-43d4da8d2494" containerName="kserve-container" Oct 30 22:26:11.226134 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.226090 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d5734d6d-afa3-43eb-a10f-43d4da8d2494" containerName="kserve-container" Oct 30 22:26:11.226245 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.226154 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="d5734d6d-afa3-43eb-a10f-43d4da8d2494" containerName="kube-rbac-proxy" Oct 30 22:26:11.226245 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.226165 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="d5734d6d-afa3-43eb-a10f-43d4da8d2494" containerName="kserve-container" Oct 30 22:26:11.230302 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.230280 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" Oct 30 22:26:11.239838 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.239812 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"kube-root-ca.crt\"" Oct 30 22:26:11.240003 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.239853 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"error-404-isvc-18df3-kube-rbac-proxy-sar-config\"" Oct 30 22:26:11.240003 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.239866 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"openshift-service-ca.crt\"" Oct 30 22:26:11.240119 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.239874 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"default-dockercfg-kk2z5\"" Oct 30 22:26:11.240119 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.239938 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a3ce8b9d69\"/\"error-404-isvc-18df3-predictor-serving-cert\"" Oct 30 22:26:11.241071 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.241048 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5"] Oct 30 22:26:11.251232 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.251192 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" podUID="62177765-9991-4fb4-b5ff-b5b39bafcb1d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:26:11.375613 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.375572 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/84ebc189-89cf-4638-a691-e3a1d7421ff0-proxy-tls\") pod \"error-404-isvc-18df3-predictor-7b5568b5d9-k48m5\" (UID: \"84ebc189-89cf-4638-a691-e3a1d7421ff0\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" Oct 30 22:26:11.375794 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.375627 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/84ebc189-89cf-4638-a691-e3a1d7421ff0-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-18df3-predictor-7b5568b5d9-k48m5\" (UID: \"84ebc189-89cf-4638-a691-e3a1d7421ff0\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" Oct 30 22:26:11.375794 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.375757 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqq46\" (UniqueName: \"kubernetes.io/projected/84ebc189-89cf-4638-a691-e3a1d7421ff0-kube-api-access-tqq46\") pod \"error-404-isvc-18df3-predictor-7b5568b5d9-k48m5\" (UID: \"84ebc189-89cf-4638-a691-e3a1d7421ff0\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" Oct 30 22:26:11.476870 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.476773 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/84ebc189-89cf-4638-a691-e3a1d7421ff0-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-18df3-predictor-7b5568b5d9-k48m5\" (UID: \"84ebc189-89cf-4638-a691-e3a1d7421ff0\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" Oct 30 22:26:11.476870 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.476855 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqq46\" (UniqueName: \"kubernetes.io/projected/84ebc189-89cf-4638-a691-e3a1d7421ff0-kube-api-access-tqq46\") pod \"error-404-isvc-18df3-predictor-7b5568b5d9-k48m5\" (UID: \"84ebc189-89cf-4638-a691-e3a1d7421ff0\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" Oct 30 22:26:11.477100 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.476889 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/84ebc189-89cf-4638-a691-e3a1d7421ff0-proxy-tls\") pod \"error-404-isvc-18df3-predictor-7b5568b5d9-k48m5\" (UID: \"84ebc189-89cf-4638-a691-e3a1d7421ff0\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" Oct 30 22:26:11.477487 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.477462 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/84ebc189-89cf-4638-a691-e3a1d7421ff0-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-18df3-predictor-7b5568b5d9-k48m5\" (UID: \"84ebc189-89cf-4638-a691-e3a1d7421ff0\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" Oct 30 22:26:11.479236 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.479217 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/84ebc189-89cf-4638-a691-e3a1d7421ff0-proxy-tls\") pod \"error-404-isvc-18df3-predictor-7b5568b5d9-k48m5\" (UID: \"84ebc189-89cf-4638-a691-e3a1d7421ff0\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" Oct 30 22:26:11.490451 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.490421 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqq46\" (UniqueName: \"kubernetes.io/projected/84ebc189-89cf-4638-a691-e3a1d7421ff0-kube-api-access-tqq46\") pod \"error-404-isvc-18df3-predictor-7b5568b5d9-k48m5\" (UID: \"84ebc189-89cf-4638-a691-e3a1d7421ff0\") " pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" Oct 30 22:26:11.546482 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.546445 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" Oct 30 22:26:11.819902 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:11.819817 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5"] Oct 30 22:26:11.823225 ip-10-0-137-4 kubenswrapper[7307]: W1030 22:26:11.823190 7307 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84ebc189_89cf_4638_a691_e3a1d7421ff0.slice/crio-0d3b9ab9cf51b6f7133fd98bb58de7ddd6b3ad933e6a6101c11dd21c418bb92f WatchSource:0}: Error finding container 0d3b9ab9cf51b6f7133fd98bb58de7ddd6b3ad933e6a6101c11dd21c418bb92f: Status 404 returned error can't find the container with id 0d3b9ab9cf51b6f7133fd98bb58de7ddd6b3ad933e6a6101c11dd21c418bb92f Oct 30 22:26:12.428063 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:12.428023 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" event={"ID":"84ebc189-89cf-4638-a691-e3a1d7421ff0","Type":"ContainerStarted","Data":"9865b7e2230ad01a57506d54a8932090d77a33ac8fc55b217b08f7d3ce83c58a"} Oct 30 22:26:12.428537 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:12.428097 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" event={"ID":"84ebc189-89cf-4638-a691-e3a1d7421ff0","Type":"ContainerStarted","Data":"1a0f85f210b297cb2682b57f69a9b91be36aba4ae89ee848ebc7fcdaeb0dec4d"} Oct 30 22:26:12.428537 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:12.428210 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" Oct 30 22:26:12.428537 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:12.428243 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" event={"ID":"84ebc189-89cf-4638-a691-e3a1d7421ff0","Type":"ContainerStarted","Data":"0d3b9ab9cf51b6f7133fd98bb58de7ddd6b3ad933e6a6101c11dd21c418bb92f"} Oct 30 22:26:12.428537 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:12.428279 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" Oct 30 22:26:12.429971 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:12.429942 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" podUID="84ebc189-89cf-4638-a691-e3a1d7421ff0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:26:12.450110 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:12.450059 7307 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" podStartSLOduration=1.450046109 podStartE2EDuration="1.450046109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:26:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:26:12.449265758 +0000 UTC m=+1925.650637962" watchObservedRunningTime="2026-10-30 22:26:12.450046109 +0000 UTC m=+1925.651418304" Oct 30 22:26:13.432293 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:13.432246 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" podUID="84ebc189-89cf-4638-a691-e3a1d7421ff0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:26:14.274157 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:26:14.274121 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:26:18.436740 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:18.436709 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" Oct 30 22:26:18.437211 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:18.437183 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" podUID="84ebc189-89cf-4638-a691-e3a1d7421ff0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:26:21.252558 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:21.252529 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" Oct 30 22:26:28.437565 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:28.437524 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" podUID="84ebc189-89cf-4638-a691-e3a1d7421ff0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:26:34.021805 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:34.021769 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m"] Oct 30 22:26:34.022227 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:34.022050 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" podUID="62177765-9991-4fb4-b5ff-b5b39bafcb1d" containerName="kserve-container" containerID="cri-o://1bb2cf97bae65785a5c25f6df556f2f07073674bf622991c38486954cab8df5d" gracePeriod=30 Oct 30 22:26:34.022227 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:34.022157 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" podUID="62177765-9991-4fb4-b5ff-b5b39bafcb1d" containerName="kube-rbac-proxy" containerID="cri-o://7c17de6557b2700aafb1a35d27f80702c61957eed333ed054faf91cf9f10c569" gracePeriod=30 Oct 30 22:26:34.511211 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:34.511167 7307 generic.go:356] "Generic (PLEG): container finished" podID="62177765-9991-4fb4-b5ff-b5b39bafcb1d" containerID="7c17de6557b2700aafb1a35d27f80702c61957eed333ed054faf91cf9f10c569" exitCode=0 Oct 30 22:26:34.511409 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:34.511240 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" event={"ID":"62177765-9991-4fb4-b5ff-b5b39bafcb1d","Type":"ContainerDied","Data":"7c17de6557b2700aafb1a35d27f80702c61957eed333ed054faf91cf9f10c569"} Oct 30 22:26:36.247742 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:36.247704 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" podUID="62177765-9991-4fb4-b5ff-b5b39bafcb1d" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.32:8643/healthz\": dial tcp 10.133.0.32:8643: connect: connection refused" Oct 30 22:26:37.766393 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:37.766361 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" Oct 30 22:26:37.813765 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:37.813685 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/62177765-9991-4fb4-b5ff-b5b39bafcb1d-kube-api-access-6hdv4\" (UniqueName: \"kubernetes.io/projected/62177765-9991-4fb4-b5ff-b5b39bafcb1d-kube-api-access-6hdv4\") pod \"62177765-9991-4fb4-b5ff-b5b39bafcb1d\" (UID: \"62177765-9991-4fb4-b5ff-b5b39bafcb1d\") " Oct 30 22:26:37.813765 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:37.813731 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/62177765-9991-4fb4-b5ff-b5b39bafcb1d-proxy-tls\" (UniqueName: \"kubernetes.io/secret/62177765-9991-4fb4-b5ff-b5b39bafcb1d-proxy-tls\") pod \"62177765-9991-4fb4-b5ff-b5b39bafcb1d\" (UID: \"62177765-9991-4fb4-b5ff-b5b39bafcb1d\") " Oct 30 22:26:37.813765 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:37.813759 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/62177765-9991-4fb4-b5ff-b5b39bafcb1d-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/62177765-9991-4fb4-b5ff-b5b39bafcb1d-kube-rbac-proxy-sar-config\") pod \"62177765-9991-4fb4-b5ff-b5b39bafcb1d\" (UID: \"62177765-9991-4fb4-b5ff-b5b39bafcb1d\") " Oct 30 22:26:37.814197 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:37.814163 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62177765-9991-4fb4-b5ff-b5b39bafcb1d-kube-rbac-proxy-sar-config" pod "62177765-9991-4fb4-b5ff-b5b39bafcb1d" (UID: "62177765-9991-4fb4-b5ff-b5b39bafcb1d"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:26:37.815839 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:37.815812 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62177765-9991-4fb4-b5ff-b5b39bafcb1d-kube-api-access-6hdv4" pod "62177765-9991-4fb4-b5ff-b5b39bafcb1d" (UID: "62177765-9991-4fb4-b5ff-b5b39bafcb1d"). InnerVolumeSpecName "kube-api-access-6hdv4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:26:37.815927 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:37.815839 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62177765-9991-4fb4-b5ff-b5b39bafcb1d-proxy-tls" pod "62177765-9991-4fb4-b5ff-b5b39bafcb1d" (UID: "62177765-9991-4fb4-b5ff-b5b39bafcb1d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:26:37.914541 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:37.914503 7307 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hdv4\" (UniqueName: \"kubernetes.io/projected/62177765-9991-4fb4-b5ff-b5b39bafcb1d-kube-api-access-6hdv4\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:26:37.914541 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:37.914533 7307 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62177765-9991-4fb4-b5ff-b5b39bafcb1d-proxy-tls\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:26:37.914541 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:37.914547 7307 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/62177765-9991-4fb4-b5ff-b5b39bafcb1d-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:26:38.437983 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:38.437942 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" podUID="84ebc189-89cf-4638-a691-e3a1d7421ff0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:26:38.530645 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:38.530611 7307 generic.go:356] "Generic (PLEG): container finished" podID="62177765-9991-4fb4-b5ff-b5b39bafcb1d" containerID="1bb2cf97bae65785a5c25f6df556f2f07073674bf622991c38486954cab8df5d" exitCode=0 Oct 30 22:26:38.530828 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:38.530689 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" Oct 30 22:26:38.530828 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:38.530697 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" event={"ID":"62177765-9991-4fb4-b5ff-b5b39bafcb1d","Type":"ContainerDied","Data":"1bb2cf97bae65785a5c25f6df556f2f07073674bf622991c38486954cab8df5d"} Oct 30 22:26:38.530828 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:38.530765 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m" event={"ID":"62177765-9991-4fb4-b5ff-b5b39bafcb1d","Type":"ContainerDied","Data":"d8a5e3bf957a41111d412920f2cc012a7d48fccfba074e0f57498f225612c374"} Oct 30 22:26:38.530828 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:38.530797 7307 scope.go:122] "RemoveContainer" containerID="7c17de6557b2700aafb1a35d27f80702c61957eed333ed054faf91cf9f10c569" Oct 30 22:26:38.540948 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:38.540930 7307 scope.go:122] "RemoveContainer" containerID="1bb2cf97bae65785a5c25f6df556f2f07073674bf622991c38486954cab8df5d" Oct 30 22:26:38.548038 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:38.548022 7307 scope.go:122] "RemoveContainer" containerID="7c17de6557b2700aafb1a35d27f80702c61957eed333ed054faf91cf9f10c569" Oct 30 22:26:38.548303 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:26:38.548282 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c17de6557b2700aafb1a35d27f80702c61957eed333ed054faf91cf9f10c569\": container with ID starting with 7c17de6557b2700aafb1a35d27f80702c61957eed333ed054faf91cf9f10c569 not found: ID does not exist" containerID="7c17de6557b2700aafb1a35d27f80702c61957eed333ed054faf91cf9f10c569" Oct 30 22:26:38.548370 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:38.548312 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c17de6557b2700aafb1a35d27f80702c61957eed333ed054faf91cf9f10c569"} err="failed to get container status \"7c17de6557b2700aafb1a35d27f80702c61957eed333ed054faf91cf9f10c569\": rpc error: code = NotFound desc = could not find container \"7c17de6557b2700aafb1a35d27f80702c61957eed333ed054faf91cf9f10c569\": container with ID starting with 7c17de6557b2700aafb1a35d27f80702c61957eed333ed054faf91cf9f10c569 not found: ID does not exist" Oct 30 22:26:38.548370 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:38.548328 7307 scope.go:122] "RemoveContainer" containerID="1bb2cf97bae65785a5c25f6df556f2f07073674bf622991c38486954cab8df5d" Oct 30 22:26:38.548598 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:26:38.548581 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bb2cf97bae65785a5c25f6df556f2f07073674bf622991c38486954cab8df5d\": container with ID starting with 1bb2cf97bae65785a5c25f6df556f2f07073674bf622991c38486954cab8df5d not found: ID does not exist" containerID="1bb2cf97bae65785a5c25f6df556f2f07073674bf622991c38486954cab8df5d" Oct 30 22:26:38.548641 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:38.548603 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bb2cf97bae65785a5c25f6df556f2f07073674bf622991c38486954cab8df5d"} err="failed to get container status \"1bb2cf97bae65785a5c25f6df556f2f07073674bf622991c38486954cab8df5d\": rpc error: code = NotFound desc = could not find container \"1bb2cf97bae65785a5c25f6df556f2f07073674bf622991c38486954cab8df5d\": container with ID starting with 1bb2cf97bae65785a5c25f6df556f2f07073674bf622991c38486954cab8df5d not found: ID does not exist" Oct 30 22:26:38.556053 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:38.556031 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m"] Oct 30 22:26:38.561152 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:38.561126 7307 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-b14c2-predictor-7bc78958fc-bz78m"] Oct 30 22:26:38.928801 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:38.928768 7307 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="62177765-9991-4fb4-b5ff-b5b39bafcb1d" path="/var/lib/kubelet/pods/62177765-9991-4fb4-b5ff-b5b39bafcb1d/volumes" Oct 30 22:26:39.626729 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.626694 7307 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg"] Oct 30 22:26:39.627059 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.627047 7307 cpu_manager.go:414] "containerMap: removing container" podUID="62177765-9991-4fb4-b5ff-b5b39bafcb1d" containerName="kube-rbac-proxy" Oct 30 22:26:39.627104 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.627060 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="62177765-9991-4fb4-b5ff-b5b39bafcb1d" containerName="kube-rbac-proxy" Oct 30 22:26:39.627104 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.627093 7307 cpu_manager.go:414] "containerMap: removing container" podUID="62177765-9991-4fb4-b5ff-b5b39bafcb1d" containerName="kserve-container" Oct 30 22:26:39.627104 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.627099 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="62177765-9991-4fb4-b5ff-b5b39bafcb1d" containerName="kserve-container" Oct 30 22:26:39.627198 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.627149 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="62177765-9991-4fb4-b5ff-b5b39bafcb1d" containerName="kserve-container" Oct 30 22:26:39.627198 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.627158 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="62177765-9991-4fb4-b5ff-b5b39bafcb1d" containerName="kube-rbac-proxy" Oct 30 22:26:39.631420 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.631401 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" Oct 30 22:26:39.637110 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.637085 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"openshift-service-ca.crt\"" Oct 30 22:26:39.637110 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.637096 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-36e5afb065\"/\"error-404-isvc-e3412-predictor-serving-cert\"" Oct 30 22:26:39.637110 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.637090 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"kube-root-ca.crt\"" Oct 30 22:26:39.637110 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.637107 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-36e5afb065\"/\"error-404-isvc-e3412-kube-rbac-proxy-sar-config\"" Oct 30 22:26:39.637363 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.637131 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-36e5afb065\"/\"default-dockercfg-jlnw5\"" Oct 30 22:26:39.640909 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.640883 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg"] Oct 30 22:26:39.727341 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.727302 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/92395228-e548-4086-a79f-515fad577aea-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg\" (UID: \"92395228-e548-4086-a79f-515fad577aea\") " pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" Oct 30 22:26:39.727535 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.727350 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wvgr\" (UniqueName: \"kubernetes.io/projected/92395228-e548-4086-a79f-515fad577aea-kube-api-access-6wvgr\") pod \"error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg\" (UID: \"92395228-e548-4086-a79f-515fad577aea\") " pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" Oct 30 22:26:39.727535 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.727469 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/92395228-e548-4086-a79f-515fad577aea-proxy-tls\") pod \"error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg\" (UID: \"92395228-e548-4086-a79f-515fad577aea\") " pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" Oct 30 22:26:39.828667 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.828637 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/92395228-e548-4086-a79f-515fad577aea-proxy-tls\") pod \"error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg\" (UID: \"92395228-e548-4086-a79f-515fad577aea\") " pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" Oct 30 22:26:39.828809 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.828711 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/92395228-e548-4086-a79f-515fad577aea-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg\" (UID: \"92395228-e548-4086-a79f-515fad577aea\") " pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" Oct 30 22:26:39.828809 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.828762 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wvgr\" (UniqueName: \"kubernetes.io/projected/92395228-e548-4086-a79f-515fad577aea-kube-api-access-6wvgr\") pod \"error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg\" (UID: \"92395228-e548-4086-a79f-515fad577aea\") " pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" Oct 30 22:26:39.829397 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.829354 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/92395228-e548-4086-a79f-515fad577aea-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg\" (UID: \"92395228-e548-4086-a79f-515fad577aea\") " pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" Oct 30 22:26:39.831112 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.831094 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/92395228-e548-4086-a79f-515fad577aea-proxy-tls\") pod \"error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg\" (UID: \"92395228-e548-4086-a79f-515fad577aea\") " pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" Oct 30 22:26:39.841747 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.841720 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wvgr\" (UniqueName: \"kubernetes.io/projected/92395228-e548-4086-a79f-515fad577aea-kube-api-access-6wvgr\") pod \"error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg\" (UID: \"92395228-e548-4086-a79f-515fad577aea\") " pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" Oct 30 22:26:39.946758 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:39.946670 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" Oct 30 22:26:40.222707 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:40.222630 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg"] Oct 30 22:26:40.225894 ip-10-0-137-4 kubenswrapper[7307]: W1030 22:26:40.225862 7307 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92395228_e548_4086_a79f_515fad577aea.slice/crio-766c5088a94d9153f3277ea6a99aa9ca528a8039ee0d9942c05c7b227029418e WatchSource:0}: Error finding container 766c5088a94d9153f3277ea6a99aa9ca528a8039ee0d9942c05c7b227029418e: Status 404 returned error can't find the container with id 766c5088a94d9153f3277ea6a99aa9ca528a8039ee0d9942c05c7b227029418e Oct 30 22:26:40.547370 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:40.547277 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" event={"ID":"92395228-e548-4086-a79f-515fad577aea","Type":"ContainerStarted","Data":"5633647200f77ee6e65c2d306b4557ccec937604b129aab79e48dd70000907c3"} Oct 30 22:26:40.547370 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:40.547342 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" event={"ID":"92395228-e548-4086-a79f-515fad577aea","Type":"ContainerStarted","Data":"3ba4115052c26355733a41f64ed01b1e4f5ebfe134e2f3448339aa8d25fc7151"} Oct 30 22:26:40.547370 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:40.547365 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" event={"ID":"92395228-e548-4086-a79f-515fad577aea","Type":"ContainerStarted","Data":"766c5088a94d9153f3277ea6a99aa9ca528a8039ee0d9942c05c7b227029418e"} Oct 30 22:26:40.547605 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:40.547419 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" Oct 30 22:26:40.569529 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:40.569473 7307 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" podStartSLOduration=1.569458471 podStartE2EDuration="1.569458471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:26:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:26:40.569020352 +0000 UTC m=+1953.770392554" watchObservedRunningTime="2026-10-30 22:26:40.569458471 +0000 UTC m=+1953.770830650" Oct 30 22:26:41.551545 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:41.551518 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" Oct 30 22:26:41.552562 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:41.552536 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" podUID="92395228-e548-4086-a79f-515fad577aea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 30 22:26:42.555452 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:42.555414 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" podUID="92395228-e548-4086-a79f-515fad577aea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 30 22:26:44.273571 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:26:44.273528 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:26:47.560234 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:47.560205 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" Oct 30 22:26:47.560687 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:47.560659 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" podUID="92395228-e548-4086-a79f-515fad577aea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 30 22:26:48.437228 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:48.437187 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" podUID="84ebc189-89cf-4638-a691-e3a1d7421ff0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:26:57.561200 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:57.561160 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" podUID="92395228-e548-4086-a79f-515fad577aea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 30 22:26:58.437876 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:26:58.437838 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" podUID="84ebc189-89cf-4638-a691-e3a1d7421ff0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:27:07.561663 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:27:07.561580 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" podUID="92395228-e548-4086-a79f-515fad577aea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 30 22:27:08.437558 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:27:08.437528 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" Oct 30 22:27:14.275768 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:27:14.275724 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:27:17.561674 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:27:17.561584 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" podUID="92395228-e548-4086-a79f-515fad577aea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 30 22:27:27.560727 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:27:27.560690 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" podUID="92395228-e548-4086-a79f-515fad577aea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 30 22:27:37.561536 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:27:37.561496 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" Oct 30 22:27:44.273911 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:27:44.273871 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:28:14.273927 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:28:14.273889 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:28:44.273651 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:28:44.273607 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:29:14.274295 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:29:14.274189 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:29:44.272756 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:29:44.272718 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:30:14.274154 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:30:14.274116 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:30:44.273108 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:30:44.273069 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:31:14.273329 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:31:14.273295 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:31:44.274029 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:31:44.273991 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:32:14.273223 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:32:14.273143 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:32:44.274275 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:32:44.274239 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:33:14.274043 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:33:14.273993 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:33:44.273686 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:33:44.273649 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:34:14.274101 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:34:14.274064 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:34:44.274346 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:34:44.274304 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:35:14.273005 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:35:14.272922 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:35:44.273917 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:35:44.273879 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:36:05.459923 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:05.459884 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg"] Oct 30 22:36:05.460562 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:05.460094 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" podUID="92395228-e548-4086-a79f-515fad577aea" containerName="kserve-container" containerID="cri-o://3ba4115052c26355733a41f64ed01b1e4f5ebfe134e2f3448339aa8d25fc7151" gracePeriod=30 Oct 30 22:36:05.460562 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:05.460117 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" podUID="92395228-e548-4086-a79f-515fad577aea" containerName="kube-rbac-proxy" containerID="cri-o://5633647200f77ee6e65c2d306b4557ccec937604b129aab79e48dd70000907c3" gracePeriod=30 Oct 30 22:36:05.678132 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:05.678097 7307 generic.go:356] "Generic (PLEG): container finished" podID="92395228-e548-4086-a79f-515fad577aea" containerID="5633647200f77ee6e65c2d306b4557ccec937604b129aab79e48dd70000907c3" exitCode=0 Oct 30 22:36:05.678301 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:05.678176 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" event={"ID":"92395228-e548-4086-a79f-515fad577aea","Type":"ContainerDied","Data":"5633647200f77ee6e65c2d306b4557ccec937604b129aab79e48dd70000907c3"} Oct 30 22:36:07.556181 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:07.556135 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" podUID="92395228-e548-4086-a79f-515fad577aea" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.34:8643/healthz\": dial tcp 10.133.0.34:8643: connect: connection refused" Oct 30 22:36:07.561521 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:07.561495 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" podUID="92395228-e548-4086-a79f-515fad577aea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 30 22:36:09.000806 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:09.000780 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" Oct 30 22:36:09.152709 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:09.152679 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92395228-e548-4086-a79f-515fad577aea-proxy-tls\" (UniqueName: \"kubernetes.io/secret/92395228-e548-4086-a79f-515fad577aea-proxy-tls\") pod \"92395228-e548-4086-a79f-515fad577aea\" (UID: \"92395228-e548-4086-a79f-515fad577aea\") " Oct 30 22:36:09.152890 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:09.152748 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/92395228-e548-4086-a79f-515fad577aea-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/92395228-e548-4086-a79f-515fad577aea-kube-rbac-proxy-sar-config\") pod \"92395228-e548-4086-a79f-515fad577aea\" (UID: \"92395228-e548-4086-a79f-515fad577aea\") " Oct 30 22:36:09.152890 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:09.152800 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/92395228-e548-4086-a79f-515fad577aea-kube-api-access-6wvgr\" (UniqueName: \"kubernetes.io/projected/92395228-e548-4086-a79f-515fad577aea-kube-api-access-6wvgr\") pod \"92395228-e548-4086-a79f-515fad577aea\" (UID: \"92395228-e548-4086-a79f-515fad577aea\") " Oct 30 22:36:09.153090 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:09.153065 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92395228-e548-4086-a79f-515fad577aea-kube-rbac-proxy-sar-config" pod "92395228-e548-4086-a79f-515fad577aea" (UID: "92395228-e548-4086-a79f-515fad577aea"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:36:09.154831 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:09.154803 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92395228-e548-4086-a79f-515fad577aea-kube-api-access-6wvgr" pod "92395228-e548-4086-a79f-515fad577aea" (UID: "92395228-e548-4086-a79f-515fad577aea"). InnerVolumeSpecName "kube-api-access-6wvgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:36:09.155071 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:09.154881 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92395228-e548-4086-a79f-515fad577aea-proxy-tls" pod "92395228-e548-4086-a79f-515fad577aea" (UID: "92395228-e548-4086-a79f-515fad577aea"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:36:09.253675 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:09.253638 7307 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/92395228-e548-4086-a79f-515fad577aea-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:36:09.253675 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:09.253668 7307 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wvgr\" (UniqueName: \"kubernetes.io/projected/92395228-e548-4086-a79f-515fad577aea-kube-api-access-6wvgr\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:36:09.253675 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:09.253678 7307 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/92395228-e548-4086-a79f-515fad577aea-proxy-tls\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:36:09.694206 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:09.694170 7307 generic.go:356] "Generic (PLEG): container finished" podID="92395228-e548-4086-a79f-515fad577aea" containerID="3ba4115052c26355733a41f64ed01b1e4f5ebfe134e2f3448339aa8d25fc7151" exitCode=0 Oct 30 22:36:09.694433 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:09.694226 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" Oct 30 22:36:09.694433 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:09.694256 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" event={"ID":"92395228-e548-4086-a79f-515fad577aea","Type":"ContainerDied","Data":"3ba4115052c26355733a41f64ed01b1e4f5ebfe134e2f3448339aa8d25fc7151"} Oct 30 22:36:09.694433 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:09.694333 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg" event={"ID":"92395228-e548-4086-a79f-515fad577aea","Type":"ContainerDied","Data":"766c5088a94d9153f3277ea6a99aa9ca528a8039ee0d9942c05c7b227029418e"} Oct 30 22:36:09.694433 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:09.694369 7307 scope.go:122] "RemoveContainer" containerID="5633647200f77ee6e65c2d306b4557ccec937604b129aab79e48dd70000907c3" Oct 30 22:36:09.703358 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:09.703338 7307 scope.go:122] "RemoveContainer" containerID="3ba4115052c26355733a41f64ed01b1e4f5ebfe134e2f3448339aa8d25fc7151" Oct 30 22:36:09.710778 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:09.710762 7307 scope.go:122] "RemoveContainer" containerID="5633647200f77ee6e65c2d306b4557ccec937604b129aab79e48dd70000907c3" Oct 30 22:36:09.711023 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:36:09.711003 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5633647200f77ee6e65c2d306b4557ccec937604b129aab79e48dd70000907c3\": container with ID starting with 5633647200f77ee6e65c2d306b4557ccec937604b129aab79e48dd70000907c3 not found: ID does not exist" containerID="5633647200f77ee6e65c2d306b4557ccec937604b129aab79e48dd70000907c3" Oct 30 22:36:09.711066 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:09.711033 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5633647200f77ee6e65c2d306b4557ccec937604b129aab79e48dd70000907c3"} err="failed to get container status \"5633647200f77ee6e65c2d306b4557ccec937604b129aab79e48dd70000907c3\": rpc error: code = NotFound desc = could not find container \"5633647200f77ee6e65c2d306b4557ccec937604b129aab79e48dd70000907c3\": container with ID starting with 5633647200f77ee6e65c2d306b4557ccec937604b129aab79e48dd70000907c3 not found: ID does not exist" Oct 30 22:36:09.711066 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:09.711051 7307 scope.go:122] "RemoveContainer" containerID="3ba4115052c26355733a41f64ed01b1e4f5ebfe134e2f3448339aa8d25fc7151" Oct 30 22:36:09.711285 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:36:09.711269 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ba4115052c26355733a41f64ed01b1e4f5ebfe134e2f3448339aa8d25fc7151\": container with ID starting with 3ba4115052c26355733a41f64ed01b1e4f5ebfe134e2f3448339aa8d25fc7151 not found: ID does not exist" containerID="3ba4115052c26355733a41f64ed01b1e4f5ebfe134e2f3448339aa8d25fc7151" Oct 30 22:36:09.711338 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:09.711289 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ba4115052c26355733a41f64ed01b1e4f5ebfe134e2f3448339aa8d25fc7151"} err="failed to get container status \"3ba4115052c26355733a41f64ed01b1e4f5ebfe134e2f3448339aa8d25fc7151\": rpc error: code = NotFound desc = could not find container \"3ba4115052c26355733a41f64ed01b1e4f5ebfe134e2f3448339aa8d25fc7151\": container with ID starting with 3ba4115052c26355733a41f64ed01b1e4f5ebfe134e2f3448339aa8d25fc7151 not found: ID does not exist" Oct 30 22:36:09.717755 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:09.717734 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg"] Oct 30 22:36:09.722194 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:09.722170 7307 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-36e5afb065/error-404-isvc-e3412-predictor-7f7b7cb4bc-gh8tg"] Oct 30 22:36:10.928316 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:36:10.928277 7307 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="92395228-e548-4086-a79f-515fad577aea" path="/var/lib/kubelet/pods/92395228-e548-4086-a79f-515fad577aea/volumes" Oct 30 22:36:14.274979 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:36:14.274938 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:36:44.274033 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:36:44.273993 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:37:14.273617 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:37:14.273575 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:37:44.272531 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:37:44.272490 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:38:14.273370 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:38:14.273291 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:38:44.274174 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:38:44.274129 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:39:14.273561 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:39:14.273525 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:39:44.274299 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:39:44.274250 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:40:14.274113 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:40:14.274071 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:40:44.272612 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:40:44.272569 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:41:14.275151 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:41:14.275070 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:41:44.274899 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:41:44.274858 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:42:14.274261 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:42:14.274224 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:42:44.273620 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:42:44.273581 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:43:14.273870 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:43:14.273828 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:43:42.512249 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:42.512211 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5"] Oct 30 22:43:42.512792 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:42.512441 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" podUID="84ebc189-89cf-4638-a691-e3a1d7421ff0" containerName="kserve-container" containerID="cri-o://1a0f85f210b297cb2682b57f69a9b91be36aba4ae89ee848ebc7fcdaeb0dec4d" gracePeriod=30 Oct 30 22:43:42.512792 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:42.512511 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" podUID="84ebc189-89cf-4638-a691-e3a1d7421ff0" containerName="kube-rbac-proxy" containerID="cri-o://9865b7e2230ad01a57506d54a8932090d77a33ac8fc55b217b08f7d3ce83c58a" gracePeriod=30 Oct 30 22:43:43.358951 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:43.358910 7307 generic.go:356] "Generic (PLEG): container finished" podID="84ebc189-89cf-4638-a691-e3a1d7421ff0" containerID="9865b7e2230ad01a57506d54a8932090d77a33ac8fc55b217b08f7d3ce83c58a" exitCode=0 Oct 30 22:43:43.359115 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:43.358980 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" event={"ID":"84ebc189-89cf-4638-a691-e3a1d7421ff0","Type":"ContainerDied","Data":"9865b7e2230ad01a57506d54a8932090d77a33ac8fc55b217b08f7d3ce83c58a"} Oct 30 22:43:43.432680 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:43.432640 7307 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" podUID="84ebc189-89cf-4638-a691-e3a1d7421ff0" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.33:8643/healthz\": dial tcp 10.133.0.33:8643: connect: connection refused" Oct 30 22:43:44.274125 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:43:44.274090 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:43:46.048881 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:46.048854 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" Oct 30 22:43:46.141644 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:46.141611 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/84ebc189-89cf-4638-a691-e3a1d7421ff0-kube-api-access-tqq46\" (UniqueName: \"kubernetes.io/projected/84ebc189-89cf-4638-a691-e3a1d7421ff0-kube-api-access-tqq46\") pod \"84ebc189-89cf-4638-a691-e3a1d7421ff0\" (UID: \"84ebc189-89cf-4638-a691-e3a1d7421ff0\") " Oct 30 22:43:46.141839 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:46.141684 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/84ebc189-89cf-4638-a691-e3a1d7421ff0-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/84ebc189-89cf-4638-a691-e3a1d7421ff0-kube-rbac-proxy-sar-config\") pod \"84ebc189-89cf-4638-a691-e3a1d7421ff0\" (UID: \"84ebc189-89cf-4638-a691-e3a1d7421ff0\") " Oct 30 22:43:46.141839 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:46.141742 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/84ebc189-89cf-4638-a691-e3a1d7421ff0-proxy-tls\" (UniqueName: \"kubernetes.io/secret/84ebc189-89cf-4638-a691-e3a1d7421ff0-proxy-tls\") pod \"84ebc189-89cf-4638-a691-e3a1d7421ff0\" (UID: \"84ebc189-89cf-4638-a691-e3a1d7421ff0\") " Oct 30 22:43:46.142117 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:46.142081 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84ebc189-89cf-4638-a691-e3a1d7421ff0-kube-rbac-proxy-sar-config" pod "84ebc189-89cf-4638-a691-e3a1d7421ff0" (UID: "84ebc189-89cf-4638-a691-e3a1d7421ff0"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:43:46.143910 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:46.143888 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84ebc189-89cf-4638-a691-e3a1d7421ff0-proxy-tls" pod "84ebc189-89cf-4638-a691-e3a1d7421ff0" (UID: "84ebc189-89cf-4638-a691-e3a1d7421ff0"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:43:46.143993 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:46.143914 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84ebc189-89cf-4638-a691-e3a1d7421ff0-kube-api-access-tqq46" pod "84ebc189-89cf-4638-a691-e3a1d7421ff0" (UID: "84ebc189-89cf-4638-a691-e3a1d7421ff0"). InnerVolumeSpecName "kube-api-access-tqq46". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:43:46.242923 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:46.242886 7307 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/84ebc189-89cf-4638-a691-e3a1d7421ff0-proxy-tls\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:43:46.242923 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:46.242917 7307 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqq46\" (UniqueName: \"kubernetes.io/projected/84ebc189-89cf-4638-a691-e3a1d7421ff0-kube-api-access-tqq46\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:43:46.242923 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:46.242931 7307 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/84ebc189-89cf-4638-a691-e3a1d7421ff0-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:43:46.372294 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:46.372257 7307 generic.go:356] "Generic (PLEG): container finished" podID="84ebc189-89cf-4638-a691-e3a1d7421ff0" containerID="1a0f85f210b297cb2682b57f69a9b91be36aba4ae89ee848ebc7fcdaeb0dec4d" exitCode=0 Oct 30 22:43:46.372476 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:46.372318 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" Oct 30 22:43:46.372476 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:46.372337 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" event={"ID":"84ebc189-89cf-4638-a691-e3a1d7421ff0","Type":"ContainerDied","Data":"1a0f85f210b297cb2682b57f69a9b91be36aba4ae89ee848ebc7fcdaeb0dec4d"} Oct 30 22:43:46.372476 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:46.372414 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5" event={"ID":"84ebc189-89cf-4638-a691-e3a1d7421ff0","Type":"ContainerDied","Data":"0d3b9ab9cf51b6f7133fd98bb58de7ddd6b3ad933e6a6101c11dd21c418bb92f"} Oct 30 22:43:46.372476 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:46.372442 7307 scope.go:122] "RemoveContainer" containerID="9865b7e2230ad01a57506d54a8932090d77a33ac8fc55b217b08f7d3ce83c58a" Oct 30 22:43:46.381638 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:46.381613 7307 scope.go:122] "RemoveContainer" containerID="1a0f85f210b297cb2682b57f69a9b91be36aba4ae89ee848ebc7fcdaeb0dec4d" Oct 30 22:43:46.388737 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:46.388718 7307 scope.go:122] "RemoveContainer" containerID="9865b7e2230ad01a57506d54a8932090d77a33ac8fc55b217b08f7d3ce83c58a" Oct 30 22:43:46.388986 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:43:46.388967 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9865b7e2230ad01a57506d54a8932090d77a33ac8fc55b217b08f7d3ce83c58a\": container with ID starting with 9865b7e2230ad01a57506d54a8932090d77a33ac8fc55b217b08f7d3ce83c58a not found: ID does not exist" containerID="9865b7e2230ad01a57506d54a8932090d77a33ac8fc55b217b08f7d3ce83c58a" Oct 30 22:43:46.389030 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:46.388996 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9865b7e2230ad01a57506d54a8932090d77a33ac8fc55b217b08f7d3ce83c58a"} err="failed to get container status \"9865b7e2230ad01a57506d54a8932090d77a33ac8fc55b217b08f7d3ce83c58a\": rpc error: code = NotFound desc = could not find container \"9865b7e2230ad01a57506d54a8932090d77a33ac8fc55b217b08f7d3ce83c58a\": container with ID starting with 9865b7e2230ad01a57506d54a8932090d77a33ac8fc55b217b08f7d3ce83c58a not found: ID does not exist" Oct 30 22:43:46.389030 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:46.389014 7307 scope.go:122] "RemoveContainer" containerID="1a0f85f210b297cb2682b57f69a9b91be36aba4ae89ee848ebc7fcdaeb0dec4d" Oct 30 22:43:46.389251 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:43:46.389233 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a0f85f210b297cb2682b57f69a9b91be36aba4ae89ee848ebc7fcdaeb0dec4d\": container with ID starting with 1a0f85f210b297cb2682b57f69a9b91be36aba4ae89ee848ebc7fcdaeb0dec4d not found: ID does not exist" containerID="1a0f85f210b297cb2682b57f69a9b91be36aba4ae89ee848ebc7fcdaeb0dec4d" Oct 30 22:43:46.389291 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:46.389257 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a0f85f210b297cb2682b57f69a9b91be36aba4ae89ee848ebc7fcdaeb0dec4d"} err="failed to get container status \"1a0f85f210b297cb2682b57f69a9b91be36aba4ae89ee848ebc7fcdaeb0dec4d\": rpc error: code = NotFound desc = could not find container \"1a0f85f210b297cb2682b57f69a9b91be36aba4ae89ee848ebc7fcdaeb0dec4d\": container with ID starting with 1a0f85f210b297cb2682b57f69a9b91be36aba4ae89ee848ebc7fcdaeb0dec4d not found: ID does not exist" Oct 30 22:43:46.395761 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:46.395713 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5"] Oct 30 22:43:46.400423 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:46.400404 7307 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-a3ce8b9d69/error-404-isvc-18df3-predictor-7b5568b5d9-k48m5"] Oct 30 22:43:46.928270 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:46.928227 7307 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="84ebc189-89cf-4638-a691-e3a1d7421ff0" path="/var/lib/kubelet/pods/84ebc189-89cf-4638-a691-e3a1d7421ff0/volumes" Oct 30 22:43:49.769299 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.769221 7307 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-82rgt/must-gather-8d76m"] Oct 30 22:43:49.769696 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.769619 7307 cpu_manager.go:414] "containerMap: removing container" podUID="92395228-e548-4086-a79f-515fad577aea" containerName="kserve-container" Oct 30 22:43:49.769696 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.769634 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="92395228-e548-4086-a79f-515fad577aea" containerName="kserve-container" Oct 30 22:43:49.769696 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.769653 7307 cpu_manager.go:414] "containerMap: removing container" podUID="92395228-e548-4086-a79f-515fad577aea" containerName="kube-rbac-proxy" Oct 30 22:43:49.769696 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.769659 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="92395228-e548-4086-a79f-515fad577aea" containerName="kube-rbac-proxy" Oct 30 22:43:49.769696 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.769674 7307 cpu_manager.go:414] "containerMap: removing container" podUID="84ebc189-89cf-4638-a691-e3a1d7421ff0" containerName="kserve-container" Oct 30 22:43:49.769696 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.769678 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="84ebc189-89cf-4638-a691-e3a1d7421ff0" containerName="kserve-container" Oct 30 22:43:49.769696 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.769691 7307 cpu_manager.go:414] "containerMap: removing container" podUID="84ebc189-89cf-4638-a691-e3a1d7421ff0" containerName="kube-rbac-proxy" Oct 30 22:43:49.769696 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.769696 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="84ebc189-89cf-4638-a691-e3a1d7421ff0" containerName="kube-rbac-proxy" Oct 30 22:43:49.769974 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.769751 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="92395228-e548-4086-a79f-515fad577aea" containerName="kube-rbac-proxy" Oct 30 22:43:49.769974 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.769761 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="84ebc189-89cf-4638-a691-e3a1d7421ff0" containerName="kserve-container" Oct 30 22:43:49.769974 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.769768 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="84ebc189-89cf-4638-a691-e3a1d7421ff0" containerName="kube-rbac-proxy" Oct 30 22:43:49.769974 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.769775 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="92395228-e548-4086-a79f-515fad577aea" containerName="kserve-container" Oct 30 22:43:49.774138 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.774122 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-82rgt/must-gather-8d76m" Oct 30 22:43:49.782181 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.782158 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-82rgt\"/\"openshift-service-ca.crt\"" Oct 30 22:43:49.782426 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.782407 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-82rgt\"/\"default-dockercfg-96nbk\"" Oct 30 22:43:49.782542 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.782458 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-82rgt\"/\"kube-root-ca.crt\"" Oct 30 22:43:49.783013 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.782995 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-82rgt/must-gather-8d76m"] Oct 30 22:43:49.872721 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.872674 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2d87400c-c699-434d-af6d-51520a02b389-must-gather-output\") pod \"must-gather-8d76m\" (UID: \"2d87400c-c699-434d-af6d-51520a02b389\") " pod="openshift-must-gather-82rgt/must-gather-8d76m" Oct 30 22:43:49.872721 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.872726 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgwkq\" (UniqueName: \"kubernetes.io/projected/2d87400c-c699-434d-af6d-51520a02b389-kube-api-access-mgwkq\") pod \"must-gather-8d76m\" (UID: \"2d87400c-c699-434d-af6d-51520a02b389\") " pod="openshift-must-gather-82rgt/must-gather-8d76m" Oct 30 22:43:49.973400 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.973343 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2d87400c-c699-434d-af6d-51520a02b389-must-gather-output\") pod \"must-gather-8d76m\" (UID: \"2d87400c-c699-434d-af6d-51520a02b389\") " pod="openshift-must-gather-82rgt/must-gather-8d76m" Oct 30 22:43:49.973609 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.973417 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgwkq\" (UniqueName: \"kubernetes.io/projected/2d87400c-c699-434d-af6d-51520a02b389-kube-api-access-mgwkq\") pod \"must-gather-8d76m\" (UID: \"2d87400c-c699-434d-af6d-51520a02b389\") " pod="openshift-must-gather-82rgt/must-gather-8d76m" Oct 30 22:43:49.973733 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.973715 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2d87400c-c699-434d-af6d-51520a02b389-must-gather-output\") pod \"must-gather-8d76m\" (UID: \"2d87400c-c699-434d-af6d-51520a02b389\") " pod="openshift-must-gather-82rgt/must-gather-8d76m" Oct 30 22:43:49.987271 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:49.987244 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgwkq\" (UniqueName: \"kubernetes.io/projected/2d87400c-c699-434d-af6d-51520a02b389-kube-api-access-mgwkq\") pod \"must-gather-8d76m\" (UID: \"2d87400c-c699-434d-af6d-51520a02b389\") " pod="openshift-must-gather-82rgt/must-gather-8d76m" Oct 30 22:43:50.102405 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:50.102305 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-82rgt/must-gather-8d76m" Oct 30 22:43:50.375148 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:50.375116 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-82rgt/must-gather-8d76m"] Oct 30 22:43:50.378855 ip-10-0-137-4 kubenswrapper[7307]: W1030 22:43:50.378817 7307 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d87400c_c699_434d_af6d_51520a02b389.slice/crio-7e751aefb8711228b4a307f15b62223866dde63c4e1aeb2bf3c67164ca9adf3d WatchSource:0}: Error finding container 7e751aefb8711228b4a307f15b62223866dde63c4e1aeb2bf3c67164ca9adf3d: Status 404 returned error can't find the container with id 7e751aefb8711228b4a307f15b62223866dde63c4e1aeb2bf3c67164ca9adf3d Oct 30 22:43:50.380703 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:50.380678 7307 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 22:43:50.389591 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:50.389563 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-82rgt/must-gather-8d76m" event={"ID":"2d87400c-c699-434d-af6d-51520a02b389","Type":"ContainerStarted","Data":"7e751aefb8711228b4a307f15b62223866dde63c4e1aeb2bf3c67164ca9adf3d"} Oct 30 22:43:57.424620 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:57.424574 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-82rgt/must-gather-8d76m" event={"ID":"2d87400c-c699-434d-af6d-51520a02b389","Type":"ContainerStarted","Data":"a04a094efe86cf23060560bb57f16be9edca21672171182c25cff223d7357fbc"} Oct 30 22:43:57.425089 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:57.424633 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-82rgt/must-gather-8d76m" event={"ID":"2d87400c-c699-434d-af6d-51520a02b389","Type":"ContainerStarted","Data":"fcafd091101d7b28695282f68fab54b17f9317ad9d3282e929ad2fef06ddcfeb"} Oct 30 22:43:57.444350 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:43:57.444278 7307 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-82rgt/must-gather-8d76m" podStartSLOduration=2.073589237 podStartE2EDuration="8.444260959s" totalImagesPullingTime="6.370671722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:43:57.44357095 +0000 UTC m=+2990.644943179" watchObservedRunningTime="2026-10-30 22:43:57.444260959 +0000 UTC m=+2990.645633160" Oct 30 22:44:14.275187 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:44:14.275140 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:44:32.574722 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:32.574685 7307 generic.go:356] "Generic (PLEG): container finished" podID="2d87400c-c699-434d-af6d-51520a02b389" containerID="fcafd091101d7b28695282f68fab54b17f9317ad9d3282e929ad2fef06ddcfeb" exitCode=0 Oct 30 22:44:32.575280 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:32.574730 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-82rgt/must-gather-8d76m" event={"ID":"2d87400c-c699-434d-af6d-51520a02b389","Type":"ContainerDied","Data":"fcafd091101d7b28695282f68fab54b17f9317ad9d3282e929ad2fef06ddcfeb"} Oct 30 22:44:32.575280 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:32.575160 7307 scope.go:122] "RemoveContainer" containerID="fcafd091101d7b28695282f68fab54b17f9317ad9d3282e929ad2fef06ddcfeb" Oct 30 22:44:32.754646 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:32.754614 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-82rgt_must-gather-8d76m_2d87400c-c699-434d-af6d-51520a02b389/gather/0.log" Oct 30 22:44:36.541504 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:36.541468 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kczg2_0081a009-4575-4b35-bf6b-6d12dd90067b/global-pull-secret-syncer/0.log" Oct 30 22:44:36.898819 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:36.898785 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mrg22_dcb86fdd-20cd-45b3-8533-a6900b903f13/konnectivity-agent/0.log" Oct 30 22:44:36.959025 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:36.958993 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-4.us-east-2.compute.internal_217839645ba686b08e18edb27afa5bea/haproxy/0.log" Oct 30 22:44:38.339435 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:38.339396 7307 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-82rgt/must-gather-8d76m"] Oct 30 22:44:38.339862 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:38.339597 7307 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-must-gather-82rgt/must-gather-8d76m" podUID="2d87400c-c699-434d-af6d-51520a02b389" containerName="copy" containerID="cri-o://a04a094efe86cf23060560bb57f16be9edca21672171182c25cff223d7357fbc" gracePeriod=2 Oct 30 22:44:38.344074 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:38.344035 7307 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-82rgt/must-gather-8d76m"] Oct 30 22:44:38.568575 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:38.568550 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-82rgt_must-gather-8d76m_2d87400c-c699-434d-af6d-51520a02b389/copy/0.log" Oct 30 22:44:38.571141 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:38.571121 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-82rgt/must-gather-8d76m" Oct 30 22:44:38.574188 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:44:38.574164 7307 status_manager.go:1045] "Failed to get status for pod" err="pods \"must-gather-8d76m\" is forbidden: User \"system:node:ip-10-0-137-4.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-82rgt\": no relationship found between node 'ip-10-0-137-4.us-east-2.compute.internal' and this object" podUID="2d87400c-c699-434d-af6d-51520a02b389" pod="openshift-must-gather-82rgt/must-gather-8d76m" Oct 30 22:44:38.596001 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:38.595942 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-82rgt_must-gather-8d76m_2d87400c-c699-434d-af6d-51520a02b389/copy/0.log" Oct 30 22:44:38.596282 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:38.596260 7307 generic.go:356] "Generic (PLEG): container finished" podID="2d87400c-c699-434d-af6d-51520a02b389" containerID="a04a094efe86cf23060560bb57f16be9edca21672171182c25cff223d7357fbc" exitCode=143 Oct 30 22:44:38.596329 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:38.596313 7307 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-82rgt/must-gather-8d76m" Oct 30 22:44:38.596367 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:38.596353 7307 scope.go:122] "RemoveContainer" containerID="a04a094efe86cf23060560bb57f16be9edca21672171182c25cff223d7357fbc" Oct 30 22:44:38.599169 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:44:38.599148 7307 status_manager.go:1045] "Failed to get status for pod" err="pods \"must-gather-8d76m\" is forbidden: User \"system:node:ip-10-0-137-4.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-82rgt\": no relationship found between node 'ip-10-0-137-4.us-east-2.compute.internal' and this object" podUID="2d87400c-c699-434d-af6d-51520a02b389" pod="openshift-must-gather-82rgt/must-gather-8d76m" Oct 30 22:44:38.603582 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:38.603568 7307 scope.go:122] "RemoveContainer" containerID="fcafd091101d7b28695282f68fab54b17f9317ad9d3282e929ad2fef06ddcfeb" Oct 30 22:44:38.616077 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:38.616056 7307 scope.go:122] "RemoveContainer" containerID="a04a094efe86cf23060560bb57f16be9edca21672171182c25cff223d7357fbc" Oct 30 22:44:38.616355 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:44:38.616326 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a04a094efe86cf23060560bb57f16be9edca21672171182c25cff223d7357fbc\": container with ID starting with a04a094efe86cf23060560bb57f16be9edca21672171182c25cff223d7357fbc not found: ID does not exist" containerID="a04a094efe86cf23060560bb57f16be9edca21672171182c25cff223d7357fbc" Oct 30 22:44:38.616448 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:38.616366 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a04a094efe86cf23060560bb57f16be9edca21672171182c25cff223d7357fbc"} err="failed to get container status \"a04a094efe86cf23060560bb57f16be9edca21672171182c25cff223d7357fbc\": rpc error: code = NotFound desc = could not find container \"a04a094efe86cf23060560bb57f16be9edca21672171182c25cff223d7357fbc\": container with ID starting with a04a094efe86cf23060560bb57f16be9edca21672171182c25cff223d7357fbc not found: ID does not exist" Oct 30 22:44:38.616448 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:38.616407 7307 scope.go:122] "RemoveContainer" containerID="fcafd091101d7b28695282f68fab54b17f9317ad9d3282e929ad2fef06ddcfeb" Oct 30 22:44:38.616697 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:44:38.616676 7307 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcafd091101d7b28695282f68fab54b17f9317ad9d3282e929ad2fef06ddcfeb\": container with ID starting with fcafd091101d7b28695282f68fab54b17f9317ad9d3282e929ad2fef06ddcfeb not found: ID does not exist" containerID="fcafd091101d7b28695282f68fab54b17f9317ad9d3282e929ad2fef06ddcfeb" Oct 30 22:44:38.616745 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:38.616704 7307 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcafd091101d7b28695282f68fab54b17f9317ad9d3282e929ad2fef06ddcfeb"} err="failed to get container status \"fcafd091101d7b28695282f68fab54b17f9317ad9d3282e929ad2fef06ddcfeb\": rpc error: code = NotFound desc = could not find container \"fcafd091101d7b28695282f68fab54b17f9317ad9d3282e929ad2fef06ddcfeb\": container with ID starting with fcafd091101d7b28695282f68fab54b17f9317ad9d3282e929ad2fef06ddcfeb not found: ID does not exist" Oct 30 22:44:38.737886 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:38.737846 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d87400c-c699-434d-af6d-51520a02b389-must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2d87400c-c699-434d-af6d-51520a02b389-must-gather-output\") pod \"2d87400c-c699-434d-af6d-51520a02b389\" (UID: \"2d87400c-c699-434d-af6d-51520a02b389\") " Oct 30 22:44:38.738051 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:38.737938 7307 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d87400c-c699-434d-af6d-51520a02b389-kube-api-access-mgwkq\" (UniqueName: \"kubernetes.io/projected/2d87400c-c699-434d-af6d-51520a02b389-kube-api-access-mgwkq\") pod \"2d87400c-c699-434d-af6d-51520a02b389\" (UID: \"2d87400c-c699-434d-af6d-51520a02b389\") " Oct 30 22:44:38.740128 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:38.740104 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d87400c-c699-434d-af6d-51520a02b389-kube-api-access-mgwkq" pod "2d87400c-c699-434d-af6d-51520a02b389" (UID: "2d87400c-c699-434d-af6d-51520a02b389"). InnerVolumeSpecName "kube-api-access-mgwkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:44:38.742122 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:38.742097 7307 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d87400c-c699-434d-af6d-51520a02b389-must-gather-output" pod "2d87400c-c699-434d-af6d-51520a02b389" (UID: "2d87400c-c699-434d-af6d-51520a02b389"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:44:38.839416 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:38.839344 7307 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2d87400c-c699-434d-af6d-51520a02b389-must-gather-output\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:44:38.839416 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:38.839411 7307 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgwkq\" (UniqueName: \"kubernetes.io/projected/2d87400c-c699-434d-af6d-51520a02b389-kube-api-access-mgwkq\") on node \"ip-10-0-137-4.us-east-2.compute.internal\" DevicePath \"\"" Oct 30 22:44:38.907756 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:44:38.907716 7307 status_manager.go:1045] "Failed to get status for pod" err="pods \"must-gather-8d76m\" is forbidden: User \"system:node:ip-10-0-137-4.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-82rgt\": no relationship found between node 'ip-10-0-137-4.us-east-2.compute.internal' and this object" podUID="2d87400c-c699-434d-af6d-51520a02b389" pod="openshift-must-gather-82rgt/must-gather-8d76m" Oct 30 22:44:38.928485 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:38.928449 7307 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d87400c-c699-434d-af6d-51520a02b389" path="/var/lib/kubelet/pods/2d87400c-c699-434d-af6d-51520a02b389/volumes" Oct 30 22:44:41.839993 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:41.839963 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d8d85cab-0e50-45eb-8b0d-10a3fbde35b9/alertmanager/0.log" Oct 30 22:44:41.870645 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:41.870615 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d8d85cab-0e50-45eb-8b0d-10a3fbde35b9/config-reloader/0.log" Oct 30 22:44:41.908754 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:41.908722 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d8d85cab-0e50-45eb-8b0d-10a3fbde35b9/kube-rbac-proxy-web/0.log" Oct 30 22:44:41.938076 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:41.938046 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d8d85cab-0e50-45eb-8b0d-10a3fbde35b9/kube-rbac-proxy/0.log" Oct 30 22:44:41.965900 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:41.965869 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d8d85cab-0e50-45eb-8b0d-10a3fbde35b9/kube-rbac-proxy-metric/0.log" Oct 30 22:44:42.001737 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:42.001711 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d8d85cab-0e50-45eb-8b0d-10a3fbde35b9/prom-label-proxy/0.log" Oct 30 22:44:42.030206 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:42.030178 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d8d85cab-0e50-45eb-8b0d-10a3fbde35b9/init-config-reloader/0.log" Oct 30 22:44:42.175677 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:42.175650 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-rzwtt_a7af64ff-9b50-4567-9016-b0cdd4ac7b15/kube-state-metrics/0.log" Oct 30 22:44:42.206485 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:42.206456 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-rzwtt_a7af64ff-9b50-4567-9016-b0cdd4ac7b15/kube-rbac-proxy-main/0.log" Oct 30 22:44:42.234160 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:42.234133 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-rzwtt_a7af64ff-9b50-4567-9016-b0cdd4ac7b15/kube-rbac-proxy-self/0.log" Oct 30 22:44:42.268656 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:42.268620 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-67979d6695-hbngh_ed8c71ed-0f37-4927-b52d-5966421f9978/metrics-server/0.log" Oct 30 22:44:42.298316 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:42.298287 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-k7cl2_a0b20b31-4338-40f4-82fb-55e7f9bafa3c/monitoring-plugin/0.log" Oct 30 22:44:42.539721 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:42.539619 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pqvnh_acf30d7e-4114-4fe7-bf69-c6678b18c2af/node-exporter/0.log" Oct 30 22:44:42.575415 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:42.575369 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pqvnh_acf30d7e-4114-4fe7-bf69-c6678b18c2af/kube-rbac-proxy/0.log" Oct 30 22:44:42.599601 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:42.599576 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pqvnh_acf30d7e-4114-4fe7-bf69-c6678b18c2af/init-textfile/0.log" Oct 30 22:44:42.633212 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:42.633176 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-tv9dq_fa3d72fd-de71-426f-8841-f6fdc58ddfb5/kube-rbac-proxy-main/0.log" Oct 30 22:44:42.660510 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:42.660487 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-tv9dq_fa3d72fd-de71-426f-8841-f6fdc58ddfb5/kube-rbac-proxy-self/0.log" Oct 30 22:44:42.685659 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:42.685638 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-tv9dq_fa3d72fd-de71-426f-8841-f6fdc58ddfb5/openshift-state-metrics/0.log" Oct 30 22:44:42.734373 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:42.734351 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_84e8a57d-af63-4447-b0d1-d9adbfb57740/prometheus/0.log" Oct 30 22:44:42.756721 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:42.756694 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_84e8a57d-af63-4447-b0d1-d9adbfb57740/config-reloader/0.log" Oct 30 22:44:42.783341 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:42.783314 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_84e8a57d-af63-4447-b0d1-d9adbfb57740/thanos-sidecar/0.log" Oct 30 22:44:42.813570 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:42.813505 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_84e8a57d-af63-4447-b0d1-d9adbfb57740/kube-rbac-proxy-web/0.log" Oct 30 22:44:42.845604 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:42.845569 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_84e8a57d-af63-4447-b0d1-d9adbfb57740/kube-rbac-proxy/0.log" Oct 30 22:44:42.872469 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:42.872446 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_84e8a57d-af63-4447-b0d1-d9adbfb57740/kube-rbac-proxy-thanos/0.log" Oct 30 22:44:42.907906 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:42.907873 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_84e8a57d-af63-4447-b0d1-d9adbfb57740/init-config-reloader/0.log" Oct 30 22:44:43.197186 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:43.197147 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57888bcfc4-5g9tj_0268731b-5534-46e0-a079-4998617d8048/thanos-query/0.log" Oct 30 22:44:43.221207 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:43.221180 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57888bcfc4-5g9tj_0268731b-5534-46e0-a079-4998617d8048/kube-rbac-proxy-web/0.log" Oct 30 22:44:43.251274 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:43.251247 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57888bcfc4-5g9tj_0268731b-5534-46e0-a079-4998617d8048/kube-rbac-proxy/0.log" Oct 30 22:44:43.284816 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:43.284788 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57888bcfc4-5g9tj_0268731b-5534-46e0-a079-4998617d8048/prom-label-proxy/0.log" Oct 30 22:44:43.311604 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:43.311568 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57888bcfc4-5g9tj_0268731b-5534-46e0-a079-4998617d8048/kube-rbac-proxy-rules/0.log" Oct 30 22:44:43.337461 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:43.337417 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57888bcfc4-5g9tj_0268731b-5534-46e0-a079-4998617d8048/kube-rbac-proxy-metrics/0.log" Oct 30 22:44:44.273555 ip-10-0-137-4 kubenswrapper[7307]: E1030 22:44:44.273516 7307 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flp69" containerName="extractor" Oct 30 22:44:44.522639 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.522603 7307 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt"] Oct 30 22:44:44.522935 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.522923 7307 cpu_manager.go:414] "containerMap: removing container" podUID="2d87400c-c699-434d-af6d-51520a02b389" containerName="gather" Oct 30 22:44:44.522979 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.522935 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d87400c-c699-434d-af6d-51520a02b389" containerName="gather" Oct 30 22:44:44.522979 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.522949 7307 cpu_manager.go:414] "containerMap: removing container" podUID="2d87400c-c699-434d-af6d-51520a02b389" containerName="copy" Oct 30 22:44:44.522979 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.522954 7307 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d87400c-c699-434d-af6d-51520a02b389" containerName="copy" Oct 30 22:44:44.523080 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.523009 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d87400c-c699-434d-af6d-51520a02b389" containerName="gather" Oct 30 22:44:44.523080 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.523019 7307 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d87400c-c699-434d-af6d-51520a02b389" containerName="copy" Oct 30 22:44:44.528236 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.528166 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt" Oct 30 22:44:44.535571 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.535545 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s6gzr\"/\"kube-root-ca.crt\"" Oct 30 22:44:44.536456 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.536433 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt"] Oct 30 22:44:44.537534 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.537510 7307 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s6gzr\"/\"openshift-service-ca.crt\"" Oct 30 22:44:44.537642 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.537629 7307 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s6gzr\"/\"default-dockercfg-bdjbc\"" Oct 30 22:44:44.687081 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.687041 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d735c09-7436-4294-a0fb-5217925fae69-sys\") pod \"perf-node-gather-daemonset-8kjdt\" (UID: \"7d735c09-7436-4294-a0fb-5217925fae69\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt" Oct 30 22:44:44.687081 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.687080 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7d735c09-7436-4294-a0fb-5217925fae69-podres\") pod \"perf-node-gather-daemonset-8kjdt\" (UID: \"7d735c09-7436-4294-a0fb-5217925fae69\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt" Oct 30 22:44:44.687323 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.687108 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-892mn\" (UniqueName: \"kubernetes.io/projected/7d735c09-7436-4294-a0fb-5217925fae69-kube-api-access-892mn\") pod \"perf-node-gather-daemonset-8kjdt\" (UID: \"7d735c09-7436-4294-a0fb-5217925fae69\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt" Oct 30 22:44:44.687323 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.687265 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d735c09-7436-4294-a0fb-5217925fae69-lib-modules\") pod \"perf-node-gather-daemonset-8kjdt\" (UID: \"7d735c09-7436-4294-a0fb-5217925fae69\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt" Oct 30 22:44:44.687323 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.687311 7307 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7d735c09-7436-4294-a0fb-5217925fae69-proc\") pod \"perf-node-gather-daemonset-8kjdt\" (UID: \"7d735c09-7436-4294-a0fb-5217925fae69\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt" Oct 30 22:44:44.787962 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.787879 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d735c09-7436-4294-a0fb-5217925fae69-sys\") pod \"perf-node-gather-daemonset-8kjdt\" (UID: \"7d735c09-7436-4294-a0fb-5217925fae69\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt" Oct 30 22:44:44.787962 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.787914 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7d735c09-7436-4294-a0fb-5217925fae69-podres\") pod \"perf-node-gather-daemonset-8kjdt\" (UID: \"7d735c09-7436-4294-a0fb-5217925fae69\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt" Oct 30 22:44:44.787962 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.787936 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-892mn\" (UniqueName: \"kubernetes.io/projected/7d735c09-7436-4294-a0fb-5217925fae69-kube-api-access-892mn\") pod \"perf-node-gather-daemonset-8kjdt\" (UID: \"7d735c09-7436-4294-a0fb-5217925fae69\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt" Oct 30 22:44:44.788164 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.787972 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d735c09-7436-4294-a0fb-5217925fae69-lib-modules\") pod \"perf-node-gather-daemonset-8kjdt\" (UID: \"7d735c09-7436-4294-a0fb-5217925fae69\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt" Oct 30 22:44:44.788164 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.787999 7307 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7d735c09-7436-4294-a0fb-5217925fae69-proc\") pod \"perf-node-gather-daemonset-8kjdt\" (UID: \"7d735c09-7436-4294-a0fb-5217925fae69\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt" Oct 30 22:44:44.788164 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.788003 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d735c09-7436-4294-a0fb-5217925fae69-sys\") pod \"perf-node-gather-daemonset-8kjdt\" (UID: \"7d735c09-7436-4294-a0fb-5217925fae69\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt" Oct 30 22:44:44.788164 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.788007 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7d735c09-7436-4294-a0fb-5217925fae69-podres\") pod \"perf-node-gather-daemonset-8kjdt\" (UID: \"7d735c09-7436-4294-a0fb-5217925fae69\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt" Oct 30 22:44:44.788164 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.788063 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7d735c09-7436-4294-a0fb-5217925fae69-proc\") pod \"perf-node-gather-daemonset-8kjdt\" (UID: \"7d735c09-7436-4294-a0fb-5217925fae69\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt" Oct 30 22:44:44.788164 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.788090 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d735c09-7436-4294-a0fb-5217925fae69-lib-modules\") pod \"perf-node-gather-daemonset-8kjdt\" (UID: \"7d735c09-7436-4294-a0fb-5217925fae69\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt" Oct 30 22:44:44.803973 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.803943 7307 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-892mn\" (UniqueName: \"kubernetes.io/projected/7d735c09-7436-4294-a0fb-5217925fae69-kube-api-access-892mn\") pod \"perf-node-gather-daemonset-8kjdt\" (UID: \"7d735c09-7436-4294-a0fb-5217925fae69\") " pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt" Oct 30 22:44:44.841971 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:44.841934 7307 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt" Oct 30 22:44:45.117374 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:45.117341 7307 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt"] Oct 30 22:44:45.121136 ip-10-0-137-4 kubenswrapper[7307]: W1030 22:44:45.121101 7307 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7d735c09_7436_4294_a0fb_5217925fae69.slice/crio-737e0eb67cbf02541b945730ebeb4b042813af2cc868aff461018cbe29c47793 WatchSource:0}: Error finding container 737e0eb67cbf02541b945730ebeb4b042813af2cc868aff461018cbe29c47793: Status 404 returned error can't find the container with id 737e0eb67cbf02541b945730ebeb4b042813af2cc868aff461018cbe29c47793 Oct 30 22:44:45.428141 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:45.428060 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-876cf7bcd-ph5v5_5b1c2ffc-60a1-452d-9dd7-2f28caed8189/console/0.log" Oct 30 22:44:45.622543 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:45.622498 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt" event={"ID":"7d735c09-7436-4294-a0fb-5217925fae69","Type":"ContainerStarted","Data":"16ddda7e492810d5cba7b13984e8ac73757849c6bccc571f0a7c5962104f9ade"} Oct 30 22:44:45.622742 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:45.622576 7307 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt" event={"ID":"7d735c09-7436-4294-a0fb-5217925fae69","Type":"ContainerStarted","Data":"737e0eb67cbf02541b945730ebeb4b042813af2cc868aff461018cbe29c47793"} Oct 30 22:44:45.622742 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:45.622650 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt" Oct 30 22:44:45.647862 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:45.647808 7307 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt" podStartSLOduration=1.6477969620000001 podStartE2EDuration="1.647796962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:44:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:44:45.646263172 +0000 UTC m=+3038.847635387" watchObservedRunningTime="2026-10-30 22:44:45.647796962 +0000 UTC m=+3038.849169160" Oct 30 22:44:46.988453 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:46.988418 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dv6jp_e94c0ad7-2799-48e6-ba5c-a10053ffe98d/dns/0.log" Oct 30 22:44:47.016746 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:47.016717 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dv6jp_e94c0ad7-2799-48e6-ba5c-a10053ffe98d/kube-rbac-proxy/0.log" Oct 30 22:44:47.327346 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:47.327263 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x5d7s_1928dc59-9826-41df-8599-fce8ce310d74/dns-node-resolver/0.log" Oct 30 22:44:47.868062 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:47.868016 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7zg8j_30d5a352-fc59-4709-9d83-0a756367d9e5/node-ca/0.log" Oct 30 22:44:49.120094 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:49.120065 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kb8fl_a0a75c4a-f43c-4b77-992c-3d060b81b889/serve-healthcheck-canary/0.log" Oct 30 22:44:49.615169 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:49.615140 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-flp69_4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad/kube-rbac-proxy/0.log" Oct 30 22:44:49.638514 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:49.638483 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-flp69_4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad/exporter/0.log" Oct 30 22:44:49.662667 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:49.662625 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-flp69_4a20bfb0-c6c5-4ebe-9d78-15cc550cdbad/extractor/0.log" Oct 30 22:44:51.636061 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:51.636036 7307 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s6gzr/perf-node-gather-daemonset-8kjdt" Oct 30 22:44:52.579566 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:52.579536 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-ctc8z_69b224b0-448d-4bbb-ad4f-0095b919a746/s3-init/0.log" Oct 30 22:44:52.597586 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:52.597559 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-ctc8z_69b224b0-448d-4bbb-ad4f-0095b919a746/download-hf-model/0.log" Oct 30 22:44:58.361074 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:58.361048 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hkqj8_82584512-72fe-4964-a8c3-7cacc053025e/kube-multus-additional-cni-plugins/0.log" Oct 30 22:44:58.385582 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:58.385554 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hkqj8_82584512-72fe-4964-a8c3-7cacc053025e/egress-router-binary-copy/0.log" Oct 30 22:44:58.410011 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:58.409989 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hkqj8_82584512-72fe-4964-a8c3-7cacc053025e/cni-plugins/0.log" Oct 30 22:44:58.432692 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:58.432668 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hkqj8_82584512-72fe-4964-a8c3-7cacc053025e/bond-cni-plugin/0.log" Oct 30 22:44:58.456323 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:58.456302 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hkqj8_82584512-72fe-4964-a8c3-7cacc053025e/routeoverride-cni/0.log" Oct 30 22:44:58.480289 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:58.480266 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hkqj8_82584512-72fe-4964-a8c3-7cacc053025e/whereabouts-cni-bincopy/0.log" Oct 30 22:44:58.504927 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:58.504902 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hkqj8_82584512-72fe-4964-a8c3-7cacc053025e/whereabouts-cni/0.log" Oct 30 22:44:58.910906 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:58.910877 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-srvpr_39ebed07-3b7e-4027-93b0-f9c2b83802ab/kube-multus/0.log" Oct 30 22:44:58.932979 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:58.932950 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ktz7g_e28f054c-44b5-4b39-9813-a547c1b41f04/network-metrics-daemon/0.log" Oct 30 22:44:58.954206 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:44:58.954179 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ktz7g_e28f054c-44b5-4b39-9813-a547c1b41f04/kube-rbac-proxy/0.log" Oct 30 22:45:00.161500 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:45:00.161470 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9xpx_6f4b3be4-a694-497b-9fc5-ae54afc372d5/ovn-controller/0.log" Oct 30 22:45:00.197611 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:45:00.197583 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9xpx_6f4b3be4-a694-497b-9fc5-ae54afc372d5/ovn-acl-logging/0.log" Oct 30 22:45:00.234975 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:45:00.234944 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9xpx_6f4b3be4-a694-497b-9fc5-ae54afc372d5/kube-rbac-proxy-node/0.log" Oct 30 22:45:00.265019 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:45:00.264992 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9xpx_6f4b3be4-a694-497b-9fc5-ae54afc372d5/kube-rbac-proxy-ovn-metrics/0.log" Oct 30 22:45:00.292658 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:45:00.292632 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9xpx_6f4b3be4-a694-497b-9fc5-ae54afc372d5/northd/0.log" Oct 30 22:45:00.324110 ip-10-0-137-4 kubenswrapper[7307]: I1030 22:45:00.324075 7307 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b9xpx_6f4b3be4-a694-497b-9fc5-ae54afc372d5/nbdb/0.log"