Nov 04 05:46:38.342661 ip-10-0-134-45 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Nov 04 05:46:38.342673 ip-10-0-134-45 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Nov 04 05:46:38.342680 ip-10-0-134-45 systemd[1]: kubelet.service: Failed with result 'resources'. Nov 04 05:46:38.342906 ip-10-0-134-45 systemd[1]: Failed to start Kubernetes Kubelet. Nov 04 05:46:48.573133 ip-10-0-134-45 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Nov 04 05:46:48.573148 ip-10-0-134-45 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 77ea3b13f9974b868dba71d36c51056d -- Nov 04 05:48:46.417397 ip-10-0-134-45 systemd[1]: Starting Kubernetes Kubelet... Nov 04 05:48:46.754231 ip-10-0-134-45 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 05:48:46.754231 ip-10-0-134-45 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 04 05:48:46.754231 ip-10-0-134-45 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 05:48:46.754231 ip-10-0-134-45 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 05:48:46.758118 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758026 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:48:46.758118 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758117 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:48:46.758118 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758121 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:48:46.758210 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758125 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:48:46.758210 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758128 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:48:46.758210 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758131 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:48:46.758210 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758134 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:48:46.758210 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758137 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:48:46.758210 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758140 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:48:46.758210 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758143 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:48:46.758210 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758146 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:48:46.758210 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758149 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:48:46.758210 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758151 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:48:46.758210 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758154 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:48:46.758210 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758156 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:48:46.758210 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758159 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:48:46.758210 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758161 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:48:46.758210 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758164 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:48:46.758210 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758166 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:48:46.758210 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758169 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:48:46.758210 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758177 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:48:46.758210 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758180 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:48:46.758210 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758183 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:48:46.758670 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758185 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:48:46.758670 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758188 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:48:46.758670 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758191 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:48:46.758670 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758195 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:48:46.758670 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758199 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:48:46.758670 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758201 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:48:46.758670 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758204 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:48:46.758670 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758207 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:48:46.758670 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758209 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:48:46.758670 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758212 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:48:46.758670 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758215 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:48:46.758670 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758218 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:48:46.758670 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758221 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:48:46.758670 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758224 2580 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:48:46.758670 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758227 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:48:46.758670 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758230 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:48:46.758670 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758232 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:48:46.758670 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758235 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:48:46.758670 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758237 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:48:46.758670 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758240 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:48:46.759176 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758243 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:48:46.759176 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758245 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:48:46.759176 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758247 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:48:46.759176 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758250 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:48:46.759176 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758252 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:48:46.759176 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758255 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:48:46.759176 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758257 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:48:46.759176 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758260 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:48:46.759176 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758263 2580 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:48:46.759176 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758266 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:48:46.759176 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758269 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:48:46.759176 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758272 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:48:46.759176 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758275 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:48:46.759176 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758278 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:48:46.759176 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758281 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:48:46.759176 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758283 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:48:46.759176 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758286 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:48:46.759176 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758289 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:48:46.759176 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758291 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:48:46.759636 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758294 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:48:46.759636 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758296 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:48:46.759636 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758299 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:48:46.759636 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758301 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:48:46.759636 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758304 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:48:46.759636 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758307 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:48:46.759636 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758309 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:48:46.759636 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758312 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:48:46.759636 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758315 2580 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:48:46.759636 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758317 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:48:46.759636 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758320 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:48:46.759636 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758323 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:48:46.759636 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758325 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:48:46.759636 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758328 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:48:46.759636 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758331 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:48:46.759636 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758334 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:48:46.759636 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758336 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:48:46.759636 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758339 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:48:46.759636 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758341 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:48:46.760095 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758344 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:48:46.760095 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758347 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:48:46.760095 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758349 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:48:46.760095 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758353 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:48:46.760095 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758357 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:48:46.760095 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758360 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:48:46.760095 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758362 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:48:46.760095 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758365 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:48:46.760095 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758368 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:48:46.760095 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758372 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:48:46.760095 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758374 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:48:46.760095 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758377 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:48:46.760095 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758379 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:48:46.760095 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758382 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:48:46.760095 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758385 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:48:46.760095 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758388 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:48:46.760095 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758390 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:48:46.760095 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758393 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:48:46.760095 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758395 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:48:46.760589 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758398 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:48:46.760589 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758401 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:48:46.760589 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758403 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:48:46.760589 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758406 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:48:46.760589 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758408 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:48:46.760589 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.758411 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:48:46.760589 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759222 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:48:46.760589 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759230 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:48:46.760589 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759232 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:48:46.760589 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759236 2580 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:48:46.760589 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759240 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:48:46.760589 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759244 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:48:46.760589 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759248 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:48:46.760589 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759250 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:48:46.760589 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759253 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:48:46.760589 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759256 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:48:46.760589 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759259 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:48:46.760589 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759261 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:48:46.760589 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759264 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:48:46.761045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759266 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:48:46.761045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759269 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:48:46.761045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759272 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:48:46.761045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759274 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:48:46.761045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759277 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:48:46.761045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759280 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:48:46.761045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759283 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:48:46.761045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759285 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:48:46.761045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759298 2580 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:48:46.761045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759303 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:48:46.761045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759305 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:48:46.761045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759308 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:48:46.761045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759311 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:48:46.761045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759314 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:48:46.761045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759316 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:48:46.761045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759319 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:48:46.761045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759321 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:48:46.761045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759324 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:48:46.761045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759327 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:48:46.761045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759333 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:48:46.761536 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759336 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:48:46.761536 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759338 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:48:46.761536 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759341 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:48:46.761536 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759344 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:48:46.761536 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759346 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:48:46.761536 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759349 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:48:46.761536 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759351 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:48:46.761536 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759354 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:48:46.761536 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759357 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:48:46.761536 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759359 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:48:46.761536 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759361 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:48:46.761536 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759364 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:48:46.761536 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759366 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:48:46.761536 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759369 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:48:46.761536 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759371 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:48:46.761536 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759374 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:48:46.761536 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759376 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:48:46.761536 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759379 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:48:46.761536 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759382 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:48:46.761536 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759385 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:48:46.762015 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759388 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:48:46.762015 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759390 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:48:46.762015 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759393 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:48:46.762015 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759396 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:48:46.762015 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759398 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:48:46.762015 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759401 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:48:46.762015 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759403 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:48:46.762015 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759406 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:48:46.762015 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759409 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:48:46.762015 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759411 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:48:46.762015 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759414 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:48:46.762015 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759416 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:48:46.762015 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759428 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:48:46.762015 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759431 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:48:46.762015 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759433 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:48:46.762015 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759436 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:48:46.762015 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759438 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:48:46.762015 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759441 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:48:46.762015 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759444 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:48:46.762484 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759447 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:48:46.762484 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759449 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:48:46.762484 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759452 2580 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:48:46.762484 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759455 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:48:46.762484 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759459 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:48:46.762484 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759463 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:48:46.762484 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759465 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:48:46.762484 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759468 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:48:46.762484 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759471 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:48:46.762484 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759473 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:48:46.762484 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759475 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:48:46.762484 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759478 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:48:46.762484 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759481 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:48:46.762484 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759484 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:48:46.762484 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759486 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:48:46.762484 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759489 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:48:46.762484 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759491 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:48:46.762484 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759494 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:48:46.762484 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759496 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:48:46.763045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759499 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:48:46.763045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759502 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:48:46.763045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759504 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:48:46.763045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759507 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:48:46.763045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759509 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:48:46.763045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759511 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:48:46.763045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759514 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:48:46.763045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759529 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:48:46.763045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759532 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:48:46.763045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759535 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:48:46.763045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759538 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:48:46.763045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759540 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:48:46.763045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759543 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:48:46.763045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759545 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:48:46.763045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.759548 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:48:46.763045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760083 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:48:46.763045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760089 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:48:46.763045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760091 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:48:46.763045 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760094 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:48:46.763545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760097 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:48:46.763545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760099 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:48:46.763545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760102 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:48:46.763545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760105 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:48:46.763545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760108 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:48:46.763545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760111 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:48:46.763545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760113 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:48:46.763545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760117 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:48:46.763545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760120 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:48:46.763545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760123 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:48:46.763545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760125 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:48:46.763545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760130 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:48:46.763545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760134 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:48:46.763545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760137 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:48:46.763545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760140 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:48:46.763545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760143 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:48:46.763545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760145 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:48:46.763545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760148 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:48:46.763545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760150 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:48:46.764003 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760153 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:48:46.764003 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760156 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:48:46.764003 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760158 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:48:46.764003 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760161 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:48:46.764003 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760163 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:48:46.764003 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760166 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:48:46.764003 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760169 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:48:46.764003 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760171 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:48:46.764003 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760174 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:48:46.764003 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760176 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:48:46.764003 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760179 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:48:46.764003 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760181 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:48:46.764003 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760184 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:48:46.764003 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760186 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:48:46.764003 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760189 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:48:46.764003 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760191 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:48:46.764003 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760194 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:48:46.764003 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760196 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:48:46.764003 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760199 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:48:46.764478 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760202 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:48:46.764478 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760205 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:48:46.764478 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760208 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:48:46.764478 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760211 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:48:46.764478 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760213 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:48:46.764478 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760216 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:48:46.764478 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760218 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:48:46.764478 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760221 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:48:46.764478 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760224 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:48:46.764478 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760226 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:48:46.764478 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760229 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:48:46.764478 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760231 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:48:46.764478 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760233 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:48:46.764478 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760236 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:48:46.764478 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760238 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:48:46.764478 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760243 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:48:46.764478 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760246 2580 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:48:46.764478 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760249 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:48:46.764478 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760253 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:48:46.764933 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760256 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:48:46.764933 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760259 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:48:46.764933 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760262 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:48:46.764933 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760264 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:48:46.764933 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760267 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:48:46.764933 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760269 2580 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:48:46.764933 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760272 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:48:46.764933 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760274 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:48:46.764933 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760277 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:48:46.764933 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760279 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:48:46.764933 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760282 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:48:46.764933 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760284 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:48:46.764933 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760287 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:48:46.764933 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760290 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:48:46.764933 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760293 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:48:46.764933 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760295 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:48:46.764933 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760298 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:48:46.764933 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760300 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:48:46.764933 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760303 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:48:46.764933 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760305 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:48:46.765435 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760308 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:48:46.765435 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760310 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:48:46.765435 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760313 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:48:46.765435 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760315 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:48:46.765435 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760318 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:48:46.765435 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760320 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:48:46.765435 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760323 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:48:46.765435 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760325 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:48:46.765435 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760327 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:48:46.765435 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760330 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:48:46.765435 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760333 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:48:46.765435 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760336 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:48:46.765435 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760338 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:48:46.765435 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760341 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:48:46.765435 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760344 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:48:46.765435 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760346 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:48:46.765435 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760349 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:48:46.765435 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760351 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:48:46.765435 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760354 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:48:46.765435 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760356 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:48:46.765910 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760358 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:48:46.765910 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760361 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:48:46.765910 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760363 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:48:46.765910 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760366 2580 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:48:46.765910 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.760371 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:48:46.765910 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761842 2580 flags.go:64] FLAG: --address="0.0.0.0" Nov 04 05:48:46.765910 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761851 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 04 05:48:46.765910 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761858 2580 flags.go:64] FLAG: --anonymous-auth="true" Nov 04 05:48:46.765910 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761862 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 04 05:48:46.765910 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761867 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 04 05:48:46.765910 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761870 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 04 05:48:46.765910 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761879 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 04 05:48:46.765910 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761883 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 04 05:48:46.765910 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761886 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 04 05:48:46.765910 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761889 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 04 05:48:46.765910 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761892 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 04 05:48:46.765910 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761896 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 04 05:48:46.765910 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761899 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 04 05:48:46.765910 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761902 2580 flags.go:64] FLAG: --cgroup-root="" Nov 04 05:48:46.765910 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761905 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 04 05:48:46.765910 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761908 2580 flags.go:64] FLAG: --client-ca-file="" Nov 04 05:48:46.765910 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761911 2580 flags.go:64] FLAG: --cloud-provider="external" Nov 04 05:48:46.765910 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761915 2580 flags.go:64] FLAG: --cluster-dns="[]" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761919 2580 flags.go:64] FLAG: --cluster-domain="" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761923 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761926 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761929 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761932 2580 flags.go:64] FLAG: --container-log-max-files="5" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761936 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761939 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761942 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761946 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761949 2580 flags.go:64] FLAG: --contention-profiling="false" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761952 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761955 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761958 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761962 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761966 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761969 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761973 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761976 2580 flags.go:64] FLAG: --enable-load-reader="false" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761979 2580 flags.go:64] FLAG: --enable-server="true" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761982 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761986 2580 flags.go:64] FLAG: --event-burst="100" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761990 2580 flags.go:64] FLAG: --event-qps="50" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761993 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 04 05:48:46.766458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761996 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 04 05:48:46.767113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.761999 2580 flags.go:64] FLAG: --eviction-hard="" Nov 04 05:48:46.767113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762004 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 04 05:48:46.767113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762007 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 04 05:48:46.767113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762010 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 04 05:48:46.767113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762013 2580 flags.go:64] FLAG: --eviction-soft="" Nov 04 05:48:46.767113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762016 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 04 05:48:46.767113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762020 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 04 05:48:46.767113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762023 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 04 05:48:46.767113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762027 2580 flags.go:64] FLAG: --experimental-mounter-path="" Nov 04 05:48:46.767113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762030 2580 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 04 05:48:46.767113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762034 2580 flags.go:64] FLAG: --fail-swap-on="true" Nov 04 05:48:46.767113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762037 2580 flags.go:64] FLAG: --feature-gates="" Nov 04 05:48:46.767113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762041 2580 flags.go:64] FLAG: --file-check-frequency="20s" Nov 04 05:48:46.767113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762044 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 04 05:48:46.767113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762047 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 04 05:48:46.767113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762050 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 04 05:48:46.767113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762053 2580 flags.go:64] FLAG: --healthz-port="10248" Nov 04 05:48:46.767113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762056 2580 flags.go:64] FLAG: --help="false" Nov 04 05:48:46.767113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762069 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:48:46.767113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762073 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 04 05:48:46.767113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762076 2580 flags.go:64] FLAG: --http-check-frequency="20s" Nov 04 05:48:46.767113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762079 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 04 05:48:46.767113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762083 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762086 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762090 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762092 2580 flags.go:64] FLAG: --image-service-endpoint="" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762095 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762098 2580 flags.go:64] FLAG: --kube-api-burst="100" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762101 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762106 2580 flags.go:64] FLAG: --kube-api-qps="50" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762109 2580 flags.go:64] FLAG: --kube-reserved="" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762112 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762115 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762119 2580 flags.go:64] FLAG: --kubelet-cgroups="" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762121 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762124 2580 flags.go:64] FLAG: --lock-file="" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762127 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762130 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762133 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762139 2580 flags.go:64] FLAG: --log-json-split-stream="false" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762142 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762146 2580 flags.go:64] FLAG: --log-text-split-stream="false" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762149 2580 flags.go:64] FLAG: --logging-format="text" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762152 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762156 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762158 2580 flags.go:64] FLAG: --manifest-url="" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762161 2580 flags.go:64] FLAG: --manifest-url-header="" Nov 04 05:48:46.767677 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762166 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762169 2580 flags.go:64] FLAG: --max-open-files="1000000" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762173 2580 flags.go:64] FLAG: --max-pods="110" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762176 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762179 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762182 2580 flags.go:64] FLAG: --memory-manager-policy="None" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762185 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762188 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762191 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762194 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762201 2580 flags.go:64] FLAG: --node-status-max-images="50" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762204 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762207 2580 flags.go:64] FLAG: --oom-score-adj="-999" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762210 2580 flags.go:64] FLAG: --pod-cidr="" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762216 2580 flags.go:64] FLAG: --pod-manifest-path="" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762219 2580 flags.go:64] FLAG: --pod-max-pids="-1" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762223 2580 flags.go:64] FLAG: --pods-per-core="0" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762226 2580 flags.go:64] FLAG: --port="10250" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762229 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762232 2580 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-09963d41d2e1814c5" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762235 2580 flags.go:64] FLAG: --qos-reserved="" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762238 2580 flags.go:64] FLAG: --read-only-port="10255" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762242 2580 flags.go:64] FLAG: --register-node="true" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762244 2580 flags.go:64] FLAG: --register-with-taints="" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762248 2580 flags.go:64] FLAG: --registry-burst="10" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762251 2580 flags.go:64] FLAG: --registry-qps="5" Nov 04 05:48:46.768315 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762254 2580 flags.go:64] FLAG: --reserved-cpus="" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762258 2580 flags.go:64] FLAG: --reserved-memory="" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762263 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762266 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762269 2580 flags.go:64] FLAG: --rotate-certificates="false" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762272 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762275 2580 flags.go:64] FLAG: --runonce="false" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762278 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762281 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762284 2580 flags.go:64] FLAG: --seccomp-default="false" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762287 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762290 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762293 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762296 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762299 2580 flags.go:64] FLAG: --storage-driver-password="root" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762302 2580 flags.go:64] FLAG: --storage-driver-secure="false" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762305 2580 flags.go:64] FLAG: --storage-driver-table="stats" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762309 2580 flags.go:64] FLAG: --storage-driver-user="root" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762312 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762316 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762320 2580 flags.go:64] FLAG: --system-cgroups="" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762323 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762328 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762331 2580 flags.go:64] FLAG: --tls-cert-file="" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762334 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 04 05:48:46.768928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762338 2580 flags.go:64] FLAG: --tls-min-version="" Nov 04 05:48:46.769545 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762341 2580 flags.go:64] FLAG: --tls-private-key-file="" Nov 04 05:48:46.769545 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762344 2580 flags.go:64] FLAG: --topology-manager-policy="none" Nov 04 05:48:46.769545 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762347 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 04 05:48:46.769545 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762350 2580 flags.go:64] FLAG: --topology-manager-scope="container" Nov 04 05:48:46.769545 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762353 2580 flags.go:64] FLAG: --v="2" Nov 04 05:48:46.769545 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762357 2580 flags.go:64] FLAG: --version="false" Nov 04 05:48:46.769545 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762361 2580 flags.go:64] FLAG: --vmodule="" Nov 04 05:48:46.769545 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762367 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 04 05:48:46.769545 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762371 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 04 05:48:46.769545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762525 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:48:46.769545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762530 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:48:46.769545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762534 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:48:46.769545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762537 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:48:46.769545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762540 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:48:46.769545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762543 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:48:46.769545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762545 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:48:46.769545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762548 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:48:46.769545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762551 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:48:46.769545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762553 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:48:46.769545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762556 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:48:46.769545 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762558 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:48:46.770042 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762561 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:48:46.770042 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762563 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:48:46.770042 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762566 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:48:46.770042 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762568 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:48:46.770042 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762571 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:48:46.770042 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762575 2580 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:48:46.770042 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762578 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:48:46.770042 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762580 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:48:46.770042 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762583 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:48:46.770042 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762585 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:48:46.770042 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762588 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:48:46.770042 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762590 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:48:46.770042 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762593 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:48:46.770042 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762597 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:48:46.770042 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762601 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:48:46.770042 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762605 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:48:46.770042 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762608 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:48:46.770042 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762611 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:48:46.770042 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762615 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:48:46.770519 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762618 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:48:46.770519 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762621 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:48:46.770519 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762624 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:48:46.770519 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762626 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:48:46.770519 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762629 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:48:46.770519 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762632 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:48:46.770519 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762634 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:48:46.770519 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762637 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:48:46.770519 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762639 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:48:46.770519 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762642 2580 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:48:46.770519 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762644 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:48:46.770519 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762647 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:48:46.770519 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762650 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:48:46.770519 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762652 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:48:46.770519 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762655 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:48:46.770519 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762657 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:48:46.770519 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762660 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:48:46.770519 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762662 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:48:46.770519 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762666 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:48:46.770519 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762669 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:48:46.770998 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762672 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:48:46.770998 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762674 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:48:46.770998 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762677 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:48:46.770998 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762679 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:48:46.770998 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762682 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:48:46.770998 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762684 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:48:46.770998 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762687 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:48:46.770998 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762689 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:48:46.770998 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762692 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:48:46.770998 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762694 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:48:46.770998 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762697 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:48:46.770998 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762701 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:48:46.770998 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762703 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:48:46.770998 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762706 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:48:46.770998 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762709 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:48:46.770998 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762712 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:48:46.770998 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762715 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:48:46.770998 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762717 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:48:46.770998 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762720 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:48:46.770998 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762722 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:48:46.771507 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762725 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:48:46.771507 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762727 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:48:46.771507 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762730 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:48:46.771507 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762732 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:48:46.771507 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762735 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:48:46.771507 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762737 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:48:46.771507 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762740 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:48:46.771507 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762742 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:48:46.771507 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762745 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:48:46.771507 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762747 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:48:46.771507 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762751 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:48:46.771507 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762753 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:48:46.771507 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762756 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:48:46.771507 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762758 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:48:46.771507 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762761 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:48:46.771507 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762764 2580 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:48:46.771507 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762767 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:48:46.771507 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762769 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:48:46.771507 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762771 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:48:46.771507 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762774 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:48:46.772024 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762777 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:48:46.772024 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762779 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:48:46.772024 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762782 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:48:46.772024 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762786 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:48:46.772024 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762788 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:48:46.772024 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762791 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:48:46.772024 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762793 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:48:46.772024 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762796 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:48:46.772024 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762799 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:48:46.772024 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762801 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:48:46.772024 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762804 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:48:46.772024 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762806 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:48:46.772024 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762809 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:48:46.772024 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762811 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:48:46.772024 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762814 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:48:46.772024 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.762839 2580 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 05:48:46.772415 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762878 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:48:46.772415 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762882 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:48:46.772415 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762885 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:48:46.772415 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762888 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:48:46.772415 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762890 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:48:46.772415 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762893 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:48:46.772415 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762895 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:48:46.772415 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762899 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:48:46.772415 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762902 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:48:46.772415 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762905 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:48:46.772415 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762908 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:48:46.772415 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762911 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:48:46.772415 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762914 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:48:46.772415 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762916 2580 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:48:46.772415 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762919 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:48:46.772415 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762921 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:48:46.772415 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762924 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:48:46.772415 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762927 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:48:46.772415 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762929 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:48:46.772415 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762933 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:48:46.772907 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762937 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:48:46.772907 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762939 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:48:46.772907 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762942 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:48:46.772907 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762944 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:48:46.772907 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762947 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:48:46.772907 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762950 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:48:46.772907 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762952 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:48:46.772907 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762955 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:48:46.772907 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762957 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:48:46.772907 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762960 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:48:46.772907 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762962 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:48:46.772907 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762965 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:48:46.772907 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762967 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:48:46.772907 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762970 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:48:46.772907 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762974 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:48:46.772907 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762977 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:48:46.772907 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762980 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:48:46.772907 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762983 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:48:46.772907 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762986 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:48:46.773380 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762990 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:48:46.773380 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762993 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:48:46.773380 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762996 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:48:46.773380 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.762999 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:48:46.773380 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763001 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:48:46.773380 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763004 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:48:46.773380 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763006 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:48:46.773380 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763009 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:48:46.773380 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763012 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:48:46.773380 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763014 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:48:46.773380 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763017 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:48:46.773380 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763019 2580 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:48:46.773380 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763023 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:48:46.773380 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763025 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:48:46.773380 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763028 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:48:46.773380 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763030 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:48:46.773380 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763033 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:48:46.773380 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763035 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:48:46.773380 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763039 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:48:46.773822 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763043 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:48:46.773822 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763047 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:48:46.773822 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763051 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:48:46.773822 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763054 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:48:46.773822 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763057 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:48:46.773822 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763073 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:48:46.773822 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763078 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:48:46.773822 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763082 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:48:46.773822 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763086 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:48:46.773822 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763091 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:48:46.773822 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763093 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:48:46.773822 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763096 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:48:46.773822 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763099 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:48:46.773822 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763103 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:48:46.773822 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763105 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:48:46.773822 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763108 2580 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:48:46.773822 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763110 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:48:46.773822 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763113 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:48:46.773822 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763116 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:48:46.774304 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763119 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:48:46.774304 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763121 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:48:46.774304 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763123 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:48:46.774304 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763126 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:48:46.774304 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763128 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:48:46.774304 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763131 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:48:46.774304 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763135 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:48:46.774304 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763138 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:48:46.774304 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763140 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:48:46.774304 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763143 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:48:46.774304 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763145 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:48:46.774304 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763148 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:48:46.774304 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763151 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:48:46.774304 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763154 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:48:46.774304 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763157 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:48:46.774304 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763159 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:48:46.774304 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763161 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:48:46.774304 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763164 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:48:46.774304 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763167 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:48:46.774304 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763169 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:48:46.774765 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763172 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:48:46.774765 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763175 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:48:46.774765 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763177 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:48:46.774765 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763180 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:48:46.774765 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763183 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:48:46.774765 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763186 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:48:46.774765 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763189 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:48:46.774765 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763192 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:48:46.774765 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.763195 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:48:46.774765 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.770468 2580 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 04 05:48:46.774765 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.770481 2580 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 04 05:48:46.774765 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.771117 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 04 05:48:46.774765 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.771123 2580 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 04 05:48:46.774765 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771202 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:48:46.774765 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771207 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:48:46.774765 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771210 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:48:46.774765 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771213 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:48:46.774765 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771216 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:48:46.774765 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771219 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:48:46.775242 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771221 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:48:46.775242 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771225 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:48:46.775242 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771227 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:48:46.775242 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771230 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:48:46.775242 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771233 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:48:46.775242 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771236 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:48:46.775242 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771244 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:48:46.775242 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771247 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:48:46.775242 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771250 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:48:46.775242 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771252 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:48:46.775242 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771255 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:48:46.775242 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771258 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:48:46.775242 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771261 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:48:46.775242 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771263 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:48:46.775242 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771266 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:48:46.775242 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771268 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:48:46.775242 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771271 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:48:46.775242 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771273 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:48:46.775242 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771276 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:48:46.775706 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771278 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:48:46.775706 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771281 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:48:46.775706 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771283 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:48:46.775706 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771286 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:48:46.775706 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771297 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:48:46.775706 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771301 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:48:46.775706 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771304 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:48:46.775706 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771306 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:48:46.775706 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771309 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:48:46.775706 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771311 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:48:46.775706 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771314 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:48:46.775706 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771317 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:48:46.775706 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771320 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:48:46.775706 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771322 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:48:46.775706 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771325 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:48:46.775706 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771327 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:48:46.775706 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771330 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:48:46.775706 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771332 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:48:46.775706 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771335 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:48:46.776167 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771337 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:48:46.776167 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771346 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:48:46.776167 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771349 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:48:46.776167 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771351 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:48:46.776167 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771354 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:48:46.776167 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771356 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:48:46.776167 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771358 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:48:46.776167 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771361 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:48:46.776167 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771364 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:48:46.776167 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771366 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:48:46.776167 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771369 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:48:46.776167 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771371 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:48:46.776167 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771374 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:48:46.776167 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771376 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:48:46.776167 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771379 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:48:46.776167 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771382 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:48:46.776167 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771384 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:48:46.776167 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771388 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:48:46.776167 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771391 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:48:46.776167 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771393 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:48:46.776637 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771396 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:48:46.776637 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771398 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:48:46.776637 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771401 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:48:46.776637 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771403 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:48:46.776637 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771406 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:48:46.776637 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771408 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:48:46.776637 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771411 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:48:46.776637 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771413 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:48:46.776637 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771417 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:48:46.776637 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771421 2580 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:48:46.776637 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771424 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:48:46.776637 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771427 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:48:46.776637 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771431 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:48:46.776637 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771434 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:48:46.776637 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771444 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:48:46.776637 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771448 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:48:46.776637 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771451 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:48:46.776637 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771455 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:48:46.776637 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771458 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:48:46.777183 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771460 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:48:46.777183 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771463 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:48:46.777183 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771465 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:48:46.777183 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771468 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:48:46.777183 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771470 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:48:46.777183 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771473 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:48:46.777183 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771475 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:48:46.777183 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771478 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:48:46.777183 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771480 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:48:46.777183 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771483 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:48:46.777183 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771486 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:48:46.777183 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771488 2580 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:48:46.777183 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771491 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:48:46.777183 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771493 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:48:46.777183 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771496 2580 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:48:46.777183 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771498 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:48:46.777183 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771501 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:48:46.777183 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771503 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:48:46.777183 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771506 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:48:46.777183 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771509 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:48:46.777981 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771511 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:48:46.777981 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771514 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:48:46.777981 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771517 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:48:46.777981 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.771545 2580 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 05:48:46.777981 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771745 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:48:46.777981 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771750 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:48:46.777981 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771753 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:48:46.777981 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771756 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:48:46.777981 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771764 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:48:46.777981 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771767 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:48:46.777981 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771769 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:48:46.777981 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771772 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:48:46.777981 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771774 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:48:46.777981 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771777 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:48:46.777981 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771779 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:48:46.777981 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771782 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:48:46.778753 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771784 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:48:46.778753 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771787 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:48:46.778753 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771789 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:48:46.778753 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771792 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:48:46.778753 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771794 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:48:46.778753 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771797 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:48:46.778753 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771799 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:48:46.778753 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771802 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:48:46.778753 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771804 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:48:46.778753 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771807 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:48:46.778753 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771809 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:48:46.778753 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771812 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:48:46.778753 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771814 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:48:46.778753 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771817 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:48:46.778753 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771819 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:48:46.778753 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771822 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:48:46.778753 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771825 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:48:46.778753 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771828 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:48:46.778753 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771830 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:48:46.779299 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771833 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:48:46.779299 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771835 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:48:46.779299 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771838 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:48:46.779299 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771840 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:48:46.779299 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771843 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:48:46.779299 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771845 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:48:46.779299 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771855 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:48:46.779299 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771857 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:48:46.779299 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771860 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:48:46.779299 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771862 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:48:46.779299 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771865 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:48:46.779299 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771867 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:48:46.779299 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771870 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:48:46.779299 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771873 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:48:46.779299 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771875 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:48:46.779299 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771879 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:48:46.779299 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771882 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:48:46.779299 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771885 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:48:46.779299 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771892 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:48:46.779746 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771896 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:48:46.779746 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771899 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:48:46.779746 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771902 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:48:46.779746 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771905 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:48:46.779746 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771908 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:48:46.779746 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771910 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:48:46.779746 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771913 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:48:46.779746 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771921 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:48:46.779746 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771923 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:48:46.779746 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771926 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:48:46.779746 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771929 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:48:46.779746 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771931 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:48:46.779746 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771933 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:48:46.779746 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771936 2580 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:48:46.779746 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771938 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:48:46.779746 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771941 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:48:46.779746 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771944 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:48:46.779746 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771946 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:48:46.779746 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771949 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:48:46.779746 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771951 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:48:46.780245 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771959 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:48:46.780245 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771962 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:48:46.780245 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771965 2580 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:48:46.780245 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771968 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:48:46.780245 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771970 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:48:46.780245 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771973 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:48:46.780245 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771975 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:48:46.780245 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771977 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:48:46.780245 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771980 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:48:46.780245 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771982 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:48:46.780245 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771985 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:48:46.780245 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771988 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:48:46.780245 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771990 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:48:46.780245 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771993 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:48:46.780245 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771995 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:48:46.780245 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.771998 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:48:46.780245 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772001 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:48:46.780245 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772003 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:48:46.780245 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772006 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:48:46.780245 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772008 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:48:46.780697 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772011 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:48:46.780697 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772013 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:48:46.780697 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772016 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:48:46.780697 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772018 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:48:46.780697 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772021 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:48:46.780697 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772023 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:48:46.780697 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772026 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:48:46.780697 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772028 2580 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:48:46.780697 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772031 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:48:46.780697 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772034 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:48:46.780697 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772037 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:48:46.780697 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772039 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:48:46.780697 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772042 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:48:46.780697 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772050 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:48:46.780697 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772053 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:48:46.780697 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772055 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:48:46.781101 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.772092 2580 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 05:48:46.781101 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772136 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:48:46.781101 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772140 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:48:46.781101 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772143 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:48:46.781101 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772146 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:48:46.781101 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772149 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:48:46.781101 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772152 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:48:46.781101 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772155 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:48:46.781101 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772158 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:48:46.781101 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772160 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:48:46.781101 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772163 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:48:46.781101 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772165 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:48:46.781101 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772168 2580 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:48:46.781101 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772172 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:48:46.781101 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772175 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:48:46.781101 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772177 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:48:46.781490 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772179 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:48:46.781490 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772182 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:48:46.781490 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772184 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:48:46.781490 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772187 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:48:46.781490 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772190 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:48:46.781490 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772193 2580 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:48:46.781490 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772195 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:48:46.781490 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772198 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:48:46.781490 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772200 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:48:46.781490 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772202 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:48:46.781490 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772205 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:48:46.781490 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772207 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:48:46.781490 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772210 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:48:46.781490 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772212 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:48:46.781490 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772222 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:48:46.781490 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772225 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:48:46.781490 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772227 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:48:46.781490 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772230 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:48:46.781490 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772232 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:48:46.781490 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772235 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:48:46.781969 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772237 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:48:46.781969 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772240 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:48:46.781969 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772242 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:48:46.781969 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772245 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:48:46.781969 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772247 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:48:46.781969 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772250 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:48:46.781969 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772253 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:48:46.781969 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772255 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:48:46.781969 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772258 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:48:46.781969 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772262 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:48:46.781969 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772264 2580 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:48:46.781969 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772267 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:48:46.781969 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772270 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:48:46.781969 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772273 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:48:46.781969 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772275 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:48:46.781969 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772278 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:48:46.781969 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772280 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:48:46.781969 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772283 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:48:46.781969 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772285 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:48:46.782570 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772288 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:48:46.782570 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772290 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:48:46.782570 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772293 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:48:46.782570 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772295 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:48:46.782570 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772298 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:48:46.782570 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772300 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:48:46.782570 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772303 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:48:46.782570 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772305 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:48:46.782570 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772317 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:48:46.782570 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772319 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:48:46.782570 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772322 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:48:46.782570 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772324 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:48:46.782570 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772327 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:48:46.782570 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772330 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:48:46.782570 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772332 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:48:46.782570 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772335 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:48:46.782570 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772337 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:48:46.782570 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772340 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:48:46.782570 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772342 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:48:46.783102 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772345 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:48:46.783102 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772347 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:48:46.783102 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772349 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:48:46.783102 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772353 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:48:46.783102 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772356 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:48:46.783102 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772359 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:48:46.783102 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772362 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:48:46.783102 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772365 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:48:46.783102 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772368 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:48:46.783102 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772371 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:48:46.783102 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772373 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:48:46.783102 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772376 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:48:46.783102 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772379 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:48:46.783102 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772381 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:48:46.783102 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772383 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:48:46.783102 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772386 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:48:46.783102 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772389 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:48:46.783102 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772391 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:48:46.783102 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772394 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:48:46.784377 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772396 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:48:46.784377 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772399 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:48:46.784377 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772401 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:48:46.784377 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772411 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:48:46.784377 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772414 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:48:46.784377 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772417 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:48:46.784377 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772420 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:48:46.784377 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772422 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:48:46.784377 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772426 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:48:46.784377 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772430 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:48:46.784377 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772433 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:48:46.784377 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772437 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:48:46.784377 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772440 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:48:46.784377 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:46.772443 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:48:46.784377 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.772499 2580 server.go:957] "Client rotation is on, will bootstrap in background" Nov 04 05:48:46.784377 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.774590 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Nov 04 05:48:46.784377 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.775312 2580 server.go:1014] "Starting client certificate rotation" Nov 04 05:48:46.784377 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.775437 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 04 05:48:46.784803 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.775983 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 04 05:48:46.784803 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.779325 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 05:48:46.784803 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.783093 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 05:48:46.794493 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.794475 2580 log.go:25] "Validated CRI v1 runtime API" Nov 04 05:48:46.797119 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.797105 2580 log.go:25] "Validated CRI v1 image API" Nov 04 05:48:46.797928 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.797904 2580 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 04 05:48:46.802135 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.802115 2580 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e84a8552-4023-42d4-bf93-c72a1a96ca1b:/dev/nvme0n1p4 f082d6cb-69fd-466a-88bc-da0ca4d879cc:/dev/nvme0n1p3] Nov 04 05:48:46.802211 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.802134 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Nov 04 05:48:46.807983 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.807878 2580 manager.go:217] Machine: {Timestamp:2026-11-04 05:48:46.806654925 +0000 UTC m=+0.291444697 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100173 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20f35966886088e35dbe1094bb6a2f SystemUUID:ec20f359-6688-6088-e35d-be1094bb6a2f BootID:77ea3b13-f997-4b86-8dba-71d36c51056d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:31:99:18:5f:f9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:31:99:18:5f:f9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:8f:7e:49:ba:4a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 04 05:48:46.807983 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.807980 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 04 05:48:46.808117 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.808100 2580 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 04 05:48:46.810807 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.810781 2580 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 04 05:48:46.810947 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.810810 2580 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-45.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 04 05:48:46.811038 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.810950 2580 topology_manager.go:143] "Creating topology manager with none policy" Nov 04 05:48:46.811038 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.810958 2580 container_manager_linux.go:311] "Creating device plugin manager" Nov 04 05:48:46.811038 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.810998 2580 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 05:48:46.811038 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.811016 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 05:48:46.811833 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.811822 2580 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 04 05:48:46.815226 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.815214 2580 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 04 05:48:46.815361 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.815351 2580 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 04 05:48:46.815886 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.815876 2580 kubelet.go:493] "Attempting to sync node with API server" Nov 04 05:48:46.815929 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.815889 2580 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 04 05:48:46.815929 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.815903 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 04 05:48:46.815929 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.815913 2580 kubelet.go:405] "Adding apiserver pod source" Nov 04 05:48:46.815929 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.815921 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 04 05:48:46.816287 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.816271 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 05:48:46.818451 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.818435 2580 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 04 05:48:46.823307 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.823284 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 05:48:46.824227 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.824214 2580 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 04 05:48:46.824279 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.824245 2580 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 04 05:48:46.824399 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.824389 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 04 05:48:46.824439 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.824405 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 04 05:48:46.824439 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.824411 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 04 05:48:46.824439 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.824417 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 04 05:48:46.824439 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.824423 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 04 05:48:46.824439 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.824429 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 04 05:48:46.824878 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.824869 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 04 05:48:46.824906 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.824879 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 04 05:48:46.824906 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.824887 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 04 05:48:46.824906 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.824893 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 04 05:48:46.824906 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.824901 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 04 05:48:46.825075 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.824910 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 04 05:48:46.825417 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.825407 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 04 05:48:46.825417 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.825417 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 04 05:48:46.829091 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.829078 2580 server.go:1263] "Started kubelet" Nov 04 05:48:46.829213 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.829169 2580 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 04 05:48:46.829286 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.829166 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 04 05:48:46.829286 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.829271 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 04 05:48:46.829798 ip-10-0-134-45 systemd[1]: Started Kubernetes Kubelet. Nov 04 05:48:46.831199 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.831180 2580 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 04 05:48:46.833736 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.833270 2580 server.go:317] "Adding debug handlers to kubelet server" Nov 04 05:48:46.835795 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.835769 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 04 05:48:46.836131 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.836113 2580 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 04 05:48:46.836220 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:46.836154 2580 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Nov 04 05:48:46.836274 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:46.836242 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-45.us-west-1.compute.internal\" not found" Nov 04 05:48:46.836720 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.836701 2580 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 04 05:48:46.836720 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.836719 2580 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 04 05:48:46.836849 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.836756 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 04 05:48:46.836849 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.836838 2580 reconstruct.go:97] "Volume reconstruction finished" Nov 04 05:48:46.836849 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.836846 2580 reconciler.go:29] "Reconciler: start to sync state" Nov 04 05:48:46.837025 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.837013 2580 factory.go:55] Registering systemd factory Nov 04 05:48:46.837091 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.837037 2580 factory.go:223] Registration of the systemd container factory successfully Nov 04 05:48:46.837342 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.837327 2580 factory.go:153] Registering CRI-O factory Nov 04 05:48:46.837385 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.837346 2580 factory.go:223] Registration of the crio container factory successfully Nov 04 05:48:46.837414 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.837395 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 04 05:48:46.837453 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.837412 2580 factory.go:103] Registering Raw factory Nov 04 05:48:46.837453 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.837434 2580 manager.go:1199] Started watching for new ooms in manager Nov 04 05:48:46.838257 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.838243 2580 manager.go:319] Starting recovery of all containers Nov 04 05:48:46.851437 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.851413 2580 manager.go:324] Recovery completed Nov 04 05:48:46.856390 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.856366 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:48:46.858106 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.858079 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:48:46.858198 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.858118 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:48:46.858198 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.858132 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:48:46.858734 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.858721 2580 cpu_manager.go:226] "Starting" policy="none" Nov 04 05:48:46.858734 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.858732 2580 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 04 05:48:46.858838 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.858754 2580 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 04 05:48:46.858881 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.858733 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:48:46.859674 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.859655 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:48:46.859792 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.859690 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:48:46.859792 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.859706 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:48:46.861332 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.861319 2580 policy_none.go:50] "Start" Nov 04 05:48:46.861332 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.861334 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 04 05:48:46.861428 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.861344 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 04 05:48:46.863354 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.863343 2580 policy_none.go:44] "Start" Nov 04 05:48:46.890741 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.890608 2580 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 04 05:48:46.894727 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.894709 2580 manager.go:341] "Starting Device Plugin manager" Nov 04 05:48:46.894826 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:46.894747 2580 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 04 05:48:46.894826 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.894760 2580 server.go:87] "Starting device plugin registration server" Nov 04 05:48:46.895035 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.895022 2580 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 04 05:48:46.895152 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.895038 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 04 05:48:46.895204 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.895149 2580 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 04 05:48:46.895268 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.895253 2580 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 04 05:48:46.895268 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.895268 2580 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 04 05:48:46.895953 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:46.895870 2580 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 04 05:48:46.895953 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:46.895934 2580 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-45.us-west-1.compute.internal\" not found" Nov 04 05:48:46.972281 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.972248 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 04 05:48:46.974283 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.973463 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 04 05:48:46.974283 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.973487 2580 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 04 05:48:46.974283 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.973508 2580 kubelet.go:2521] "Starting kubelet main sync loop" Nov 04 05:48:46.974283 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:46.973547 2580 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Nov 04 05:48:46.992215 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.992192 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-45.us-west-1.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Nov 04 05:48:46.993075 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:46.992203 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-45.us-west-1.compute.internal.18e4c18497eceb4c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-45.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-45.us-west-1.compute.internal,},FirstTimestamp:2026-11-04 05:48:46.82903022 +0000 UTC m=+0.313819971,LastTimestamp:2026-11-04 05:48:46.82903022 +0000 UTC m=+0.313819971,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-45.us-west-1.compute.internal,}" Nov 04 05:48:46.995592 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.995576 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:48:46.996327 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.996311 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:48:46.996417 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.996345 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:48:46.996417 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.996360 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:48:46.996417 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:46.996390 2580 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:48:47.045349 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:47.045330 2580 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-45.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Nov 04 05:48:47.074431 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.074385 2580 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal"] Nov 04 05:48:47.074510 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.074463 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:48:47.075368 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.075352 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:48:47.075451 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.075384 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:48:47.075451 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.075398 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:48:47.077627 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.077611 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:48:47.077774 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.077756 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:48:47.077823 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.077793 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:48:47.078347 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.078331 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:48:47.078398 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.078356 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:48:47.078398 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.078367 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:48:47.078468 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.078331 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:48:47.078468 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.078433 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:48:47.078468 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.078445 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:48:47.080429 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.080414 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:48:47.080478 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.080445 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:48:47.081076 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.081047 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:48:47.081164 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.081088 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:48:47.081164 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.081099 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:48:47.100314 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:47.100296 2580 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-45.us-west-1.compute.internal\" not found" node="ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:48:47.103377 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:47.103360 2580 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-45.us-west-1.compute.internal\" not found" node="ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:48:47.124111 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.124088 2580 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 04 05:48:47.124197 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.124129 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j549h" Nov 04 05:48:47.138290 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.138259 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aea09c4c566ff629316b6657597f6b06-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal\" (UID: \"aea09c4c566ff629316b6657597f6b06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:48:47.138290 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.138294 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aea09c4c566ff629316b6657597f6b06-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal\" (UID: \"aea09c4c566ff629316b6657597f6b06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:48:47.138393 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.138312 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cac56becdfbf016c3dc7fcb0c6060f7b-config\") pod \"kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal\" (UID: \"cac56becdfbf016c3dc7fcb0c6060f7b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:48:47.161579 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:47.161542 2580 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Nov 04 05:48:47.161664 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:47.161575 2580 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Nov 04 05:48:47.161767 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:47.161664 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-45.us-west-1.compute.internal.18e4c18499a89079 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-45.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-45.us-west-1.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-45.us-west-1.compute.internal,},FirstTimestamp:2026-11-04 05:48:46.858104953 +0000 UTC m=+0.342894734,LastTimestamp:2026-11-04 05:48:46.858104953 +0000 UTC m=+0.342894734,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-45.us-west-1.compute.internal,}" Nov 04 05:48:47.161893 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:47.161876 2580 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-45.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Nov 04 05:48:47.218312 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.218289 2580 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 05:48:47.218857 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:47.218841 2580 kubelet_node_status.go:115] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-45.us-west-1.compute.internal\" not found" node="ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:48:47.239723 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.239695 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aea09c4c566ff629316b6657597f6b06-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal\" (UID: \"aea09c4c566ff629316b6657597f6b06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:48:47.239830 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.239729 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aea09c4c566ff629316b6657597f6b06-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal\" (UID: \"aea09c4c566ff629316b6657597f6b06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:48:47.239830 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.239748 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cac56becdfbf016c3dc7fcb0c6060f7b-config\") pod \"kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal\" (UID: \"cac56becdfbf016c3dc7fcb0c6060f7b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:48:47.239830 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.239801 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aea09c4c566ff629316b6657597f6b06-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal\" (UID: \"aea09c4c566ff629316b6657597f6b06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:48:47.239929 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.239855 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cac56becdfbf016c3dc7fcb0c6060f7b-config\") pod \"kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal\" (UID: \"cac56becdfbf016c3dc7fcb0c6060f7b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:48:47.239929 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.239883 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aea09c4c566ff629316b6657597f6b06-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal\" (UID: \"aea09c4c566ff629316b6657597f6b06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:48:47.358482 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:47.358415 2580 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-45.us-west-1.compute.internal\" not found" node="ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:48:47.402440 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.402419 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:48:47.407043 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.406836 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:48:47.419349 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.419334 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:48:47.420118 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.420102 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:48:47.420188 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.420131 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:48:47.420188 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.420149 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:48:47.420188 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.420176 2580 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:48:47.479917 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.479897 2580 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:48:47.479917 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:47.479918 2580 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-45.us-west-1.compute.internal\": node \"ip-10-0-134-45.us-west-1.compute.internal\" not found" Nov 04 05:48:47.610846 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:47.610778 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-45.us-west-1.compute.internal\" not found" Nov 04 05:48:47.711605 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:47.711578 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-45.us-west-1.compute.internal\" not found" Nov 04 05:48:47.775278 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.775257 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Nov 04 05:48:47.775674 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:47.775378 2580 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 04 05:48:47.775674 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:47.775441 2580 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://ad99878772f894bf595fb87a43495684-6faf233d34787b2e.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-134-45.us-west-1.compute.internal.18e4c18499a910a7\": read tcp 10.0.134.45:40582->18.223.64.73:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-134-45.us-west-1.compute.internal.18e4c18499a910a7 default 5322 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-45.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-45.us-west-1.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-45.us-west-1.compute.internal,},FirstTimestamp:2026-11-04 05:48:46 +0000 UTC,LastTimestamp:2026-11-04 05:48:46.996365578 +0000 UTC m=+0.481155332,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-45.us-west-1.compute.internal,}" Nov 04 05:48:47.812558 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:47.812540 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-45.us-west-1.compute.internal\" not found" Nov 04 05:48:47.913217 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:47.913160 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-45.us-west-1.compute.internal\" not found" Nov 04 05:48:48.013856 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:48.013833 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-45.us-west-1.compute.internal\" not found" Nov 04 05:48:48.070331 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.070307 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:48:48.071178 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.071164 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:48:48.071260 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.071195 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:48:48.071260 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.071211 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:48:48.114206 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:48.114183 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-45.us-west-1.compute.internal\" not found" Nov 04 05:48:48.129122 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.129095 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 05:43:46 +0000 UTC" deadline="2028-07-25 08:27:40.751803124 +0000 UTC" Nov 04 05:48:48.129122 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.129119 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15098h38m52.622687475s" Nov 04 05:48:48.215002 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:48.214943 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-45.us-west-1.compute.internal\" not found" Nov 04 05:48:48.315428 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:48.315405 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-45.us-west-1.compute.internal\" not found" Nov 04 05:48:48.415824 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:48.415797 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-45.us-west-1.compute.internal\" not found" Nov 04 05:48:48.442649 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:48.442624 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaea09c4c566ff629316b6657597f6b06.slice/crio-32a03eca3efac02dd990719640a77603f8fd42784a5d827b73cb4101d30bd356 WatchSource:0}: Error finding container 32a03eca3efac02dd990719640a77603f8fd42784a5d827b73cb4101d30bd356: Status 404 returned error can't find the container with id 32a03eca3efac02dd990719640a77603f8fd42784a5d827b73cb4101d30bd356 Nov 04 05:48:48.443071 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:48.443046 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcac56becdfbf016c3dc7fcb0c6060f7b.slice/crio-8eb39cf29ab7476d1d8bde56c93f41de6aa848f51f0b835ec286fd847ddfd8a5 WatchSource:0}: Error finding container 8eb39cf29ab7476d1d8bde56c93f41de6aa848f51f0b835ec286fd847ddfd8a5: Status 404 returned error can't find the container with id 8eb39cf29ab7476d1d8bde56c93f41de6aa848f51f0b835ec286fd847ddfd8a5 Nov 04 05:48:48.447342 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.447322 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 05:48:48.516448 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:48.516407 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-45.us-west-1.compute.internal\" not found" Nov 04 05:48:48.516649 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.516635 2580 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 05:48:48.617088 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:48.617050 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-45.us-west-1.compute.internal\" not found" Nov 04 05:48:48.659405 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.659388 2580 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 05:48:48.677572 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.677557 2580 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 05:48:48.736639 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.736622 2580 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:48:48.792885 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.792836 2580 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 05:48:48.796648 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.796635 2580 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 05:48:48.797563 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.797551 2580 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:48:48.816776 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.816757 2580 apiserver.go:52] "Watching apiserver" Nov 04 05:48:48.837758 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.837734 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Nov 04 05:48:48.854766 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.854752 2580 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 05:48:48.919334 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.919312 2580 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 04 05:48:48.919575 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.919560 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal","kube-system/global-pull-secret-syncer-9vrcj","kube-system/kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal","openshift-image-registry/node-ca-xzkmv","openshift-multus/network-metrics-daemon-ssngm","openshift-network-diagnostics/network-check-target-zc9wk","openshift-network-operator/iptables-alerter-pc5sk","openshift-multus/multus-5jn26","openshift-multus/multus-additional-cni-plugins-tqz8r","openshift-ovn-kubernetes/ovnkube-node-qvgv2","openshift-cluster-node-tuning-operator/tuned-848sz","openshift-dns/node-resolver-7cdk6","kube-system/konnectivity-agent-plf2w"] Nov 04 05:48:48.923058 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.923037 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:48:48.925073 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.925040 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7cdk6" Nov 04 05:48:48.927119 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.927101 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:48:48.927202 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:48.927161 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:48:48.929122 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.929109 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-plf2w" Nov 04 05:48:48.931129 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.931115 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xzkmv" Nov 04 05:48:48.933274 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.933257 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:48:48.933357 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:48.933318 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:48:48.936343 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.936327 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5jn26" Nov 04 05:48:48.938993 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.938974 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:48:48.939100 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:48.939029 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:48:48.940948 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.940931 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pc5sk" Nov 04 05:48:48.942941 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.942922 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:48:48.945126 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.945113 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:48.947226 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.947209 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:48.947324 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.947207 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-run-netns\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:48.947383 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.947363 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2bc8ee82-0a82-4157-99b0-53360f1cd919-cni-binary-copy\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:48:48.947432 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.947396 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/237e2f40-006a-4b40-aa3e-6d0d05295e6d-serviceca\") pod \"node-ca-xzkmv\" (UID: \"237e2f40-006a-4b40-aa3e-6d0d05295e6d\") " pod="openshift-image-registry/node-ca-xzkmv" Nov 04 05:48:48.947432 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.947421 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-run-k8s-cni-cncf-io\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:48.947526 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.947445 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-etc-kubernetes\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:48.947526 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.947492 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs\") pod \"network-metrics-daemon-ssngm\" (UID: \"83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f\") " pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:48:48.947588 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.947555 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2bc8ee82-0a82-4157-99b0-53360f1cd919-system-cni-dir\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:48:48.947627 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.947594 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dadf5f9-5bb9-4652-9d12-c4f17d327528-tmp-dir\") pod \"node-resolver-7cdk6\" (UID: \"5dadf5f9-5bb9-4652-9d12-c4f17d327528\") " pod="openshift-dns/node-resolver-7cdk6" Nov 04 05:48:48.947679 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.947629 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/635418a3-d2fd-4dcc-8893-8488f45988c0-dbus\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:48:48.947679 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.947657 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:48:48.947773 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.947683 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59bf3884-8cc8-4a80-a064-470c85186dda-konnectivity-ca\") pod \"konnectivity-agent-plf2w\" (UID: \"59bf3884-8cc8-4a80-a064-470c85186dda\") " pod="kube-system/konnectivity-agent-plf2w" Nov 04 05:48:48.947773 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.947714 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-var-lib-cni-multus\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:48.947773 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.947730 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-hostroot\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:48.947773 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.947744 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2bc8ee82-0a82-4157-99b0-53360f1cd919-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:48:48.947911 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.947783 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5dadf5f9-5bb9-4652-9d12-c4f17d327528-hosts-file\") pod \"node-resolver-7cdk6\" (UID: \"5dadf5f9-5bb9-4652-9d12-c4f17d327528\") " pod="openshift-dns/node-resolver-7cdk6" Nov 04 05:48:48.947911 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.947813 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/237e2f40-006a-4b40-aa3e-6d0d05295e6d-host\") pod \"node-ca-xzkmv\" (UID: \"237e2f40-006a-4b40-aa3e-6d0d05295e6d\") " pod="openshift-image-registry/node-ca-xzkmv" Nov 04 05:48:48.947911 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.947835 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f227a09-ac46-4ab4-85db-cf57670ae3c1-cni-binary-copy\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:48.947911 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.947872 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-run-multus-certs\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:48.947911 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.947907 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48twm\" (UniqueName: \"kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm\") pod \"network-check-target-zc9wk\" (UID: \"6bde7db4-687a-4dcb-b490-2f88e2e4ea71\") " pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:48:48.948052 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.947939 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2bc8ee82-0a82-4157-99b0-53360f1cd919-cnibin\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:48:48.948052 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.947973 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbrdw\" (UniqueName: \"kubernetes.io/projected/237e2f40-006a-4b40-aa3e-6d0d05295e6d-kube-api-access-kbrdw\") pod \"node-ca-xzkmv\" (UID: \"237e2f40-006a-4b40-aa3e-6d0d05295e6d\") " pod="openshift-image-registry/node-ca-xzkmv" Nov 04 05:48:48.948052 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.948002 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-cni-dir\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:48.948052 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.948034 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-var-lib-kubelet\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:48.948232 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.948122 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6jqz\" (UniqueName: \"kubernetes.io/projected/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-kube-api-access-n6jqz\") pod \"network-metrics-daemon-ssngm\" (UID: \"83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f\") " pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:48:48.948232 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.948179 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2bc8ee82-0a82-4157-99b0-53360f1cd919-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:48:48.948232 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.948221 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2bc8ee82-0a82-4157-99b0-53360f1cd919-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:48:48.948335 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.948259 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tlhk\" (UniqueName: \"kubernetes.io/projected/5dadf5f9-5bb9-4652-9d12-c4f17d327528-kube-api-access-5tlhk\") pod \"node-resolver-7cdk6\" (UID: \"5dadf5f9-5bb9-4652-9d12-c4f17d327528\") " pod="openshift-dns/node-resolver-7cdk6" Nov 04 05:48:48.948335 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.948296 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/635418a3-d2fd-4dcc-8893-8488f45988c0-kubelet-config\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:48:48.948335 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.948312 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-daemon-config\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:48.948335 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.948329 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59bf3884-8cc8-4a80-a064-470c85186dda-agent-certs\") pod \"konnectivity-agent-plf2w\" (UID: \"59bf3884-8cc8-4a80-a064-470c85186dda\") " pod="kube-system/konnectivity-agent-plf2w" Nov 04 05:48:48.948498 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.948380 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-conf-dir\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:48.948498 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.948405 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-system-cni-dir\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:48.948498 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.948426 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-cnibin\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:48.948498 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.948448 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-socket-dir-parent\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:48.948498 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.948473 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-var-lib-cni-bin\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:48.948754 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.948505 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44hld\" (UniqueName: \"kubernetes.io/projected/7f227a09-ac46-4ab4-85db-cf57670ae3c1-kube-api-access-44hld\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:48.948754 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.948530 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wx9c\" (UniqueName: \"kubernetes.io/projected/2bc8ee82-0a82-4157-99b0-53360f1cd919-kube-api-access-5wx9c\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:48:48.975587 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.975562 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z7wx5\"" Nov 04 05:48:48.975689 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.975603 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 04 05:48:48.975689 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.975644 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 04 05:48:48.975689 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.975681 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 04 05:48:48.975880 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.975779 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 04 05:48:48.975880 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.975856 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 04 05:48:48.977030 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.977000 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" event={"ID":"aea09c4c566ff629316b6657597f6b06","Type":"ContainerStarted","Data":"32a03eca3efac02dd990719640a77603f8fd42784a5d827b73cb4101d30bd356"} Nov 04 05:48:48.977188 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.977176 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 04 05:48:48.977188 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.977182 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 04 05:48:48.977308 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.977293 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4mrpf\"" Nov 04 05:48:48.978076 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.978039 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal" event={"ID":"cac56becdfbf016c3dc7fcb0c6060f7b","Type":"ContainerStarted","Data":"8eb39cf29ab7476d1d8bde56c93f41de6aa848f51f0b835ec286fd847ddfd8a5"} Nov 04 05:48:48.981141 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.981051 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 04 05:48:48.981527 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.981509 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 04 05:48:48.981627 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.981557 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-plv46\"" Nov 04 05:48:48.983329 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.983283 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 04 05:48:48.983600 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.983561 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 04 05:48:48.983600 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.983579 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 04 05:48:48.983716 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.983634 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5jcm9\"" Nov 04 05:48:48.988288 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.988273 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 04 05:48:48.988383 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.988374 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-tk5dx\"" Nov 04 05:48:48.992898 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.992884 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 04 05:48:48.992963 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.992937 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 04 05:48:48.993009 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.992963 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 04 05:48:48.993009 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.992981 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lflbx\"" Nov 04 05:48:48.994878 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.994863 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c8frb\"" Nov 04 05:48:48.994937 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.994896 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 04 05:48:48.994937 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.994905 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 04 05:48:48.994937 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.994924 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 04 05:48:48.996988 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.996973 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 04 05:48:48.997074 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.997036 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 04 05:48:48.997125 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:48.997086 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 04 05:48:49.021390 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.021369 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 04 05:48:49.021519 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.021505 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-njggn\"" Nov 04 05:48:49.021583 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.021567 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 04 05:48:49.021634 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.021615 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 04 05:48:49.021673 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.021641 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qt7t9\"" Nov 04 05:48:49.021719 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.021689 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 04 05:48:49.021719 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.021693 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 04 05:48:49.023175 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.023159 2580 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 04 05:48:49.023251 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.023212 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lxmxt" Nov 04 05:48:49.037295 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.037282 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 04 05:48:49.049485 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049443 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tlhk\" (UniqueName: \"kubernetes.io/projected/5dadf5f9-5bb9-4652-9d12-c4f17d327528-kube-api-access-5tlhk\") pod \"node-resolver-7cdk6\" (UID: \"5dadf5f9-5bb9-4652-9d12-c4f17d327528\") " pod="openshift-dns/node-resolver-7cdk6" Nov 04 05:48:49.049485 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049465 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/635418a3-d2fd-4dcc-8893-8488f45988c0-kubelet-config\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:48:49.049485 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049481 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-daemon-config\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.049616 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049497 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bcf9e13b-7029-4567-85b8-4d53bca32fef-host-slash\") pod \"iptables-alerter-pc5sk\" (UID: \"bcf9e13b-7029-4567-85b8-4d53bca32fef\") " pod="openshift-network-operator/iptables-alerter-pc5sk" Nov 04 05:48:49.049616 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049519 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w44fz\" (UniqueName: \"kubernetes.io/projected/bcf9e13b-7029-4567-85b8-4d53bca32fef-kube-api-access-w44fz\") pod \"iptables-alerter-pc5sk\" (UID: \"bcf9e13b-7029-4567-85b8-4d53bca32fef\") " pod="openshift-network-operator/iptables-alerter-pc5sk" Nov 04 05:48:49.049616 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049569 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/635418a3-d2fd-4dcc-8893-8488f45988c0-kubelet-config\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:48:49.049616 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049608 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-etc-selinux\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:48:49.049764 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049641 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-conf-dir\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.049764 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049667 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-run\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.049764 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049689 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-var-lib-kubelet\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.049764 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049722 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrpdw\" (UniqueName: \"kubernetes.io/projected/f678b061-520c-474f-b4ab-7e5e6949100e-kube-api-access-wrpdw\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.049764 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049734 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-conf-dir\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.049764 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049745 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-system-cni-dir\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.049943 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049810 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-cnibin\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.049943 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049820 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-system-cni-dir\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.049943 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049832 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-socket-dir-parent\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.049943 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049864 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-cnibin\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.049943 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049870 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-var-lib-cni-bin\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.049943 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049895 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-sys-fs\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:48:49.049943 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049904 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-var-lib-cni-bin\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.049943 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049912 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-run-systemd\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.050179 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049957 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-socket-dir-parent\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.050179 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049957 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-var-lib-openvswitch\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.050179 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.049982 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-cni-bin\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.050179 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050007 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wx9c\" (UniqueName: \"kubernetes.io/projected/2bc8ee82-0a82-4157-99b0-53360f1cd919-kube-api-access-5wx9c\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:48:49.050179 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050029 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-daemon-config\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.050179 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050084 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-sysctl-d\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.050179 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050103 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-host\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.050179 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050119 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f678b061-520c-474f-b4ab-7e5e6949100e-etc-tuned\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.050385 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050182 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f678b061-520c-474f-b4ab-7e5e6949100e-tmp\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.050385 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050199 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2bc8ee82-0a82-4157-99b0-53360f1cd919-cni-binary-copy\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:48:49.050385 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050215 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-etc-kubernetes\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.050385 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050229 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs\") pod \"network-metrics-daemon-ssngm\" (UID: \"83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f\") " pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:48:49.050385 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050244 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-run-netns\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.050385 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050283 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-etc-kubernetes\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.050385 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:49.050311 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:48:49.050385 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050286 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/206b2e75-0735-49df-a53c-bdd17aab8ae6-ovnkube-script-lib\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.050385 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050334 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:48:49.050385 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:49.050380 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs podName:83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f nodeName:}" failed. No retries permitted until 2026-11-04 05:48:49.550354231 +0000 UTC m=+3.035143982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs") pod "network-metrics-daemon-ssngm" (UID: "83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:48:49.050658 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050431 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-systemd-units\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.050658 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050449 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2bc8ee82-0a82-4157-99b0-53360f1cd919-system-cni-dir\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:48:49.050658 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050464 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:48:49.050658 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050483 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-var-lib-cni-multus\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.050658 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050511 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2bc8ee82-0a82-4157-99b0-53360f1cd919-system-cni-dir\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:48:49.050658 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050524 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-var-lib-cni-multus\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.050658 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:49.050542 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 05:48:49.050658 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:49.050585 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret podName:635418a3-d2fd-4dcc-8893-8488f45988c0 nodeName:}" failed. No retries permitted until 2026-11-04 05:48:49.550574551 +0000 UTC m=+3.035364302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret") pod "global-pull-secret-syncer-9vrcj" (UID: "635418a3-d2fd-4dcc-8893-8488f45988c0") : object "kube-system"/"original-pull-secret" not registered Nov 04 05:48:49.050658 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050600 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-systemd\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.050658 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050608 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2bc8ee82-0a82-4157-99b0-53360f1cd919-cni-binary-copy\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:48:49.050658 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050623 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2bc8ee82-0a82-4157-99b0-53360f1cd919-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:48:49.050658 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050638 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5dadf5f9-5bb9-4652-9d12-c4f17d327528-hosts-file\") pod \"node-resolver-7cdk6\" (UID: \"5dadf5f9-5bb9-4652-9d12-c4f17d327528\") " pod="openshift-dns/node-resolver-7cdk6" Nov 04 05:48:49.050658 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050659 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/237e2f40-006a-4b40-aa3e-6d0d05295e6d-host\") pod \"node-ca-xzkmv\" (UID: \"237e2f40-006a-4b40-aa3e-6d0d05295e6d\") " pod="openshift-image-registry/node-ca-xzkmv" Nov 04 05:48:49.051230 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050676 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f227a09-ac46-4ab4-85db-cf57670ae3c1-cni-binary-copy\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.051230 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050691 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-lib-modules\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.051230 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050705 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbrdw\" (UniqueName: \"kubernetes.io/projected/237e2f40-006a-4b40-aa3e-6d0d05295e6d-kube-api-access-kbrdw\") pod \"node-ca-xzkmv\" (UID: \"237e2f40-006a-4b40-aa3e-6d0d05295e6d\") " pod="openshift-image-registry/node-ca-xzkmv" Nov 04 05:48:49.051230 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050718 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-cni-dir\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.051230 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050759 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/237e2f40-006a-4b40-aa3e-6d0d05295e6d-host\") pod \"node-ca-xzkmv\" (UID: \"237e2f40-006a-4b40-aa3e-6d0d05295e6d\") " pod="openshift-image-registry/node-ca-xzkmv" Nov 04 05:48:49.051230 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050777 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5dadf5f9-5bb9-4652-9d12-c4f17d327528-hosts-file\") pod \"node-resolver-7cdk6\" (UID: \"5dadf5f9-5bb9-4652-9d12-c4f17d327528\") " pod="openshift-dns/node-resolver-7cdk6" Nov 04 05:48:49.051230 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050778 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-log-socket\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.051230 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050809 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-cni-netd\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.051230 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050830 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-cni-dir\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.051230 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050833 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-sysctl-conf\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.051230 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050863 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2bc8ee82-0a82-4157-99b0-53360f1cd919-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:48:49.051230 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050885 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-modprobe-d\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.051230 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050905 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59bf3884-8cc8-4a80-a064-470c85186dda-agent-certs\") pod \"konnectivity-agent-plf2w\" (UID: \"59bf3884-8cc8-4a80-a064-470c85186dda\") " pod="kube-system/konnectivity-agent-plf2w" Nov 04 05:48:49.051230 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050946 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-device-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:48:49.051230 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050977 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.051230 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.050993 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/206b2e75-0735-49df-a53c-bdd17aab8ae6-env-overrides\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.051230 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051019 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2bc8ee82-0a82-4157-99b0-53360f1cd919-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:48:49.051755 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051036 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-sys\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.051755 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051048 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2bc8ee82-0a82-4157-99b0-53360f1cd919-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:48:49.051755 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051086 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44hld\" (UniqueName: \"kubernetes.io/projected/7f227a09-ac46-4ab4-85db-cf57670ae3c1-kube-api-access-44hld\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.051755 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051119 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-registration-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:48:49.051755 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051140 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-kubelet\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.051755 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051161 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-etc-openvswitch\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.051755 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051181 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-node-log\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.051755 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051188 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f227a09-ac46-4ab4-85db-cf57670ae3c1-cni-binary-copy\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.051755 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051208 2580 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 04 05:48:49.051755 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051221 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-sysconfig\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.051755 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051256 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-kubernetes\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.051755 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051288 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-socket-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:48:49.051755 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051302 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-run-ovn-kubernetes\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.051755 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051316 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcqrv\" (UniqueName: \"kubernetes.io/projected/206b2e75-0735-49df-a53c-bdd17aab8ae6-kube-api-access-hcqrv\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.051755 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051332 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-run-netns\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.051755 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051367 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/237e2f40-006a-4b40-aa3e-6d0d05295e6d-serviceca\") pod \"node-ca-xzkmv\" (UID: \"237e2f40-006a-4b40-aa3e-6d0d05295e6d\") " pod="openshift-image-registry/node-ca-xzkmv" Nov 04 05:48:49.051755 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051369 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-run-netns\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.052471 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051404 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-run-k8s-cni-cncf-io\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.052471 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051479 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-run-openvswitch\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.052471 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051494 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-run-k8s-cni-cncf-io\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.052471 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051517 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-run-ovn\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.052471 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051534 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/206b2e75-0735-49df-a53c-bdd17aab8ae6-ovn-node-metrics-cert\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.052471 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051592 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-run-multus-certs\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.052471 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051639 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48twm\" (UniqueName: \"kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm\") pod \"network-check-target-zc9wk\" (UID: \"6bde7db4-687a-4dcb-b490-2f88e2e4ea71\") " pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:48:49.052471 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051667 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-run-multus-certs\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.052471 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051714 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/237e2f40-006a-4b40-aa3e-6d0d05295e6d-serviceca\") pod \"node-ca-xzkmv\" (UID: \"237e2f40-006a-4b40-aa3e-6d0d05295e6d\") " pod="openshift-image-registry/node-ca-xzkmv" Nov 04 05:48:49.052471 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051717 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dadf5f9-5bb9-4652-9d12-c4f17d327528-tmp-dir\") pod \"node-resolver-7cdk6\" (UID: \"5dadf5f9-5bb9-4652-9d12-c4f17d327528\") " pod="openshift-dns/node-resolver-7cdk6" Nov 04 05:48:49.052471 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051806 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/635418a3-d2fd-4dcc-8893-8488f45988c0-dbus\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:48:49.052471 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051830 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59bf3884-8cc8-4a80-a064-470c85186dda-konnectivity-ca\") pod \"konnectivity-agent-plf2w\" (UID: \"59bf3884-8cc8-4a80-a064-470c85186dda\") " pod="kube-system/konnectivity-agent-plf2w" Nov 04 05:48:49.052471 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051844 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-hostroot\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.052471 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051879 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bcf9e13b-7029-4567-85b8-4d53bca32fef-iptables-alerter-script\") pod \"iptables-alerter-pc5sk\" (UID: \"bcf9e13b-7029-4567-85b8-4d53bca32fef\") " pod="openshift-network-operator/iptables-alerter-pc5sk" Nov 04 05:48:49.052471 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051897 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-hostroot\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.052471 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051913 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/635418a3-d2fd-4dcc-8893-8488f45988c0-dbus\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:48:49.052471 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051957 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2bc8ee82-0a82-4157-99b0-53360f1cd919-cnibin\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:48:49.052878 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051973 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dadf5f9-5bb9-4652-9d12-c4f17d327528-tmp-dir\") pod \"node-resolver-7cdk6\" (UID: \"5dadf5f9-5bb9-4652-9d12-c4f17d327528\") " pod="openshift-dns/node-resolver-7cdk6" Nov 04 05:48:49.052878 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.051987 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-var-lib-kubelet\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.052878 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.052005 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6jqz\" (UniqueName: \"kubernetes.io/projected/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-kube-api-access-n6jqz\") pod \"network-metrics-daemon-ssngm\" (UID: \"83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f\") " pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:48:49.052878 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.052022 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxkfl\" (UniqueName: \"kubernetes.io/projected/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-kube-api-access-dxkfl\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:48:49.052878 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.052031 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2bc8ee82-0a82-4157-99b0-53360f1cd919-cnibin\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:48:49.052878 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.052045 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-slash\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.052878 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.052070 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-var-lib-kubelet\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.052878 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.052176 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/206b2e75-0735-49df-a53c-bdd17aab8ae6-ovnkube-config\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.052878 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.052214 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2bc8ee82-0a82-4157-99b0-53360f1cd919-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:48:49.052878 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.052356 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59bf3884-8cc8-4a80-a064-470c85186dda-konnectivity-ca\") pod \"konnectivity-agent-plf2w\" (UID: \"59bf3884-8cc8-4a80-a064-470c85186dda\") " pod="kube-system/konnectivity-agent-plf2w" Nov 04 05:48:49.052878 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.052529 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2bc8ee82-0a82-4157-99b0-53360f1cd919-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:48:49.054236 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.054222 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59bf3884-8cc8-4a80-a064-470c85186dda-agent-certs\") pod \"konnectivity-agent-plf2w\" (UID: \"59bf3884-8cc8-4a80-a064-470c85186dda\") " pod="kube-system/konnectivity-agent-plf2w" Nov 04 05:48:49.108915 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:49.108891 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 05:48:49.108915 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:49.108917 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 05:48:49.108915 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:49.108930 2580 projected.go:196] Error preparing data for projected volume kube-api-access-48twm for pod openshift-network-diagnostics/network-check-target-zc9wk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:48:49.109145 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:49.109005 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm podName:6bde7db4-687a-4dcb-b490-2f88e2e4ea71 nodeName:}" failed. No retries permitted until 2026-11-04 05:48:49.608988221 +0000 UTC m=+3.093777979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-48twm" (UniqueName: "kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm") pod "network-check-target-zc9wk" (UID: "6bde7db4-687a-4dcb-b490-2f88e2e4ea71") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:48:49.109676 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.109645 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tlhk\" (UniqueName: \"kubernetes.io/projected/5dadf5f9-5bb9-4652-9d12-c4f17d327528-kube-api-access-5tlhk\") pod \"node-resolver-7cdk6\" (UID: \"5dadf5f9-5bb9-4652-9d12-c4f17d327528\") " pod="openshift-dns/node-resolver-7cdk6" Nov 04 05:48:49.109775 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.109756 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wx9c\" (UniqueName: \"kubernetes.io/projected/2bc8ee82-0a82-4157-99b0-53360f1cd919-kube-api-access-5wx9c\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:48:49.109906 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.109890 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbrdw\" (UniqueName: \"kubernetes.io/projected/237e2f40-006a-4b40-aa3e-6d0d05295e6d-kube-api-access-kbrdw\") pod \"node-ca-xzkmv\" (UID: \"237e2f40-006a-4b40-aa3e-6d0d05295e6d\") " pod="openshift-image-registry/node-ca-xzkmv" Nov 04 05:48:49.110153 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.110138 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44hld\" (UniqueName: \"kubernetes.io/projected/7f227a09-ac46-4ab4-85db-cf57670ae3c1-kube-api-access-44hld\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.111095 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.111081 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6jqz\" (UniqueName: \"kubernetes.io/projected/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-kube-api-access-n6jqz\") pod \"network-metrics-daemon-ssngm\" (UID: \"83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f\") " pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:48:49.152907 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.152882 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-modprobe-d\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.152998 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.152911 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-device-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:48:49.152998 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.152936 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.152998 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.152987 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.153133 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.152997 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/206b2e75-0735-49df-a53c-bdd17aab8ae6-env-overrides\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.153133 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153031 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-sys\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.153133 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153058 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-registration-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:48:49.153133 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153083 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-kubelet\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.153133 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153101 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-sys\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.153133 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153031 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-modprobe-d\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.153133 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153000 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-device-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:48:49.153133 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153104 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-etc-openvswitch\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.153482 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153134 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-etc-openvswitch\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.153482 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153138 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-registration-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:48:49.153482 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153154 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-node-log\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.153482 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153165 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-kubelet\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.153482 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153178 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-sysconfig\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.153482 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153199 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-kubernetes\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.153482 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153224 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-socket-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:48:49.153482 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153239 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-sysconfig\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.153482 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153247 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-run-ovn-kubernetes\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.153482 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153252 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-node-log\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.153482 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153288 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-run-ovn-kubernetes\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.153482 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153297 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-kubernetes\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.153482 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153317 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcqrv\" (UniqueName: \"kubernetes.io/projected/206b2e75-0735-49df-a53c-bdd17aab8ae6-kube-api-access-hcqrv\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.153482 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153344 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-run-openvswitch\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.153482 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153356 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-socket-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:48:49.153482 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153364 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-run-ovn\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.153482 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153366 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/206b2e75-0735-49df-a53c-bdd17aab8ae6-env-overrides\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.154335 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153387 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/206b2e75-0735-49df-a53c-bdd17aab8ae6-ovn-node-metrics-cert\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.154335 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153400 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-run-openvswitch\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.154335 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153408 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-run-ovn\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.154335 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153431 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bcf9e13b-7029-4567-85b8-4d53bca32fef-iptables-alerter-script\") pod \"iptables-alerter-pc5sk\" (UID: \"bcf9e13b-7029-4567-85b8-4d53bca32fef\") " pod="openshift-network-operator/iptables-alerter-pc5sk" Nov 04 05:48:49.154335 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153454 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxkfl\" (UniqueName: \"kubernetes.io/projected/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-kube-api-access-dxkfl\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:48:49.154335 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153479 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-slash\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.154335 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153501 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/206b2e75-0735-49df-a53c-bdd17aab8ae6-ovnkube-config\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.154335 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153526 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bcf9e13b-7029-4567-85b8-4d53bca32fef-host-slash\") pod \"iptables-alerter-pc5sk\" (UID: \"bcf9e13b-7029-4567-85b8-4d53bca32fef\") " pod="openshift-network-operator/iptables-alerter-pc5sk" Nov 04 05:48:49.154335 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153548 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w44fz\" (UniqueName: \"kubernetes.io/projected/bcf9e13b-7029-4567-85b8-4d53bca32fef-kube-api-access-w44fz\") pod \"iptables-alerter-pc5sk\" (UID: \"bcf9e13b-7029-4567-85b8-4d53bca32fef\") " pod="openshift-network-operator/iptables-alerter-pc5sk" Nov 04 05:48:49.154335 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153527 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-slash\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.154335 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153570 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-etc-selinux\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:48:49.154335 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153613 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-run\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.154335 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153628 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bcf9e13b-7029-4567-85b8-4d53bca32fef-host-slash\") pod \"iptables-alerter-pc5sk\" (UID: \"bcf9e13b-7029-4567-85b8-4d53bca32fef\") " pod="openshift-network-operator/iptables-alerter-pc5sk" Nov 04 05:48:49.154335 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153654 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-var-lib-kubelet\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.154335 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153680 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrpdw\" (UniqueName: \"kubernetes.io/projected/f678b061-520c-474f-b4ab-7e5e6949100e-kube-api-access-wrpdw\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.154335 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153683 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-run\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.154335 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153705 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-sys-fs\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:48:49.154809 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153719 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-var-lib-kubelet\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.154809 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153755 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-run-systemd\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.154809 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153728 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-run-systemd\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.154809 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153729 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-etc-selinux\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:48:49.154809 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153768 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-sys-fs\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:48:49.154809 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153789 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-var-lib-openvswitch\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.154809 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153822 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-cni-bin\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.154809 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153845 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-sysctl-d\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.154809 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153860 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-var-lib-openvswitch\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.154809 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153871 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-cni-bin\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.154809 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153873 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-host\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.154809 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153900 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f678b061-520c-474f-b4ab-7e5e6949100e-etc-tuned\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.154809 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153908 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-host\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.154809 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153918 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f678b061-520c-474f-b4ab-7e5e6949100e-tmp\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.154809 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153955 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-sysctl-d\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.154809 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.153988 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-run-netns\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.154809 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.154008 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/206b2e75-0735-49df-a53c-bdd17aab8ae6-ovnkube-script-lib\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.154809 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.154034 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:48:49.155282 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.154054 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-systemd-units\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.155282 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.154108 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-systemd\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.155282 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.154130 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bcf9e13b-7029-4567-85b8-4d53bca32fef-iptables-alerter-script\") pod \"iptables-alerter-pc5sk\" (UID: \"bcf9e13b-7029-4567-85b8-4d53bca32fef\") " pod="openshift-network-operator/iptables-alerter-pc5sk" Nov 04 05:48:49.155282 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.154137 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-lib-modules\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.155282 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.154179 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/206b2e75-0735-49df-a53c-bdd17aab8ae6-ovnkube-config\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.155282 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.154189 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-log-socket\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.155282 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.154213 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-cni-netd\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.155282 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.154223 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-lib-modules\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.155282 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.154238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-sysctl-conf\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.155282 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.154245 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-run-netns\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.155282 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.154268 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-systemd-units\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.155282 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.154271 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-systemd\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.155282 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.154297 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:48:49.155282 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.154307 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-cni-netd\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.155282 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.154327 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-log-socket\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.155282 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.154378 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-sysctl-conf\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.155282 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.154609 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/206b2e75-0735-49df-a53c-bdd17aab8ae6-ovnkube-script-lib\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.155282 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.155270 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/206b2e75-0735-49df-a53c-bdd17aab8ae6-ovn-node-metrics-cert\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.155733 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.155539 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f678b061-520c-474f-b4ab-7e5e6949100e-etc-tuned\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.155733 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.155696 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f678b061-520c-474f-b4ab-7e5e6949100e-tmp\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.213503 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.213479 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w44fz\" (UniqueName: \"kubernetes.io/projected/bcf9e13b-7029-4567-85b8-4d53bca32fef-kube-api-access-w44fz\") pod \"iptables-alerter-pc5sk\" (UID: \"bcf9e13b-7029-4567-85b8-4d53bca32fef\") " pod="openshift-network-operator/iptables-alerter-pc5sk" Nov 04 05:48:49.213594 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.213518 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcqrv\" (UniqueName: \"kubernetes.io/projected/206b2e75-0735-49df-a53c-bdd17aab8ae6-kube-api-access-hcqrv\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.213594 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.213546 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrpdw\" (UniqueName: \"kubernetes.io/projected/f678b061-520c-474f-b4ab-7e5e6949100e-kube-api-access-wrpdw\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.213594 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.213551 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxkfl\" (UniqueName: \"kubernetes.io/projected/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-kube-api-access-dxkfl\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:48:49.244378 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.244354 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7cdk6" Nov 04 05:48:49.246545 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.246525 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-plf2w" Nov 04 05:48:49.251330 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.251294 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:48:49.252384 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.252368 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xzkmv" Nov 04 05:48:49.256510 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.256489 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5jn26" Nov 04 05:48:49.256789 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:49.256768 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dadf5f9_5bb9_4652_9d12_c4f17d327528.slice/crio-2b09245e3ed95759d032b02dffced1eade477eb95cc522e71d7c62caacb272f3 WatchSource:0}: Error finding container 2b09245e3ed95759d032b02dffced1eade477eb95cc522e71d7c62caacb272f3: Status 404 returned error can't find the container with id 2b09245e3ed95759d032b02dffced1eade477eb95cc522e71d7c62caacb272f3 Nov 04 05:48:49.262080 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.262047 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pc5sk" Nov 04 05:48:49.265716 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:49.265469 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bc8ee82_0a82_4157_99b0_53360f1cd919.slice/crio-a396ba5736233f1901d46140af01c70266994f35bea8f5955343ec8467a9d7ab WatchSource:0}: Error finding container a396ba5736233f1901d46140af01c70266994f35bea8f5955343ec8467a9d7ab: Status 404 returned error can't find the container with id a396ba5736233f1901d46140af01c70266994f35bea8f5955343ec8467a9d7ab Nov 04 05:48:49.269038 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:49.269010 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f227a09_ac46_4ab4_85db_cf57670ae3c1.slice/crio-50986f63cea9bb5f61995667a88c6f2fa90b6a533101e17451da766c8ceb46f3 WatchSource:0}: Error finding container 50986f63cea9bb5f61995667a88c6f2fa90b6a533101e17451da766c8ceb46f3: Status 404 returned error can't find the container with id 50986f63cea9bb5f61995667a88c6f2fa90b6a533101e17451da766c8ceb46f3 Nov 04 05:48:49.270790 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.270457 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:48:49.272341 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:49.272259 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod237e2f40_006a_4b40_aa3e_6d0d05295e6d.slice/crio-8c1dc9ece389634bcb19fbf5d6bf13066353cd2ab4b25119f62a84b19485ceb0 WatchSource:0}: Error finding container 8c1dc9ece389634bcb19fbf5d6bf13066353cd2ab4b25119f62a84b19485ceb0: Status 404 returned error can't find the container with id 8c1dc9ece389634bcb19fbf5d6bf13066353cd2ab4b25119f62a84b19485ceb0 Nov 04 05:48:49.275346 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:49.275126 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcf9e13b_7029_4567_85b8_4d53bca32fef.slice/crio-bc7e49420dda09f988b8df21ba90c69fa996b0633c7c9af4bc14027b257bf4a5 WatchSource:0}: Error finding container bc7e49420dda09f988b8df21ba90c69fa996b0633c7c9af4bc14027b257bf4a5: Status 404 returned error can't find the container with id bc7e49420dda09f988b8df21ba90c69fa996b0633c7c9af4bc14027b257bf4a5 Nov 04 05:48:49.280291 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.280267 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:48:49.289559 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.289535 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:48:49.295106 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:49.295083 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf678b061_520c_474f_b4ab_7e5e6949100e.slice/crio-8e2caf3ccc170848ab4c78c0223372dc380c6ab540fe452b211567ec0cb662c4 WatchSource:0}: Error finding container 8e2caf3ccc170848ab4c78c0223372dc380c6ab540fe452b211567ec0cb662c4: Status 404 returned error can't find the container with id 8e2caf3ccc170848ab4c78c0223372dc380c6ab540fe452b211567ec0cb662c4 Nov 04 05:48:49.299746 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:48:49.299690 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod206b2e75_0735_49df_a53c_bdd17aab8ae6.slice/crio-dc72ae2f62b98449fa1adf7cba30a5346084c61fc6d55bdc95fec98330fe640b WatchSource:0}: Error finding container dc72ae2f62b98449fa1adf7cba30a5346084c61fc6d55bdc95fec98330fe640b: Status 404 returned error can't find the container with id dc72ae2f62b98449fa1adf7cba30a5346084c61fc6d55bdc95fec98330fe640b Nov 04 05:48:49.558561 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.558479 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs\") pod \"network-metrics-daemon-ssngm\" (UID: \"83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f\") " pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:48:49.558561 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.558521 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:48:49.558776 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:49.558615 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 05:48:49.558776 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:49.558663 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:48:49.558776 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:49.558678 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret podName:635418a3-d2fd-4dcc-8893-8488f45988c0 nodeName:}" failed. No retries permitted until 2026-11-04 05:48:50.558662456 +0000 UTC m=+4.043452198 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret") pod "global-pull-secret-syncer-9vrcj" (UID: "635418a3-d2fd-4dcc-8893-8488f45988c0") : object "kube-system"/"original-pull-secret" not registered Nov 04 05:48:49.558776 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:49.558748 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs podName:83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f nodeName:}" failed. No retries permitted until 2026-11-04 05:48:50.558731127 +0000 UTC m=+4.043520879 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs") pod "network-metrics-daemon-ssngm" (UID: "83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:48:49.659788 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.659750 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48twm\" (UniqueName: \"kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm\") pod \"network-check-target-zc9wk\" (UID: \"6bde7db4-687a-4dcb-b490-2f88e2e4ea71\") " pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:48:49.659970 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:49.659881 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 05:48:49.659970 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:49.659906 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 05:48:49.659970 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:49.659919 2580 projected.go:196] Error preparing data for projected volume kube-api-access-48twm for pod openshift-network-diagnostics/network-check-target-zc9wk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:48:49.660188 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:49.659973 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm podName:6bde7db4-687a-4dcb-b490-2f88e2e4ea71 nodeName:}" failed. No retries permitted until 2026-11-04 05:48:50.65996004 +0000 UTC m=+4.144749791 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-48twm" (UniqueName: "kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm") pod "network-check-target-zc9wk" (UID: "6bde7db4-687a-4dcb-b490-2f88e2e4ea71") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:48:49.981359 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.981321 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xzkmv" event={"ID":"237e2f40-006a-4b40-aa3e-6d0d05295e6d","Type":"ContainerStarted","Data":"8c1dc9ece389634bcb19fbf5d6bf13066353cd2ab4b25119f62a84b19485ceb0"} Nov 04 05:48:49.982723 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.982695 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7cdk6" event={"ID":"5dadf5f9-5bb9-4652-9d12-c4f17d327528","Type":"ContainerStarted","Data":"2b09245e3ed95759d032b02dffced1eade477eb95cc522e71d7c62caacb272f3"} Nov 04 05:48:49.984041 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.984011 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" event={"ID":"206b2e75-0735-49df-a53c-bdd17aab8ae6","Type":"ContainerStarted","Data":"dc72ae2f62b98449fa1adf7cba30a5346084c61fc6d55bdc95fec98330fe640b"} Nov 04 05:48:49.985482 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.985431 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5jn26" event={"ID":"7f227a09-ac46-4ab4-85db-cf57670ae3c1","Type":"ContainerStarted","Data":"50986f63cea9bb5f61995667a88c6f2fa90b6a533101e17451da766c8ceb46f3"} Nov 04 05:48:49.986734 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.986700 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqz8r" event={"ID":"2bc8ee82-0a82-4157-99b0-53360f1cd919","Type":"ContainerStarted","Data":"a396ba5736233f1901d46140af01c70266994f35bea8f5955343ec8467a9d7ab"} Nov 04 05:48:49.988085 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.988046 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-plf2w" event={"ID":"59bf3884-8cc8-4a80-a064-470c85186dda","Type":"ContainerStarted","Data":"623b03da3fb7c889ae6d19eaa905cc6a601e2efc209a6e691b9e998e1c5d9e11"} Nov 04 05:48:49.989652 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.989623 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-848sz" event={"ID":"f678b061-520c-474f-b4ab-7e5e6949100e","Type":"ContainerStarted","Data":"8e2caf3ccc170848ab4c78c0223372dc380c6ab540fe452b211567ec0cb662c4"} Nov 04 05:48:49.990988 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.990962 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" event={"ID":"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc","Type":"ContainerStarted","Data":"4435416caffc8da3d173f24d06308c1332679baaee17b9f9a385eade822318c5"} Nov 04 05:48:49.992285 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:49.992257 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pc5sk" event={"ID":"bcf9e13b-7029-4567-85b8-4d53bca32fef","Type":"ContainerStarted","Data":"bc7e49420dda09f988b8df21ba90c69fa996b0633c7c9af4bc14027b257bf4a5"} Nov 04 05:48:50.026301 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:50.026258 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 05:43:48 +0000 UTC" deadline="2028-06-27 03:01:49.64284005 +0000 UTC" Nov 04 05:48:50.026436 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:50.026299 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14421h12m59.616544542s" Nov 04 05:48:50.575355 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:50.574842 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs\") pod \"network-metrics-daemon-ssngm\" (UID: \"83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f\") " pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:48:50.575355 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:50.574887 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:48:50.575355 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:50.575034 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 05:48:50.575355 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:50.575111 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret podName:635418a3-d2fd-4dcc-8893-8488f45988c0 nodeName:}" failed. No retries permitted until 2026-11-04 05:48:52.575091476 +0000 UTC m=+6.059881219 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret") pod "global-pull-secret-syncer-9vrcj" (UID: "635418a3-d2fd-4dcc-8893-8488f45988c0") : object "kube-system"/"original-pull-secret" not registered Nov 04 05:48:50.575355 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:50.575188 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:48:50.575355 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:50.575222 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs podName:83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f nodeName:}" failed. No retries permitted until 2026-11-04 05:48:52.575209823 +0000 UTC m=+6.059999566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs") pod "network-metrics-daemon-ssngm" (UID: "83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:48:50.676370 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:50.675475 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48twm\" (UniqueName: \"kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm\") pod \"network-check-target-zc9wk\" (UID: \"6bde7db4-687a-4dcb-b490-2f88e2e4ea71\") " pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:48:50.676370 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:50.675666 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 05:48:50.676370 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:50.675684 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 05:48:50.676370 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:50.675697 2580 projected.go:196] Error preparing data for projected volume kube-api-access-48twm for pod openshift-network-diagnostics/network-check-target-zc9wk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:48:50.676370 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:50.675754 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm podName:6bde7db4-687a-4dcb-b490-2f88e2e4ea71 nodeName:}" failed. No retries permitted until 2026-11-04 05:48:52.6757344 +0000 UTC m=+6.160524160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-48twm" (UniqueName: "kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm") pod "network-check-target-zc9wk" (UID: "6bde7db4-687a-4dcb-b490-2f88e2e4ea71") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:48:50.975085 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:50.974968 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:48:50.975248 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:50.974972 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:48:50.975248 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:50.975121 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:48:50.975248 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:50.975198 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:48:50.975248 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:50.974956 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:48:50.975446 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:50.975283 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:48:51.007606 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:51.006898 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal" event={"ID":"cac56becdfbf016c3dc7fcb0c6060f7b","Type":"ContainerStarted","Data":"4d043ed524a922c20b76263fcbcfcdfa17cea61f9d46b64e31f5f6d79c1b0859"} Nov 04 05:48:51.031855 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:51.031675 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 05:43:48 +0000 UTC" deadline="2028-07-29 20:16:46.444002918 +0000 UTC" Nov 04 05:48:51.031855 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:51.031735 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15206h27m55.412273538s" Nov 04 05:48:52.030664 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:52.029356 2580 generic.go:356] "Generic (PLEG): container finished" podID="aea09c4c566ff629316b6657597f6b06" containerID="e3d283c8959c8b56152c3b520b917b9dd303263f1d65b444f00582ee42a1a2f0" exitCode=0 Nov 04 05:48:52.030664 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:52.030372 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" event={"ID":"aea09c4c566ff629316b6657597f6b06","Type":"ContainerDied","Data":"e3d283c8959c8b56152c3b520b917b9dd303263f1d65b444f00582ee42a1a2f0"} Nov 04 05:48:52.155308 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:52.155084 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal" podStartSLOduration=4.155050995 podStartE2EDuration="4.155050995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:51.13082644 +0000 UTC m=+4.615616202" watchObservedRunningTime="2026-11-04 05:48:52.155050995 +0000 UTC m=+5.639840757" Nov 04 05:48:52.591564 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:52.591535 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs\") pod \"network-metrics-daemon-ssngm\" (UID: \"83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f\") " pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:48:52.591730 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:52.591579 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:48:52.591730 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:52.591700 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 05:48:52.591847 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:52.591756 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret podName:635418a3-d2fd-4dcc-8893-8488f45988c0 nodeName:}" failed. No retries permitted until 2026-11-04 05:48:56.591739452 +0000 UTC m=+10.076529204 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret") pod "global-pull-secret-syncer-9vrcj" (UID: "635418a3-d2fd-4dcc-8893-8488f45988c0") : object "kube-system"/"original-pull-secret" not registered Nov 04 05:48:52.591847 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:52.591807 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:48:52.591847 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:52.591829 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs podName:83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f nodeName:}" failed. No retries permitted until 2026-11-04 05:48:56.591822173 +0000 UTC m=+10.076611924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs") pod "network-metrics-daemon-ssngm" (UID: "83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:48:52.692737 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:52.692677 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48twm\" (UniqueName: \"kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm\") pod \"network-check-target-zc9wk\" (UID: \"6bde7db4-687a-4dcb-b490-2f88e2e4ea71\") " pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:48:52.692897 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:52.692834 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 05:48:52.692897 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:52.692860 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 05:48:52.692897 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:52.692873 2580 projected.go:196] Error preparing data for projected volume kube-api-access-48twm for pod openshift-network-diagnostics/network-check-target-zc9wk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:48:52.693079 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:52.692931 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm podName:6bde7db4-687a-4dcb-b490-2f88e2e4ea71 nodeName:}" failed. No retries permitted until 2026-11-04 05:48:56.69291318 +0000 UTC m=+10.177702921 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-48twm" (UniqueName: "kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm") pod "network-check-target-zc9wk" (UID: "6bde7db4-687a-4dcb-b490-2f88e2e4ea71") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:48:52.976186 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:52.976154 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:48:52.976354 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:52.976285 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:48:52.976354 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:52.976344 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:48:52.976439 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:52.976424 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:48:52.976486 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:52.976464 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:48:52.976685 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:52.976527 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:48:53.056791 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:53.056490 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" event={"ID":"aea09c4c566ff629316b6657597f6b06","Type":"ContainerStarted","Data":"e1272b5f5fdb65c5da233f63fe1e553cf1f85ed76fc0936a31ab1e0a3e039949"} Nov 04 05:48:53.066009 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:53.065976 2580 generic.go:356] "Generic (PLEG): container finished" podID="2bc8ee82-0a82-4157-99b0-53360f1cd919" containerID="c5d0100f613164b11ef14ae77b7f846485c08095755e5064c8cbd049ccd305f5" exitCode=0 Nov 04 05:48:53.066212 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:53.066022 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqz8r" event={"ID":"2bc8ee82-0a82-4157-99b0-53360f1cd919","Type":"ContainerDied","Data":"c5d0100f613164b11ef14ae77b7f846485c08095755e5064c8cbd049ccd305f5"} Nov 04 05:48:53.312575 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:53.312478 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" podStartSLOduration=5.312464069 podStartE2EDuration="5.312464069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:53.181837584 +0000 UTC m=+6.666627345" watchObservedRunningTime="2026-11-04 05:48:53.312464069 +0000 UTC m=+6.797253830" Nov 04 05:48:54.079523 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:54.079487 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-plf2w" event={"ID":"59bf3884-8cc8-4a80-a064-470c85186dda","Type":"ContainerStarted","Data":"43f3ca8da3cb04aea60300f60e90e6d77f6fddebbb6d898344968d66341d044f"} Nov 04 05:48:54.203361 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:54.203283 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-plf2w" podStartSLOduration=2.816205435 podStartE2EDuration="7.203264111s" totalImagesPullingTime="4.387058676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:54.202654716 +0000 UTC m=+7.687444477" watchObservedRunningTime="2026-11-04 05:48:54.203264111 +0000 UTC m=+7.688053874" Nov 04 05:48:54.510102 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:54.509701 2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-plf2w" Nov 04 05:48:54.510661 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:54.510478 2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-plf2w" Nov 04 05:48:54.976801 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:54.976093 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:48:54.976801 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:54.976135 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:48:54.976801 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:54.976219 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:48:54.976801 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:54.976322 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:48:54.976801 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:54.976371 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:48:54.976801 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:54.976434 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:48:55.084438 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:55.084403 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xzkmv" event={"ID":"237e2f40-006a-4b40-aa3e-6d0d05295e6d","Type":"ContainerStarted","Data":"ee446882f7d1f0b3ad0c7d32c05cf90d7370c8670dbb44bdded205b51cded2fb"} Nov 04 05:48:55.208781 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:55.208415 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xzkmv" podStartSLOduration=2.817974646 podStartE2EDuration="8.208398212s" totalImagesPullingTime="5.390423566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:55.207760156 +0000 UTC m=+8.692549917" watchObservedRunningTime="2026-11-04 05:48:55.208398212 +0000 UTC m=+8.693187974" Nov 04 05:48:56.090370 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:56.090334 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" event={"ID":"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc","Type":"ContainerStarted","Data":"33f5513d24bce740d26f63298243a2003eb55bc8ade1fb4bc3b2bef864422139"} Nov 04 05:48:56.090895 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:56.090447 2580 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 05:48:56.625538 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:56.625471 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs\") pod \"network-metrics-daemon-ssngm\" (UID: \"83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f\") " pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:48:56.625538 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:56.625529 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:48:56.625824 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:56.625683 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 05:48:56.625824 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:56.625743 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret podName:635418a3-d2fd-4dcc-8893-8488f45988c0 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:04.625724773 +0000 UTC m=+18.110514514 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret") pod "global-pull-secret-syncer-9vrcj" (UID: "635418a3-d2fd-4dcc-8893-8488f45988c0") : object "kube-system"/"original-pull-secret" not registered Nov 04 05:48:56.626907 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:56.626142 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:48:56.626907 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:56.626507 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs podName:83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:04.626181839 +0000 UTC m=+18.110971580 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs") pod "network-metrics-daemon-ssngm" (UID: "83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:48:56.726795 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:56.726424 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48twm\" (UniqueName: \"kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm\") pod \"network-check-target-zc9wk\" (UID: \"6bde7db4-687a-4dcb-b490-2f88e2e4ea71\") " pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:48:56.726795 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:56.726618 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 05:48:56.726795 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:56.726636 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 05:48:56.726795 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:56.726648 2580 projected.go:196] Error preparing data for projected volume kube-api-access-48twm for pod openshift-network-diagnostics/network-check-target-zc9wk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:48:56.726795 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:56.726742 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm podName:6bde7db4-687a-4dcb-b490-2f88e2e4ea71 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:04.726697233 +0000 UTC m=+18.211486991 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-48twm" (UniqueName: "kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm") pod "network-check-target-zc9wk" (UID: "6bde7db4-687a-4dcb-b490-2f88e2e4ea71") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:48:56.975615 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:56.975544 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:48:56.975615 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:56.975575 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:48:56.975833 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:56.975648 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:48:56.975833 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:56.975732 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:48:56.975833 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:56.975796 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:48:56.975990 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:56.975877 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:48:57.683829 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:57.683523 2580 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 04 05:48:57.900447 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:57.899539 2580 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T05:48:57.683772509Z","UUID":"9b94d3b5-5b84-4ef9-86fe-3f2b7dfe6fb8","Handler":null,"Name":"","Endpoint":""} Nov 04 05:48:57.901911 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:57.901888 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 04 05:48:57.902027 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:57.901917 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 04 05:48:58.098650 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:58.098568 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" event={"ID":"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc","Type":"ContainerStarted","Data":"b56cfaf37dff0868b8476ad8c923424a2e809e854f2046659e3f25591328afb6"} Nov 04 05:48:58.100745 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:58.100708 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7cdk6" event={"ID":"5dadf5f9-5bb9-4652-9d12-c4f17d327528","Type":"ContainerStarted","Data":"67f839e55a627b74a63fcfa3a92c2ee3af08a2f45a50ac294d4560b76e781f0c"} Nov 04 05:48:58.102513 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:58.102489 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5jn26" event={"ID":"7f227a09-ac46-4ab4-85db-cf57670ae3c1","Type":"ContainerStarted","Data":"2f5c4b6856d064a7f35415bf025e04214056f75fd5e0e4ea4a6f220b80e80800"} Nov 04 05:48:58.104370 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:58.104343 2580 generic.go:356] "Generic (PLEG): container finished" podID="2bc8ee82-0a82-4157-99b0-53360f1cd919" containerID="9348a9eabb513b93009f81dcdcf053a786fb8b1bc394e120cef19e4d47071013" exitCode=0 Nov 04 05:48:58.104493 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:58.104382 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqz8r" event={"ID":"2bc8ee82-0a82-4157-99b0-53360f1cd919","Type":"ContainerDied","Data":"9348a9eabb513b93009f81dcdcf053a786fb8b1bc394e120cef19e4d47071013"} Nov 04 05:48:58.224462 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:58.224400 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-7cdk6" podStartSLOduration=2.862316892 podStartE2EDuration="11.224383024s" totalImagesPullingTime="8.362066132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:58.223775207 +0000 UTC m=+11.708564968" watchObservedRunningTime="2026-11-04 05:48:58.224383024 +0000 UTC m=+11.709172788" Nov 04 05:48:58.974462 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:58.974426 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:48:58.975176 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:58.974505 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:48:58.975176 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:48:58.974522 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:48:58.975176 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:58.974626 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:48:58.975176 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:58.975084 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:48:58.975391 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:48:58.975174 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:49:00.111298 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:00.111263 2580 generic.go:356] "Generic (PLEG): container finished" podID="2bc8ee82-0a82-4157-99b0-53360f1cd919" containerID="009657dcd7065815b628cb7cc557ba8c54a8ab4452f36335fb2f44cfe09e6b86" exitCode=0 Nov 04 05:49:00.111792 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:00.111341 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqz8r" event={"ID":"2bc8ee82-0a82-4157-99b0-53360f1cd919","Type":"ContainerDied","Data":"009657dcd7065815b628cb7cc557ba8c54a8ab4452f36335fb2f44cfe09e6b86"} Nov 04 05:49:00.114867 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:00.114841 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-848sz" event={"ID":"f678b061-520c-474f-b4ab-7e5e6949100e","Type":"ContainerStarted","Data":"acaf9d961637d66fa92de955af25cb2be39687a9b01c4a2c2ae9b0ad7171d698"} Nov 04 05:49:00.119416 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:00.119394 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" event={"ID":"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc","Type":"ContainerStarted","Data":"7694e85a241cdce162305657d8d771ed1eda4f605126fdfebc100d1e9a0650ca"} Nov 04 05:49:00.121111 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:00.121089 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pc5sk" event={"ID":"bcf9e13b-7029-4567-85b8-4d53bca32fef","Type":"ContainerStarted","Data":"fcfb75a8f7b3468dddb35c8d0d03a8dad91c8dcd62f84ad9dc42e56ca4f0c53b"} Nov 04 05:49:00.340040 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:00.339987 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-5jn26" podStartSLOduration=5.459429917 podStartE2EDuration="13.339972288s" totalImagesPullingTime="7.880542371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:58.485040435 +0000 UTC m=+11.969830211" watchObservedRunningTime="2026-11-04 05:49:00.339972288 +0000 UTC m=+13.824762047" Nov 04 05:49:00.462698 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:00.462643 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pc5sk" podStartSLOduration=5.020253312 podStartE2EDuration="13.462628416s" totalImagesPullingTime="8.442375104s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:00.462400211 +0000 UTC m=+13.947189974" watchObservedRunningTime="2026-11-04 05:49:00.462628416 +0000 UTC m=+13.947418176" Nov 04 05:49:00.594113 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:00.593987 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" podStartSLOduration=4.005766684 podStartE2EDuration="13.593965956s" totalImagesPullingTime="9.588199272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:00.59319797 +0000 UTC m=+14.077987731" watchObservedRunningTime="2026-11-04 05:49:00.593965956 +0000 UTC m=+14.078755721" Nov 04 05:49:00.748635 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:00.748588 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-848sz" podStartSLOduration=3.065376926 podStartE2EDuration="13.748574295s" totalImagesPullingTime="10.683197369s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:00.747920012 +0000 UTC m=+14.232709790" watchObservedRunningTime="2026-11-04 05:49:00.748574295 +0000 UTC m=+14.233364068" Nov 04 05:49:00.974724 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:00.974649 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:00.974724 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:00.974703 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:00.974927 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:00.974733 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:00.974927 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:00.974774 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:49:00.974927 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:00.974842 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:49:00.975040 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:00.974936 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:49:02.129458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:02.129202 2580 generic.go:356] "Generic (PLEG): container finished" podID="2bc8ee82-0a82-4157-99b0-53360f1cd919" containerID="4de3ab06e92c29c9f8a076c722a756ec0d1f37f3db0900673ce7c8eb78acc563" exitCode=0 Nov 04 05:49:02.129458 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:02.129298 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqz8r" event={"ID":"2bc8ee82-0a82-4157-99b0-53360f1cd919","Type":"ContainerDied","Data":"4de3ab06e92c29c9f8a076c722a756ec0d1f37f3db0900673ce7c8eb78acc563"} Nov 04 05:49:02.974024 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:02.973987 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:02.974218 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:02.973995 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:02.974218 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:02.974146 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:49:02.974218 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:02.973995 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:02.974218 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:02.974188 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:49:02.974429 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:02.974236 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:49:04.137226 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:04.137032 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvgv2_206b2e75-0735-49df-a53c-bdd17aab8ae6/ovn-acl-logging/0.log" Nov 04 05:49:04.137713 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:04.137587 2580 generic.go:356] "Generic (PLEG): container finished" podID="206b2e75-0735-49df-a53c-bdd17aab8ae6" containerID="425e7f5d3610bed852709d9f97a7610dd4f2f5c047bdeb3ec662747d56fa114a" exitCode=1 Nov 04 05:49:04.137713 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:04.137626 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" event={"ID":"206b2e75-0735-49df-a53c-bdd17aab8ae6","Type":"ContainerStarted","Data":"1382b9930e0ad481507a2aabef5829fc23f2e6ccb6dfe3533d34dce1f9680886"} Nov 04 05:49:04.137778 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:04.137733 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" event={"ID":"206b2e75-0735-49df-a53c-bdd17aab8ae6","Type":"ContainerStarted","Data":"cfe6cde2f4a74af393153fe39bd6121f58350ea8a03771ee8aab54b1577f03e5"} Nov 04 05:49:04.137809 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:04.137784 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" event={"ID":"206b2e75-0735-49df-a53c-bdd17aab8ae6","Type":"ContainerStarted","Data":"72c9fc5852fbc387ac0646a5f19c49d39d8ac5b9acd4ee14ef7e968d53f591b8"} Nov 04 05:49:04.137846 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:04.137831 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" event={"ID":"206b2e75-0735-49df-a53c-bdd17aab8ae6","Type":"ContainerStarted","Data":"070d66d6ca9acbd53909bff8677e37a0afd18c6fe8ac2dbe036ef887aa0d20c6"} Nov 04 05:49:04.137901 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:04.137886 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" event={"ID":"206b2e75-0735-49df-a53c-bdd17aab8ae6","Type":"ContainerDied","Data":"425e7f5d3610bed852709d9f97a7610dd4f2f5c047bdeb3ec662747d56fa114a"} Nov 04 05:49:04.137951 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:04.137940 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" event={"ID":"206b2e75-0735-49df-a53c-bdd17aab8ae6","Type":"ContainerStarted","Data":"7192de8060dcdec65ed6ea720be7eb35e1058439e5222d5e93def139d353f955"} Nov 04 05:49:04.693658 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:04.693626 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs\") pod \"network-metrics-daemon-ssngm\" (UID: \"83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f\") " pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:04.693813 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:04.693665 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:04.693813 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:04.693775 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 05:49:04.693813 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:04.693782 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:49:04.693946 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:04.693829 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret podName:635418a3-d2fd-4dcc-8893-8488f45988c0 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:20.69381649 +0000 UTC m=+34.178606227 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret") pod "global-pull-secret-syncer-9vrcj" (UID: "635418a3-d2fd-4dcc-8893-8488f45988c0") : object "kube-system"/"original-pull-secret" not registered Nov 04 05:49:04.693946 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:04.693843 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs podName:83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:20.69383649 +0000 UTC m=+34.178626229 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs") pod "network-metrics-daemon-ssngm" (UID: "83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:49:04.794590 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:04.794560 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48twm\" (UniqueName: \"kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm\") pod \"network-check-target-zc9wk\" (UID: \"6bde7db4-687a-4dcb-b490-2f88e2e4ea71\") " pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:04.794716 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:04.794683 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 05:49:04.794716 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:04.794697 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 05:49:04.794716 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:04.794705 2580 projected.go:196] Error preparing data for projected volume kube-api-access-48twm for pod openshift-network-diagnostics/network-check-target-zc9wk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:49:04.794820 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:04.794749 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm podName:6bde7db4-687a-4dcb-b490-2f88e2e4ea71 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:20.794738646 +0000 UTC m=+34.279528400 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-48twm" (UniqueName: "kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm") pod "network-check-target-zc9wk" (UID: "6bde7db4-687a-4dcb-b490-2f88e2e4ea71") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:49:04.974277 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:04.974198 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:04.974277 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:04.974215 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:04.974448 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:04.974369 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:49:04.974448 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:04.974409 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:04.974509 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:04.974483 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:49:04.974615 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:04.974592 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:49:05.141696 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:05.141662 2580 generic.go:356] "Generic (PLEG): container finished" podID="2bc8ee82-0a82-4157-99b0-53360f1cd919" containerID="2dff308fd0c7dea34d8ab01f15594f64acf74cf57c255dab9e6acfbac2a7f356" exitCode=0 Nov 04 05:49:05.141696 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:05.141699 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqz8r" event={"ID":"2bc8ee82-0a82-4157-99b0-53360f1cd919","Type":"ContainerDied","Data":"2dff308fd0c7dea34d8ab01f15594f64acf74cf57c255dab9e6acfbac2a7f356"} Nov 04 05:49:06.149736 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:06.149699 2580 generic.go:356] "Generic (PLEG): container finished" podID="2bc8ee82-0a82-4157-99b0-53360f1cd919" containerID="224114d088b78bf017f7e21aea4978f13e55a39d29b7187ae3f17661e6b6a7ca" exitCode=0 Nov 04 05:49:06.150093 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:06.149753 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqz8r" event={"ID":"2bc8ee82-0a82-4157-99b0-53360f1cd919","Type":"ContainerDied","Data":"224114d088b78bf017f7e21aea4978f13e55a39d29b7187ae3f17661e6b6a7ca"} Nov 04 05:49:06.974799 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:06.974767 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:06.974988 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:06.974849 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:49:06.974988 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:06.974938 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:06.975108 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:06.975032 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:49:06.975108 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:06.975095 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:06.975204 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:06.975143 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:49:07.154580 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:07.154556 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvgv2_206b2e75-0735-49df-a53c-bdd17aab8ae6/ovn-acl-logging/0.log" Nov 04 05:49:07.155117 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:07.154937 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" event={"ID":"206b2e75-0735-49df-a53c-bdd17aab8ae6","Type":"ContainerStarted","Data":"7ba9062f7969650a50ef0e49ac4ef65166bcf55608ded2246400dd8e5249c74a"} Nov 04 05:49:07.159992 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:07.159964 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tqz8r" event={"ID":"2bc8ee82-0a82-4157-99b0-53360f1cd919","Type":"ContainerStarted","Data":"3456a1a93aeb32046afc079569d8216978156a44da0d3beb4d6c9a6fa2141695"} Nov 04 05:49:07.290647 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:07.290552 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tqz8r" podStartSLOduration=8.193300682 podStartE2EDuration="20.290538946s" totalImagesPullingTime="12.097238264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:07.290277063 +0000 UTC m=+20.775066824" watchObservedRunningTime="2026-11-04 05:49:07.290538946 +0000 UTC m=+20.775328705" Nov 04 05:49:08.974740 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:08.974562 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:08.975141 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:08.974567 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:08.975141 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:08.974824 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:49:08.975141 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:08.974912 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:49:08.975141 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:08.974617 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:08.975141 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:08.974990 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:49:09.166588 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:09.166561 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvgv2_206b2e75-0735-49df-a53c-bdd17aab8ae6/ovn-acl-logging/0.log" Nov 04 05:49:09.166899 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:09.166877 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" event={"ID":"206b2e75-0735-49df-a53c-bdd17aab8ae6","Type":"ContainerStarted","Data":"d580c6ca7b7a3b78442487648884b896a5a64babb1aca2549e324fd1e4480db9"} Nov 04 05:49:09.167187 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:09.167167 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:49:09.167319 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:09.167304 2580 scope.go:122] "RemoveContainer" containerID="425e7f5d3610bed852709d9f97a7610dd4f2f5c047bdeb3ec662747d56fa114a" Nov 04 05:49:09.183538 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:09.183515 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:49:10.172039 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:10.172015 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvgv2_206b2e75-0735-49df-a53c-bdd17aab8ae6/ovn-acl-logging/0.log" Nov 04 05:49:10.172496 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:10.172334 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" event={"ID":"206b2e75-0735-49df-a53c-bdd17aab8ae6","Type":"ContainerStarted","Data":"3f38a4e10ead5a647c3c284c77821bb4987ba485e9f4abb27cb775eee9de299c"} Nov 04 05:49:10.172496 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:10.172445 2580 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 05:49:10.172712 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:10.172695 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:49:10.186983 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:10.186964 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:49:10.367961 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:10.367909 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" podStartSLOduration=8.998651491 podStartE2EDuration="23.367895709s" totalImagesPullingTime="14.369244218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:10.367828032 +0000 UTC m=+23.852617806" watchObservedRunningTime="2026-11-04 05:49:10.367895709 +0000 UTC m=+23.852685467" Nov 04 05:49:10.974057 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:10.973991 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:10.974057 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:10.974011 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:10.974302 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:10.974127 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:49:10.974302 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:10.974196 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:49:10.974302 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:10.974221 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:10.974416 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:10.974299 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:49:11.091753 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:11.091726 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9vrcj"] Nov 04 05:49:11.095110 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:11.095085 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zc9wk"] Nov 04 05:49:11.095830 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:11.095809 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ssngm"] Nov 04 05:49:11.174379 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:11.174359 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:11.174774 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:11.174360 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:11.174774 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:11.174452 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:49:11.174774 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:11.174461 2580 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 05:49:11.174774 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:11.174365 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:11.174774 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:11.174522 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:49:11.174774 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:11.174609 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:49:11.224042 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:11.224025 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:49:12.973823 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:12.973784 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:12.974279 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:12.973831 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:12.974279 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:12.973922 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:12.974279 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:12.973948 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:49:12.974279 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:12.974010 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:49:12.974279 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:12.974110 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:49:13.189354 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:13.189197 2580 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" podUID="206b2e75-0735-49df-a53c-bdd17aab8ae6" containerName="ovnkube-controller" probeResult="failure" output="" Nov 04 05:49:14.109515 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:14.109479 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-plf2w" Nov 04 05:49:14.110040 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:14.109606 2580 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 05:49:14.110040 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:14.110023 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-plf2w" Nov 04 05:49:14.973912 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:14.973886 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:14.973912 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:14.973900 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:14.974145 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:14.973986 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:14.974145 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:14.973995 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:49:14.974145 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:14.974089 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:49:14.974145 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:14.974124 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:49:16.974683 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:16.974650 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:16.975253 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:16.974747 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:49:16.975253 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:16.974843 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:16.975253 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:16.974883 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:16.975253 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:16.974965 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:49:16.975253 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:16.975089 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:49:18.237609 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:18.237584 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7cdk6_5dadf5f9-5bb9-4652-9d12-c4f17d327528/dns-node-resolver/0.log" Nov 04 05:49:18.974286 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:18.974250 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:18.974286 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:18.974274 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:18.974475 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:18.974308 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:18.974475 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:18.974393 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:49:18.974475 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:18.974453 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:49:18.974569 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:18.974506 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:49:19.383589 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:19.383561 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xzkmv_237e2f40-006a-4b40-aa3e-6d0d05295e6d/node-ca/0.log" Nov 04 05:49:20.708237 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:20.708206 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs\") pod \"network-metrics-daemon-ssngm\" (UID: \"83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f\") " pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:20.708237 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:20.708240 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:20.708685 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:20.708353 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 05:49:20.708685 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:20.708369 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:49:20.708685 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:20.708401 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret podName:635418a3-d2fd-4dcc-8893-8488f45988c0 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:52.708388368 +0000 UTC m=+66.193178119 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret") pod "global-pull-secret-syncer-9vrcj" (UID: "635418a3-d2fd-4dcc-8893-8488f45988c0") : object "kube-system"/"original-pull-secret" not registered Nov 04 05:49:20.708685 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:20.708434 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs podName:83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f nodeName:}" failed. No retries permitted until 2026-11-04 05:49:52.708416795 +0000 UTC m=+66.193206550 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs") pod "network-metrics-daemon-ssngm" (UID: "83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 05:49:20.808688 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:20.808662 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48twm\" (UniqueName: \"kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm\") pod \"network-check-target-zc9wk\" (UID: \"6bde7db4-687a-4dcb-b490-2f88e2e4ea71\") " pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:20.808815 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:20.808764 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 05:49:20.808815 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:20.808778 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 05:49:20.808815 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:20.808786 2580 projected.go:196] Error preparing data for projected volume kube-api-access-48twm for pod openshift-network-diagnostics/network-check-target-zc9wk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:49:20.808914 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:20.808826 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm podName:6bde7db4-687a-4dcb-b490-2f88e2e4ea71 nodeName:}" failed. No retries permitted until 2026-11-04 05:49:52.808815308 +0000 UTC m=+66.293605046 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-48twm" (UniqueName: "kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm") pod "network-check-target-zc9wk" (UID: "6bde7db4-687a-4dcb-b490-2f88e2e4ea71") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 05:49:20.974193 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:20.974110 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:20.974193 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:20.974140 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:20.974409 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:20.974122 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:20.974409 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:20.974241 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:49:20.974409 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:20.974335 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:49:20.974564 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:20.974432 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:49:22.974565 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:22.974529 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:22.974565 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:22.974556 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:22.975008 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:22.974601 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:22.975008 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:22.974703 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:49:22.975008 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:22.974826 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:49:22.975008 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:22.974899 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:49:24.974269 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:24.974238 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:24.974269 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:24.974257 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:24.974711 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:24.974259 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:24.974711 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:24.974330 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:49:24.974711 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:24.974430 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:49:24.974711 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:24.974501 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:49:26.975250 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:26.975220 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:26.975632 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:26.975297 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:49:26.975632 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:26.975388 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:26.975632 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:26.975473 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:49:26.975632 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:26.975514 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:26.975632 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:26.975564 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:49:28.974657 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:28.974629 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:28.974657 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:28.974655 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:28.975099 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:28.974629 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:28.975099 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:28.974729 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:49:28.975099 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:28.974808 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:49:28.975099 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:28.974892 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:49:30.974197 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:30.974166 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:30.974197 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:30.974189 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:30.974612 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:30.974175 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:30.974612 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:30.974264 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:49:30.974612 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:30.974367 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:49:30.974612 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:30.974470 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:49:32.973983 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:32.973951 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:32.974405 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:32.973960 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:32.974405 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:32.974054 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc9wk" podUID="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" Nov 04 05:49:32.974405 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:32.974151 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ssngm" podUID="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" Nov 04 05:49:32.974405 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:32.973959 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:32.974405 ip-10-0-134-45 kubenswrapper[2580]: E1104 05:49:32.974225 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vrcj" podUID="635418a3-d2fd-4dcc-8893-8488f45988c0" Nov 04 05:49:34.350739 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.350714 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeReady" Nov 04 05:49:34.351222 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.350862 2580 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Nov 04 05:49:34.530408 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.530370 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dxkjf"] Nov 04 05:49:34.531990 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.531973 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vtpdd"] Nov 04 05:49:34.532121 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.532102 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dxkjf" Nov 04 05:49:34.533406 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.533386 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-flcbl"] Nov 04 05:49:34.533522 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.533488 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vtpdd" Nov 04 05:49:34.534895 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.534877 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:49:34.587399 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.587374 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dxkjf"] Nov 04 05:49:34.589391 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.589363 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 04 05:49:34.589524 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.589456 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jwct4\"" Nov 04 05:49:34.589913 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.589659 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 04 05:49:34.589913 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.589850 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vtpdd"] Nov 04 05:49:34.590374 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.590351 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 04 05:49:34.590492 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.590420 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 04 05:49:34.590492 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.590462 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 04 05:49:34.590595 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.590533 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-rt5s6\"" Nov 04 05:49:34.611472 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.611418 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0742c411-7597-48ae-a35d-82a7d69fafdb-crio-socket\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:49:34.611472 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.611444 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0742c411-7597-48ae-a35d-82a7d69fafdb-data-volume\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:49:34.611472 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.611460 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljlvq\" (UniqueName: \"kubernetes.io/projected/63258d2f-36fe-483c-9d98-fefeffd43533-kube-api-access-ljlvq\") pod \"ingress-canary-vtpdd\" (UID: \"63258d2f-36fe-483c-9d98-fefeffd43533\") " pod="openshift-ingress-canary/ingress-canary-vtpdd" Nov 04 05:49:34.611622 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.611533 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0742c411-7597-48ae-a35d-82a7d69fafdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:49:34.611622 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.611583 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a956a93b-8cf1-45ad-bcbf-409e331a02d1-config-volume\") pod \"dns-default-dxkjf\" (UID: \"a956a93b-8cf1-45ad-bcbf-409e331a02d1\") " pod="openshift-dns/dns-default-dxkjf" Nov 04 05:49:34.611686 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.611621 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0742c411-7597-48ae-a35d-82a7d69fafdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:49:34.611686 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.611649 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjfjp\" (UniqueName: \"kubernetes.io/projected/a956a93b-8cf1-45ad-bcbf-409e331a02d1-kube-api-access-fjfjp\") pod \"dns-default-dxkjf\" (UID: \"a956a93b-8cf1-45ad-bcbf-409e331a02d1\") " pod="openshift-dns/dns-default-dxkjf" Nov 04 05:49:34.611741 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.611710 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8fdz\" (UniqueName: \"kubernetes.io/projected/0742c411-7597-48ae-a35d-82a7d69fafdb-kube-api-access-z8fdz\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:49:34.611741 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.611732 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a956a93b-8cf1-45ad-bcbf-409e331a02d1-metrics-tls\") pod \"dns-default-dxkjf\" (UID: \"a956a93b-8cf1-45ad-bcbf-409e331a02d1\") " pod="openshift-dns/dns-default-dxkjf" Nov 04 05:49:34.611799 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.611755 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a956a93b-8cf1-45ad-bcbf-409e331a02d1-tmp-dir\") pod \"dns-default-dxkjf\" (UID: \"a956a93b-8cf1-45ad-bcbf-409e331a02d1\") " pod="openshift-dns/dns-default-dxkjf" Nov 04 05:49:34.611799 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.611769 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63258d2f-36fe-483c-9d98-fefeffd43533-cert\") pod \"ingress-canary-vtpdd\" (UID: \"63258d2f-36fe-483c-9d98-fefeffd43533\") " pod="openshift-ingress-canary/ingress-canary-vtpdd" Nov 04 05:49:34.654360 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.654334 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-flcbl"] Nov 04 05:49:34.691392 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.691360 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 04 05:49:34.691392 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.691360 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 04 05:49:34.691392 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.691398 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 04 05:49:34.691636 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.691463 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8z5zb\"" Nov 04 05:49:34.691636 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.691538 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 04 05:49:34.712793 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.712766 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a956a93b-8cf1-45ad-bcbf-409e331a02d1-tmp-dir\") pod \"dns-default-dxkjf\" (UID: \"a956a93b-8cf1-45ad-bcbf-409e331a02d1\") " pod="openshift-dns/dns-default-dxkjf" Nov 04 05:49:34.712909 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.712797 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63258d2f-36fe-483c-9d98-fefeffd43533-cert\") pod \"ingress-canary-vtpdd\" (UID: \"63258d2f-36fe-483c-9d98-fefeffd43533\") " pod="openshift-ingress-canary/ingress-canary-vtpdd" Nov 04 05:49:34.712909 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.712825 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0742c411-7597-48ae-a35d-82a7d69fafdb-crio-socket\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:49:34.712909 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.712849 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0742c411-7597-48ae-a35d-82a7d69fafdb-data-volume\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:49:34.712909 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.712871 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljlvq\" (UniqueName: \"kubernetes.io/projected/63258d2f-36fe-483c-9d98-fefeffd43533-kube-api-access-ljlvq\") pod \"ingress-canary-vtpdd\" (UID: \"63258d2f-36fe-483c-9d98-fefeffd43533\") " pod="openshift-ingress-canary/ingress-canary-vtpdd" Nov 04 05:49:34.713141 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.712909 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0742c411-7597-48ae-a35d-82a7d69fafdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:49:34.713141 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.712933 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a956a93b-8cf1-45ad-bcbf-409e331a02d1-config-volume\") pod \"dns-default-dxkjf\" (UID: \"a956a93b-8cf1-45ad-bcbf-409e331a02d1\") " pod="openshift-dns/dns-default-dxkjf" Nov 04 05:49:34.713141 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.712967 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0742c411-7597-48ae-a35d-82a7d69fafdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:49:34.713141 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.713002 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjfjp\" (UniqueName: \"kubernetes.io/projected/a956a93b-8cf1-45ad-bcbf-409e331a02d1-kube-api-access-fjfjp\") pod \"dns-default-dxkjf\" (UID: \"a956a93b-8cf1-45ad-bcbf-409e331a02d1\") " pod="openshift-dns/dns-default-dxkjf" Nov 04 05:49:34.713141 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.713037 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0742c411-7597-48ae-a35d-82a7d69fafdb-crio-socket\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:49:34.713141 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.713050 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8fdz\" (UniqueName: \"kubernetes.io/projected/0742c411-7597-48ae-a35d-82a7d69fafdb-kube-api-access-z8fdz\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:49:34.713141 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.713110 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a956a93b-8cf1-45ad-bcbf-409e331a02d1-metrics-tls\") pod \"dns-default-dxkjf\" (UID: \"a956a93b-8cf1-45ad-bcbf-409e331a02d1\") " pod="openshift-dns/dns-default-dxkjf" Nov 04 05:49:34.713448 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.713239 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a956a93b-8cf1-45ad-bcbf-409e331a02d1-tmp-dir\") pod \"dns-default-dxkjf\" (UID: \"a956a93b-8cf1-45ad-bcbf-409e331a02d1\") " pod="openshift-dns/dns-default-dxkjf" Nov 04 05:49:34.713448 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.713239 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0742c411-7597-48ae-a35d-82a7d69fafdb-data-volume\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:49:34.713753 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.713730 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a956a93b-8cf1-45ad-bcbf-409e331a02d1-config-volume\") pod \"dns-default-dxkjf\" (UID: \"a956a93b-8cf1-45ad-bcbf-409e331a02d1\") " pod="openshift-dns/dns-default-dxkjf" Nov 04 05:49:34.713807 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.713730 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0742c411-7597-48ae-a35d-82a7d69fafdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:49:34.716686 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.716664 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a956a93b-8cf1-45ad-bcbf-409e331a02d1-metrics-tls\") pod \"dns-default-dxkjf\" (UID: \"a956a93b-8cf1-45ad-bcbf-409e331a02d1\") " pod="openshift-dns/dns-default-dxkjf" Nov 04 05:49:34.716772 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.716667 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0742c411-7597-48ae-a35d-82a7d69fafdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:49:34.716772 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.716695 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63258d2f-36fe-483c-9d98-fefeffd43533-cert\") pod \"ingress-canary-vtpdd\" (UID: \"63258d2f-36fe-483c-9d98-fefeffd43533\") " pod="openshift-ingress-canary/ingress-canary-vtpdd" Nov 04 05:49:34.778883 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.778848 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjfjp\" (UniqueName: \"kubernetes.io/projected/a956a93b-8cf1-45ad-bcbf-409e331a02d1-kube-api-access-fjfjp\") pod \"dns-default-dxkjf\" (UID: \"a956a93b-8cf1-45ad-bcbf-409e331a02d1\") " pod="openshift-dns/dns-default-dxkjf" Nov 04 05:49:34.779140 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.779117 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljlvq\" (UniqueName: \"kubernetes.io/projected/63258d2f-36fe-483c-9d98-fefeffd43533-kube-api-access-ljlvq\") pod \"ingress-canary-vtpdd\" (UID: \"63258d2f-36fe-483c-9d98-fefeffd43533\") " pod="openshift-ingress-canary/ingress-canary-vtpdd" Nov 04 05:49:34.781646 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.781621 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8fdz\" (UniqueName: \"kubernetes.io/projected/0742c411-7597-48ae-a35d-82a7d69fafdb-kube-api-access-z8fdz\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:49:34.806198 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.806174 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sj64z"] Nov 04 05:49:34.808204 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.808190 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sj64z" Nov 04 05:49:34.843344 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.843319 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dxkjf" Nov 04 05:49:34.848895 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.848863 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vtpdd" Nov 04 05:49:34.854866 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.854846 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:49:34.865394 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.865370 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-7m57f\"" Nov 04 05:49:34.868098 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.867949 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Nov 04 05:49:34.872405 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.872382 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sj64z"] Nov 04 05:49:34.914678 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.914640 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8c71ae38-62e0-4de3-9cf9-c4ee58edd96a-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-sj64z\" (UID: \"8c71ae38-62e0-4de3-9cf9-c4ee58edd96a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sj64z" Nov 04 05:49:34.974694 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.974667 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:34.974694 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.974687 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:34.974859 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:34.974717 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:35.015112 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:35.015083 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8c71ae38-62e0-4de3-9cf9-c4ee58edd96a-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-sj64z\" (UID: \"8c71ae38-62e0-4de3-9cf9-c4ee58edd96a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sj64z" Nov 04 05:49:35.017328 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:35.017310 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8c71ae38-62e0-4de3-9cf9-c4ee58edd96a-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-sj64z\" (UID: \"8c71ae38-62e0-4de3-9cf9-c4ee58edd96a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sj64z" Nov 04 05:49:35.032139 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:35.032113 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 04 05:49:35.032293 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:35.032275 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 04 05:49:35.032374 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:35.032356 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-mpd4s\"" Nov 04 05:49:35.032411 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:35.032378 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fv6vj\"" Nov 04 05:49:35.032451 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:35.032413 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 04 05:49:35.032451 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:35.032436 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 04 05:49:35.032513 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:35.032456 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-gcv4b\"" Nov 04 05:49:35.117116 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:35.117054 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sj64z" Nov 04 05:49:35.283500 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:35.283470 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vtpdd"] Nov 04 05:49:35.287967 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:35.287940 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dxkjf"] Nov 04 05:49:35.288094 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:35.288015 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-flcbl"] Nov 04 05:49:35.291480 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:49:35.291459 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0742c411_7597_48ae_a35d_82a7d69fafdb.slice/crio-f14fa1521bab7cd19bbd391605e9a73ddcf336ec685a2203d87653121e1ca2b4 WatchSource:0}: Error finding container f14fa1521bab7cd19bbd391605e9a73ddcf336ec685a2203d87653121e1ca2b4: Status 404 returned error can't find the container with id f14fa1521bab7cd19bbd391605e9a73ddcf336ec685a2203d87653121e1ca2b4 Nov 04 05:49:35.292173 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:49:35.292150 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda956a93b_8cf1_45ad_bcbf_409e331a02d1.slice/crio-34a6ce100bb4dbad797d44b391da8ba21a9ee9f45fc3d51cf1a3675b34f178e8 WatchSource:0}: Error finding container 34a6ce100bb4dbad797d44b391da8ba21a9ee9f45fc3d51cf1a3675b34f178e8: Status 404 returned error can't find the container with id 34a6ce100bb4dbad797d44b391da8ba21a9ee9f45fc3d51cf1a3675b34f178e8 Nov 04 05:49:35.484543 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:35.484472 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sj64z"] Nov 04 05:49:35.487919 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:49:35.487895 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c71ae38_62e0_4de3_9cf9_c4ee58edd96a.slice/crio-1d38f8e2f93226f6cb3c4bedb1db12059b988f24e6f6413aa97d2028c7db5b2f WatchSource:0}: Error finding container 1d38f8e2f93226f6cb3c4bedb1db12059b988f24e6f6413aa97d2028c7db5b2f: Status 404 returned error can't find the container with id 1d38f8e2f93226f6cb3c4bedb1db12059b988f24e6f6413aa97d2028c7db5b2f Nov 04 05:49:36.230410 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:36.230368 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vtpdd" event={"ID":"63258d2f-36fe-483c-9d98-fefeffd43533","Type":"ContainerStarted","Data":"2ac8cbdb3dd8d88f9cb85e2e857897daf971faae2aa2fb6bce19a180506fd10b"} Nov 04 05:49:36.231731 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:36.231669 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sj64z" event={"ID":"8c71ae38-62e0-4de3-9cf9-c4ee58edd96a","Type":"ContainerStarted","Data":"1d38f8e2f93226f6cb3c4bedb1db12059b988f24e6f6413aa97d2028c7db5b2f"} Nov 04 05:49:36.232993 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:36.232970 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dxkjf" event={"ID":"a956a93b-8cf1-45ad-bcbf-409e331a02d1","Type":"ContainerStarted","Data":"34a6ce100bb4dbad797d44b391da8ba21a9ee9f45fc3d51cf1a3675b34f178e8"} Nov 04 05:49:36.234966 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:36.234941 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flcbl" event={"ID":"0742c411-7597-48ae-a35d-82a7d69fafdb","Type":"ContainerStarted","Data":"fbd22616866cfe7d77f3fab3d8f1cd02fb205dac9851606a2f88b7784ffff345"} Nov 04 05:49:36.235101 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:36.234993 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flcbl" event={"ID":"0742c411-7597-48ae-a35d-82a7d69fafdb","Type":"ContainerStarted","Data":"f14fa1521bab7cd19bbd391605e9a73ddcf336ec685a2203d87653121e1ca2b4"} Nov 04 05:49:37.240635 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:37.239959 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sj64z" event={"ID":"8c71ae38-62e0-4de3-9cf9-c4ee58edd96a","Type":"ContainerStarted","Data":"1777c60aa01225970a732ec64d018ec796ad4b13ea3bc424efb83bfa470a0c59"} Nov 04 05:49:37.241074 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:37.240848 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sj64z" Nov 04 05:49:37.242759 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:37.242721 2580 patch_prober.go:29] interesting pod/prometheus-operator-admission-webhook-6489d8bf89-sj64z container/prometheus-operator-admission-webhook namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.134.0.9:8443/healthz\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body= Nov 04 05:49:37.242875 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:37.242769 2580 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sj64z" podUID="8c71ae38-62e0-4de3-9cf9-c4ee58edd96a" containerName="prometheus-operator-admission-webhook" probeResult="failure" output="Get \"https://10.134.0.9:8443/healthz\": dial tcp 10.134.0.9:8443: connect: connection refused" Nov 04 05:49:37.244304 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:37.244213 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flcbl" event={"ID":"0742c411-7597-48ae-a35d-82a7d69fafdb","Type":"ContainerStarted","Data":"8e01614f886dd7411a29acf37f3dd42b2732a6f854a835e8ac6111c69b0ad763"} Nov 04 05:49:37.375636 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:37.375582 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sj64z" podStartSLOduration=1.716260744 podStartE2EDuration="3.375569432s" totalImagesPullingTime="1.659308688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:49:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:37.364482817 +0000 UTC m=+50.849272577" watchObservedRunningTime="2026-11-04 05:49:37.375569432 +0000 UTC m=+50.860359186" Nov 04 05:49:38.249745 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:38.249704 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dxkjf" event={"ID":"a956a93b-8cf1-45ad-bcbf-409e331a02d1","Type":"ContainerStarted","Data":"ea02b79834c9c53f756436e2ea299cde06e01fd3bbfe9eae98a4fbf34d8a844e"} Nov 04 05:49:38.250214 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:38.249812 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dxkjf" event={"ID":"a956a93b-8cf1-45ad-bcbf-409e331a02d1","Type":"ContainerStarted","Data":"c369f9c5fee8539ac88a55ea5a9b36614075edacde5df6c53ca0a677a2c1aec5"} Nov 04 05:49:38.254517 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:38.254493 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sj64z" Nov 04 05:49:38.376486 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:38.376432 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-dxkjf" podStartSLOduration=2.054073608 podStartE2EDuration="4.376418611s" totalImagesPullingTime="2.322345003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:49:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:38.376204891 +0000 UTC m=+51.860994679" watchObservedRunningTime="2026-11-04 05:49:38.376418611 +0000 UTC m=+51.861208365" Nov 04 05:49:39.254105 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.254053 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flcbl" event={"ID":"0742c411-7597-48ae-a35d-82a7d69fafdb","Type":"ContainerStarted","Data":"060e34440624b69123a402da0b69153c8cd43e340196c6f7345f1fe7c87952a0"} Nov 04 05:49:39.255601 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.255572 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vtpdd" event={"ID":"63258d2f-36fe-483c-9d98-fefeffd43533","Type":"ContainerStarted","Data":"e01c88330d803910d651407edb0539703470d31021e5deae06f5f50fb7a15700"} Nov 04 05:49:39.255849 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.255832 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dxkjf" Nov 04 05:49:39.435902 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.435850 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-flcbl" podStartSLOduration=2.406437232 podStartE2EDuration="5.435836629s" totalImagesPullingTime="3.029399397s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:49:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:39.381096536 +0000 UTC m=+52.865886293" watchObservedRunningTime="2026-11-04 05:49:39.435836629 +0000 UTC m=+52.920626388" Nov 04 05:49:39.479079 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.479037 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r"] Nov 04 05:49:39.480605 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.480590 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" Nov 04 05:49:39.506316 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.506249 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vtpdd" podStartSLOduration=2.241902602 podStartE2EDuration="5.506237623s" totalImagesPullingTime="3.264335021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:49:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:39.50553602 +0000 UTC m=+52.990325780" watchObservedRunningTime="2026-11-04 05:49:39.506237623 +0000 UTC m=+52.991027383" Nov 04 05:49:39.538030 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.537998 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Nov 04 05:49:39.538220 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.538205 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Nov 04 05:49:39.538288 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.538227 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 04 05:49:39.538288 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.538243 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Nov 04 05:49:39.538288 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.538227 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 04 05:49:39.538288 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.538227 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-9zvpc\"" Nov 04 05:49:39.552295 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.552268 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccf93b8e-80a1-4ae6-9d4e-643760607116-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-d4p9r\" (UID: \"ccf93b8e-80a1-4ae6-9d4e-643760607116\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" Nov 04 05:49:39.552425 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.552319 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmxjw\" (UniqueName: \"kubernetes.io/projected/ccf93b8e-80a1-4ae6-9d4e-643760607116-kube-api-access-lmxjw\") pod \"prometheus-operator-9cd89b74c-d4p9r\" (UID: \"ccf93b8e-80a1-4ae6-9d4e-643760607116\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" Nov 04 05:49:39.552425 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.552346 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccf93b8e-80a1-4ae6-9d4e-643760607116-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-d4p9r\" (UID: \"ccf93b8e-80a1-4ae6-9d4e-643760607116\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" Nov 04 05:49:39.552502 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.552470 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccf93b8e-80a1-4ae6-9d4e-643760607116-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-d4p9r\" (UID: \"ccf93b8e-80a1-4ae6-9d4e-643760607116\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" Nov 04 05:49:39.561291 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.561267 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r"] Nov 04 05:49:39.653495 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.653458 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccf93b8e-80a1-4ae6-9d4e-643760607116-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-d4p9r\" (UID: \"ccf93b8e-80a1-4ae6-9d4e-643760607116\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" Nov 04 05:49:39.653495 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.653496 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccf93b8e-80a1-4ae6-9d4e-643760607116-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-d4p9r\" (UID: \"ccf93b8e-80a1-4ae6-9d4e-643760607116\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" Nov 04 05:49:39.653703 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.653537 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccf93b8e-80a1-4ae6-9d4e-643760607116-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-d4p9r\" (UID: \"ccf93b8e-80a1-4ae6-9d4e-643760607116\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" Nov 04 05:49:39.653703 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.653575 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmxjw\" (UniqueName: \"kubernetes.io/projected/ccf93b8e-80a1-4ae6-9d4e-643760607116-kube-api-access-lmxjw\") pod \"prometheus-operator-9cd89b74c-d4p9r\" (UID: \"ccf93b8e-80a1-4ae6-9d4e-643760607116\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" Nov 04 05:49:39.654317 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.654290 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccf93b8e-80a1-4ae6-9d4e-643760607116-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-d4p9r\" (UID: \"ccf93b8e-80a1-4ae6-9d4e-643760607116\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" Nov 04 05:49:39.655990 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.655969 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccf93b8e-80a1-4ae6-9d4e-643760607116-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-d4p9r\" (UID: \"ccf93b8e-80a1-4ae6-9d4e-643760607116\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" Nov 04 05:49:39.656092 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.655971 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccf93b8e-80a1-4ae6-9d4e-643760607116-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-d4p9r\" (UID: \"ccf93b8e-80a1-4ae6-9d4e-643760607116\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" Nov 04 05:49:39.719367 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.719343 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmxjw\" (UniqueName: \"kubernetes.io/projected/ccf93b8e-80a1-4ae6-9d4e-643760607116-kube-api-access-lmxjw\") pod \"prometheus-operator-9cd89b74c-d4p9r\" (UID: \"ccf93b8e-80a1-4ae6-9d4e-643760607116\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" Nov 04 05:49:39.790375 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:39.790312 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" Nov 04 05:49:40.163388 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:40.163352 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r"] Nov 04 05:49:40.166382 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:49:40.166354 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf93b8e_80a1_4ae6_9d4e_643760607116.slice/crio-eb615e71882ee05bb30a724fb0cd0ab0a4d40b9401bb75cf7945d32ef2a3300d WatchSource:0}: Error finding container eb615e71882ee05bb30a724fb0cd0ab0a4d40b9401bb75cf7945d32ef2a3300d: Status 404 returned error can't find the container with id eb615e71882ee05bb30a724fb0cd0ab0a4d40b9401bb75cf7945d32ef2a3300d Nov 04 05:49:40.259250 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:40.259209 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" event={"ID":"ccf93b8e-80a1-4ae6-9d4e-643760607116","Type":"ContainerStarted","Data":"eb615e71882ee05bb30a724fb0cd0ab0a4d40b9401bb75cf7945d32ef2a3300d"} Nov 04 05:49:42.268994 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:42.268957 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" event={"ID":"ccf93b8e-80a1-4ae6-9d4e-643760607116","Type":"ContainerStarted","Data":"45d3e2f8a5eb5e853882f4b9a889aa99e241f9598e5f963d46d7a885d52e168f"} Nov 04 05:49:42.269403 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:42.269027 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" event={"ID":"ccf93b8e-80a1-4ae6-9d4e-643760607116","Type":"ContainerStarted","Data":"726411fe87c77a2dc441f373623b6c09c8feea197c0549f88d9b1c5007af91f6"} Nov 04 05:49:42.395938 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:42.395890 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" podStartSLOduration=1.860915433 podStartE2EDuration="3.395877707s" totalImagesPullingTime="1.534962274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:42.395028286 +0000 UTC m=+55.879818045" watchObservedRunningTime="2026-11-04 05:49:42.395877707 +0000 UTC m=+55.880667466" Nov 04 05:49:43.188705 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:43.188682 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:49:45.187383 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.187342 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg"] Nov 04 05:49:45.189489 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.189463 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" Nov 04 05:49:45.294540 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.294504 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/124a28d1-9d05-42d1-99d4-721942b23062-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-dmklg\" (UID: \"124a28d1-9d05-42d1-99d4-721942b23062\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" Nov 04 05:49:45.294725 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.294548 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/124a28d1-9d05-42d1-99d4-721942b23062-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-dmklg\" (UID: \"124a28d1-9d05-42d1-99d4-721942b23062\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" Nov 04 05:49:45.294725 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.294571 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtt5b\" (UniqueName: \"kubernetes.io/projected/124a28d1-9d05-42d1-99d4-721942b23062-kube-api-access-mtt5b\") pod \"openshift-state-metrics-7bd7489957-dmklg\" (UID: \"124a28d1-9d05-42d1-99d4-721942b23062\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" Nov 04 05:49:45.294839 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.294762 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/124a28d1-9d05-42d1-99d4-721942b23062-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-dmklg\" (UID: \"124a28d1-9d05-42d1-99d4-721942b23062\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" Nov 04 05:49:45.301507 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.301475 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Nov 04 05:49:45.301654 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.301509 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Nov 04 05:49:45.301654 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.301539 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-965kt\"" Nov 04 05:49:45.302641 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.302619 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg"] Nov 04 05:49:45.305801 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.305784 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx"] Nov 04 05:49:45.307605 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.307590 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:49:45.358107 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.358079 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lzjh2"] Nov 04 05:49:45.359854 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.359840 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.367353 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.367334 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Nov 04 05:49:45.367502 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.367487 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-cpsjc\"" Nov 04 05:49:45.367552 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.367533 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Nov 04 05:49:45.367646 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.367634 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Nov 04 05:49:45.395942 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.395921 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpvdq\" (UniqueName: \"kubernetes.io/projected/807edbb8-055e-4796-b4dd-b254a93313f6-kube-api-access-xpvdq\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:49:45.396008 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.395944 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b41e530-bd50-4905-8887-32286cfdedbf-root\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.396008 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.395966 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/124a28d1-9d05-42d1-99d4-721942b23062-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-dmklg\" (UID: \"124a28d1-9d05-42d1-99d4-721942b23062\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" Nov 04 05:49:45.396008 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.395985 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtt5b\" (UniqueName: \"kubernetes.io/projected/124a28d1-9d05-42d1-99d4-721942b23062-kube-api-access-mtt5b\") pod \"openshift-state-metrics-7bd7489957-dmklg\" (UID: \"124a28d1-9d05-42d1-99d4-721942b23062\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" Nov 04 05:49:45.396149 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.396126 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/807edbb8-055e-4796-b4dd-b254a93313f6-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:49:45.396199 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.396166 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/807edbb8-055e-4796-b4dd-b254a93313f6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:49:45.396250 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.396195 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b41e530-bd50-4905-8887-32286cfdedbf-metrics-client-ca\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.396316 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.396295 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-accelerators-collector-config\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.396371 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.396331 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfhg5\" (UniqueName: \"kubernetes.io/projected/3b41e530-bd50-4905-8887-32286cfdedbf-kube-api-access-nfhg5\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.396414 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.396398 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/807edbb8-055e-4796-b4dd-b254a93313f6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:49:45.396451 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.396419 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b41e530-bd50-4905-8887-32286cfdedbf-sys\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.396535 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.396521 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-textfile\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.396591 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.396548 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.396591 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.396578 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-tls\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.396665 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.396628 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-wtmp\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.396665 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.396658 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/124a28d1-9d05-42d1-99d4-721942b23062-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-dmklg\" (UID: \"124a28d1-9d05-42d1-99d4-721942b23062\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" Nov 04 05:49:45.396729 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.396682 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/807edbb8-055e-4796-b4dd-b254a93313f6-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:49:45.396729 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.396702 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/807edbb8-055e-4796-b4dd-b254a93313f6-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:49:45.396790 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.396732 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/124a28d1-9d05-42d1-99d4-721942b23062-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-dmklg\" (UID: \"124a28d1-9d05-42d1-99d4-721942b23062\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" Nov 04 05:49:45.397155 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.397139 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/124a28d1-9d05-42d1-99d4-721942b23062-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-dmklg\" (UID: \"124a28d1-9d05-42d1-99d4-721942b23062\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" Nov 04 05:49:45.398283 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.398263 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/124a28d1-9d05-42d1-99d4-721942b23062-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-dmklg\" (UID: \"124a28d1-9d05-42d1-99d4-721942b23062\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" Nov 04 05:49:45.398982 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.398961 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/124a28d1-9d05-42d1-99d4-721942b23062-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-dmklg\" (UID: \"124a28d1-9d05-42d1-99d4-721942b23062\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" Nov 04 05:49:45.413229 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.413201 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx"] Nov 04 05:49:45.461403 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.461341 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtt5b\" (UniqueName: \"kubernetes.io/projected/124a28d1-9d05-42d1-99d4-721942b23062-kube-api-access-mtt5b\") pod \"openshift-state-metrics-7bd7489957-dmklg\" (UID: \"124a28d1-9d05-42d1-99d4-721942b23062\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" Nov 04 05:49:45.467613 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.467593 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tjrmr\"" Nov 04 05:49:45.467729 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.467635 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Nov 04 05:49:45.467729 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.467646 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Nov 04 05:49:45.467729 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.467685 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Nov 04 05:49:45.496964 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.496942 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/807edbb8-055e-4796-b4dd-b254a93313f6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:49:45.497053 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.496967 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b41e530-bd50-4905-8887-32286cfdedbf-sys\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.497053 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.497002 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-textfile\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.497053 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.497019 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.497053 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.497037 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-tls\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.497253 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.497057 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-wtmp\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.497253 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.497105 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/807edbb8-055e-4796-b4dd-b254a93313f6-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:49:45.497253 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.497131 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/807edbb8-055e-4796-b4dd-b254a93313f6-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:49:45.497253 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.497144 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b41e530-bd50-4905-8887-32286cfdedbf-sys\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.497253 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.497211 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpvdq\" (UniqueName: \"kubernetes.io/projected/807edbb8-055e-4796-b4dd-b254a93313f6-kube-api-access-xpvdq\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:49:45.497253 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.497237 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b41e530-bd50-4905-8887-32286cfdedbf-root\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.497528 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.497251 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-wtmp\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.497528 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.497277 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/807edbb8-055e-4796-b4dd-b254a93313f6-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:49:45.497528 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.497304 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/807edbb8-055e-4796-b4dd-b254a93313f6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:49:45.497528 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.497326 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b41e530-bd50-4905-8887-32286cfdedbf-metrics-client-ca\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.497528 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.497356 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-accelerators-collector-config\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.497528 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.497379 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfhg5\" (UniqueName: \"kubernetes.io/projected/3b41e530-bd50-4905-8887-32286cfdedbf-kube-api-access-nfhg5\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.497528 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.497404 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-textfile\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.497528 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.497497 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/807edbb8-055e-4796-b4dd-b254a93313f6-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:49:45.497896 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.497545 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b41e530-bd50-4905-8887-32286cfdedbf-root\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.497956 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.497936 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/807edbb8-055e-4796-b4dd-b254a93313f6-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:49:45.498105 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.498078 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/807edbb8-055e-4796-b4dd-b254a93313f6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:49:45.498105 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.498097 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-accelerators-collector-config\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.498225 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.498103 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b41e530-bd50-4905-8887-32286cfdedbf-metrics-client-ca\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.499367 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.499347 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-tls\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.499667 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.499639 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/807edbb8-055e-4796-b4dd-b254a93313f6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:49:45.499870 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.499847 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/807edbb8-055e-4796-b4dd-b254a93313f6-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:49:45.499949 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.499935 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" Nov 04 05:49:45.500515 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.500492 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.563687 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.563664 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpvdq\" (UniqueName: \"kubernetes.io/projected/807edbb8-055e-4796-b4dd-b254a93313f6-kube-api-access-xpvdq\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:49:45.563857 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.563817 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfhg5\" (UniqueName: \"kubernetes.io/projected/3b41e530-bd50-4905-8887-32286cfdedbf-kube-api-access-nfhg5\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.639007 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.638978 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:49:45.670196 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.670160 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:49:45.678821 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:49:45.678796 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b41e530_bd50_4905_8887_32286cfdedbf.slice/crio-0367a099754e6a89c49e94e75bbb15f99f7c47afd13b44f320d68b06c22ad3cb WatchSource:0}: Error finding container 0367a099754e6a89c49e94e75bbb15f99f7c47afd13b44f320d68b06c22ad3cb: Status 404 returned error can't find the container with id 0367a099754e6a89c49e94e75bbb15f99f7c47afd13b44f320d68b06c22ad3cb Nov 04 05:49:45.931303 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:45.931274 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg"] Nov 04 05:49:45.933933 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:49:45.933911 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod124a28d1_9d05_42d1_99d4_721942b23062.slice/crio-59576fa1bb34c8f7627eacf1552499708c21a069a8c0945aae0223492bb17af7 WatchSource:0}: Error finding container 59576fa1bb34c8f7627eacf1552499708c21a069a8c0945aae0223492bb17af7: Status 404 returned error can't find the container with id 59576fa1bb34c8f7627eacf1552499708c21a069a8c0945aae0223492bb17af7 Nov 04 05:49:46.013776 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:46.013748 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx"] Nov 04 05:49:46.016734 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:49:46.016712 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod807edbb8_055e_4796_b4dd_b254a93313f6.slice/crio-947312d04ab16fffbf256934ca093dc2ff8dc342e406b87874751e2faa1a43de WatchSource:0}: Error finding container 947312d04ab16fffbf256934ca093dc2ff8dc342e406b87874751e2faa1a43de: Status 404 returned error can't find the container with id 947312d04ab16fffbf256934ca093dc2ff8dc342e406b87874751e2faa1a43de Nov 04 05:49:46.282190 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:46.282102 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lzjh2" event={"ID":"3b41e530-bd50-4905-8887-32286cfdedbf","Type":"ContainerStarted","Data":"0367a099754e6a89c49e94e75bbb15f99f7c47afd13b44f320d68b06c22ad3cb"} Nov 04 05:49:46.283295 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:46.283259 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" event={"ID":"807edbb8-055e-4796-b4dd-b254a93313f6","Type":"ContainerStarted","Data":"947312d04ab16fffbf256934ca093dc2ff8dc342e406b87874751e2faa1a43de"} Nov 04 05:49:46.285055 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:46.285031 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" event={"ID":"124a28d1-9d05-42d1-99d4-721942b23062","Type":"ContainerStarted","Data":"e3f5cb03f7767ba7254030157f56c8cfa10f22b8b9c91f1871a995ad8123c24f"} Nov 04 05:49:46.285171 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:46.285093 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" event={"ID":"124a28d1-9d05-42d1-99d4-721942b23062","Type":"ContainerStarted","Data":"221ae72b86d1bb30823d18836c79ecbad8a4ee8c035f047a4307623e5392553c"} Nov 04 05:49:46.285171 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:46.285116 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" event={"ID":"124a28d1-9d05-42d1-99d4-721942b23062","Type":"ContainerStarted","Data":"59576fa1bb34c8f7627eacf1552499708c21a069a8c0945aae0223492bb17af7"} Nov 04 05:49:47.289875 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.289832 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lzjh2" event={"ID":"3b41e530-bd50-4905-8887-32286cfdedbf","Type":"ContainerStarted","Data":"ecbfc39e77ff26e04a73ca036032d9b2e22932dd6694797bfe70f58ac7a6a13b"} Nov 04 05:49:47.636182 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.636145 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 04 05:49:47.640028 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.640003 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.719588 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.719506 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-config-volume\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.719588 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.719545 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/118d5d6d-e2b1-483f-a184-504325584502-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.719588 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.719568 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/118d5d6d-e2b1-483f-a184-504325584502-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.719819 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.719611 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fldv\" (UniqueName: \"kubernetes.io/projected/118d5d6d-e2b1-483f-a184-504325584502-kube-api-access-4fldv\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.719819 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.719657 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.719819 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.719685 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.719819 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.719705 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/118d5d6d-e2b1-483f-a184-504325584502-tls-assets\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.719819 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.719738 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.719819 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.719755 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.719819 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.719770 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-web-config\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.719819 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.719785 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/118d5d6d-e2b1-483f-a184-504325584502-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.720132 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.719833 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/118d5d6d-e2b1-483f-a184-504325584502-config-out\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.720132 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.719851 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.811256 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.811225 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Nov 04 05:49:47.811439 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.811321 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Nov 04 05:49:47.811439 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.811373 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Nov 04 05:49:47.811567 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.811439 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Nov 04 05:49:47.811567 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.811464 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Nov 04 05:49:47.811567 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.811505 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Nov 04 05:49:47.811567 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.811538 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cxbnx\"" Nov 04 05:49:47.811759 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.811582 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Nov 04 05:49:47.811759 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.811578 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Nov 04 05:49:47.811859 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.811771 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Nov 04 05:49:47.813864 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.813843 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 04 05:49:47.820506 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.820483 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/118d5d6d-e2b1-483f-a184-504325584502-config-out\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.820633 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.820518 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.820633 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.820547 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-config-volume\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.820735 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.820648 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/118d5d6d-e2b1-483f-a184-504325584502-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.820735 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.820675 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/118d5d6d-e2b1-483f-a184-504325584502-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.820735 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.820724 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fldv\" (UniqueName: \"kubernetes.io/projected/118d5d6d-e2b1-483f-a184-504325584502-kube-api-access-4fldv\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.820848 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.820771 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.820848 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.820808 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.820848 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.820841 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/118d5d6d-e2b1-483f-a184-504325584502-tls-assets\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.820956 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.820875 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.820956 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.820905 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.820956 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.820921 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-web-config\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.820956 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.820936 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/118d5d6d-e2b1-483f-a184-504325584502-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.821685 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.821665 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/118d5d6d-e2b1-483f-a184-504325584502-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.822559 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.822343 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/118d5d6d-e2b1-483f-a184-504325584502-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.822702 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.822670 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/118d5d6d-e2b1-483f-a184-504325584502-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.824172 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.824150 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-config-volume\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.824289 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.824207 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/118d5d6d-e2b1-483f-a184-504325584502-config-out\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.824654 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.824629 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.825471 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.825447 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.825869 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.825846 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-web-config\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.826086 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.826019 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.826174 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.826085 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.826242 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.826195 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/118d5d6d-e2b1-483f-a184-504325584502-tls-assets\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.827442 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.827420 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.887192 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.887158 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fldv\" (UniqueName: \"kubernetes.io/projected/118d5d6d-e2b1-483f-a184-504325584502-kube-api-access-4fldv\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:47.964401 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:47.964370 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:49:48.296205 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:48.296129 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" event={"ID":"807edbb8-055e-4796-b4dd-b254a93313f6","Type":"ContainerStarted","Data":"b733d577096005654c97832ed511933ab3d41ec093f7eb3b948309295884b411"} Nov 04 05:49:48.296205 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:48.296192 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" event={"ID":"807edbb8-055e-4796-b4dd-b254a93313f6","Type":"ContainerStarted","Data":"7c6b6692f3efe83f5bee57cd57ff4ef05863e7fb0d0ab18b06fef2dd3830da2f"} Nov 04 05:49:48.296671 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:48.296218 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" event={"ID":"807edbb8-055e-4796-b4dd-b254a93313f6","Type":"ContainerStarted","Data":"aa156a79f54accaf17bc9a6597456fa0b757e45d8a2f401766424a1072a63f85"} Nov 04 05:49:48.298258 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:48.298234 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" event={"ID":"124a28d1-9d05-42d1-99d4-721942b23062","Type":"ContainerStarted","Data":"8924becf33b55f504e17293cb1f9a5be07ac9babad5ee8f64ff3b3c40c067318"} Nov 04 05:49:48.299784 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:48.299756 2580 generic.go:356] "Generic (PLEG): container finished" podID="3b41e530-bd50-4905-8887-32286cfdedbf" containerID="ecbfc39e77ff26e04a73ca036032d9b2e22932dd6694797bfe70f58ac7a6a13b" exitCode=0 Nov 04 05:49:48.299871 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:48.299789 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lzjh2" event={"ID":"3b41e530-bd50-4905-8887-32286cfdedbf","Type":"ContainerDied","Data":"ecbfc39e77ff26e04a73ca036032d9b2e22932dd6694797bfe70f58ac7a6a13b"} Nov 04 05:49:48.401499 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:48.401468 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 04 05:49:48.407935 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:49:48.407911 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod118d5d6d_e2b1_483f_a184_504325584502.slice/crio-c6d5d696cce085b262640af2bcdf3f34ea286ed770e40988c5dbee5ae7c7d22d WatchSource:0}: Error finding container c6d5d696cce085b262640af2bcdf3f34ea286ed770e40988c5dbee5ae7c7d22d: Status 404 returned error can't find the container with id c6d5d696cce085b262640af2bcdf3f34ea286ed770e40988c5dbee5ae7c7d22d Nov 04 05:49:48.423799 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:48.423756 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" podStartSLOduration=1.428557083 podStartE2EDuration="3.423744375s" totalImagesPullingTime="1.995187292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:48.422883824 +0000 UTC m=+61.907673578" watchObservedRunningTime="2026-11-04 05:49:48.423744375 +0000 UTC m=+61.908534134" Nov 04 05:49:48.556505 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:48.556408 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" podStartSLOduration=2.118550615 podStartE2EDuration="3.556394378s" totalImagesPullingTime="1.437843763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:48.5557701 +0000 UTC m=+62.040559862" watchObservedRunningTime="2026-11-04 05:49:48.556394378 +0000 UTC m=+62.041184139" Nov 04 05:49:49.261969 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:49.261942 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dxkjf" Nov 04 05:49:49.304427 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:49.304393 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"118d5d6d-e2b1-483f-a184-504325584502","Type":"ContainerStarted","Data":"c6d5d696cce085b262640af2bcdf3f34ea286ed770e40988c5dbee5ae7c7d22d"} Nov 04 05:49:49.306599 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:49.306572 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lzjh2" event={"ID":"3b41e530-bd50-4905-8887-32286cfdedbf","Type":"ContainerStarted","Data":"02b6771ec4e6467b43d15fe170724e17fb00ad4e5d802d89f26bf89594bf3248"} Nov 04 05:49:49.306703 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:49.306615 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lzjh2" event={"ID":"3b41e530-bd50-4905-8887-32286cfdedbf","Type":"ContainerStarted","Data":"ac60d95c67490a0f638fdadf651d0bc83a11eb8975e960a7d51282986272d7f0"} Nov 04 05:49:49.517870 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:49.517776 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lzjh2" podStartSLOduration=2.953797631 podStartE2EDuration="4.517761887s" totalImagesPullingTime="1.490434792s" totalInitContainerRuntime="73.529464ms" isStatefulPod=true podCreationTimestamp="2026-11-04 05:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:49.516343347 +0000 UTC m=+63.001133132" watchObservedRunningTime="2026-11-04 05:49:49.517761887 +0000 UTC m=+63.002551647" Nov 04 05:49:49.937050 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:49.937021 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-hpqtm"] Nov 04 05:49:49.941311 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:49.941290 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-hpqtm" Nov 04 05:49:50.000082 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:49.999984 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-n6rcb\"" Nov 04 05:49:50.000082 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.000026 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Nov 04 05:49:50.001509 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.001486 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-hpqtm"] Nov 04 05:49:50.040858 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.040829 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkggn\" (UniqueName: \"kubernetes.io/projected/a9525137-701e-46b7-8582-322cd59aaf48-kube-api-access-nkggn\") pod \"monitoring-plugin-77f4f76594-hpqtm\" (UID: \"a9525137-701e-46b7-8582-322cd59aaf48\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-hpqtm" Nov 04 05:49:50.040958 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.040862 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9525137-701e-46b7-8582-322cd59aaf48-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-hpqtm\" (UID: \"a9525137-701e-46b7-8582-322cd59aaf48\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-hpqtm" Nov 04 05:49:50.095606 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.095576 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-f6b6d94bc-bxlj7"] Nov 04 05:49:50.098505 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.098490 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:49:50.141799 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.141770 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e8cce0a3-8ffd-465e-8b77-d386fba907b5-secret-metrics-server-client-certs\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:49:50.141938 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.141805 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e8cce0a3-8ffd-465e-8b77-d386fba907b5-secret-metrics-server-tls\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:49:50.141938 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.141905 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8cce0a3-8ffd-465e-8b77-d386fba907b5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:49:50.142005 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.141955 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e8cce0a3-8ffd-465e-8b77-d386fba907b5-metrics-server-audit-profiles\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:49:50.142041 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.142013 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkggn\" (UniqueName: \"kubernetes.io/projected/a9525137-701e-46b7-8582-322cd59aaf48-kube-api-access-nkggn\") pod \"monitoring-plugin-77f4f76594-hpqtm\" (UID: \"a9525137-701e-46b7-8582-322cd59aaf48\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-hpqtm" Nov 04 05:49:50.142099 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.142039 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rh8m\" (UniqueName: \"kubernetes.io/projected/e8cce0a3-8ffd-465e-8b77-d386fba907b5-kube-api-access-4rh8m\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:49:50.142099 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.142093 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9525137-701e-46b7-8582-322cd59aaf48-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-hpqtm\" (UID: \"a9525137-701e-46b7-8582-322cd59aaf48\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-hpqtm" Nov 04 05:49:50.142161 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.142121 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e8cce0a3-8ffd-465e-8b77-d386fba907b5-audit-log\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:49:50.142189 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.142156 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8cce0a3-8ffd-465e-8b77-d386fba907b5-client-ca-bundle\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:49:50.144399 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.144376 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9525137-701e-46b7-8582-322cd59aaf48-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-hpqtm\" (UID: \"a9525137-701e-46b7-8582-322cd59aaf48\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-hpqtm" Nov 04 05:49:50.155754 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.155700 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Nov 04 05:49:50.155850 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.155788 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Nov 04 05:49:50.155850 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.155816 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Nov 04 05:49:50.155947 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.155822 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Nov 04 05:49:50.155947 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.155898 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-n6dm2\"" Nov 04 05:49:50.155947 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.155942 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-56hpuqiqiu35s\"" Nov 04 05:49:50.160797 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.160775 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f6b6d94bc-bxlj7"] Nov 04 05:49:50.207667 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.207637 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkggn\" (UniqueName: \"kubernetes.io/projected/a9525137-701e-46b7-8582-322cd59aaf48-kube-api-access-nkggn\") pod \"monitoring-plugin-77f4f76594-hpqtm\" (UID: \"a9525137-701e-46b7-8582-322cd59aaf48\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-hpqtm" Nov 04 05:49:50.242601 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.242567 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e8cce0a3-8ffd-465e-8b77-d386fba907b5-metrics-server-audit-profiles\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:49:50.242723 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.242617 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rh8m\" (UniqueName: \"kubernetes.io/projected/e8cce0a3-8ffd-465e-8b77-d386fba907b5-kube-api-access-4rh8m\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:49:50.242723 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.242637 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e8cce0a3-8ffd-465e-8b77-d386fba907b5-audit-log\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:49:50.242723 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.242672 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8cce0a3-8ffd-465e-8b77-d386fba907b5-client-ca-bundle\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:49:50.242908 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.242719 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e8cce0a3-8ffd-465e-8b77-d386fba907b5-secret-metrics-server-client-certs\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:49:50.242908 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.242751 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e8cce0a3-8ffd-465e-8b77-d386fba907b5-secret-metrics-server-tls\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:49:50.243007 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.242927 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8cce0a3-8ffd-465e-8b77-d386fba907b5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:49:50.243147 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.243131 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e8cce0a3-8ffd-465e-8b77-d386fba907b5-audit-log\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:49:50.243563 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.243539 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8cce0a3-8ffd-465e-8b77-d386fba907b5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:49:50.243759 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.243734 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e8cce0a3-8ffd-465e-8b77-d386fba907b5-metrics-server-audit-profiles\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:49:50.245160 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.245130 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e8cce0a3-8ffd-465e-8b77-d386fba907b5-secret-metrics-server-client-certs\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:49:50.245270 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.245173 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e8cce0a3-8ffd-465e-8b77-d386fba907b5-secret-metrics-server-tls\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:49:50.245270 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.245250 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8cce0a3-8ffd-465e-8b77-d386fba907b5-client-ca-bundle\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:49:50.273029 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.272990 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-hpqtm" Nov 04 05:49:50.308575 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.308547 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rh8m\" (UniqueName: \"kubernetes.io/projected/e8cce0a3-8ffd-465e-8b77-d386fba907b5-kube-api-access-4rh8m\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:49:50.312554 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.312522 2580 generic.go:356] "Generic (PLEG): container finished" podID="118d5d6d-e2b1-483f-a184-504325584502" containerID="6b2276a8819cb9615329740c4650032907a9938d58e7f017f007cf028b173db9" exitCode=0 Nov 04 05:49:50.312722 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.312604 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"118d5d6d-e2b1-483f-a184-504325584502","Type":"ContainerDied","Data":"6b2276a8819cb9615329740c4650032907a9938d58e7f017f007cf028b173db9"} Nov 04 05:49:50.409688 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.409608 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:49:50.648593 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.648562 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-hpqtm"] Nov 04 05:49:50.651473 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:49:50.651453 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9525137_701e_46b7_8582_322cd59aaf48.slice/crio-9627133d301f4d5b0c74c2e5f7d998369a9346ccf683c23b8f3c93d66935332b WatchSource:0}: Error finding container 9627133d301f4d5b0c74c2e5f7d998369a9346ccf683c23b8f3c93d66935332b: Status 404 returned error can't find the container with id 9627133d301f4d5b0c74c2e5f7d998369a9346ccf683c23b8f3c93d66935332b Nov 04 05:49:50.787386 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:50.787317 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f6b6d94bc-bxlj7"] Nov 04 05:49:50.790140 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:49:50.790114 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8cce0a3_8ffd_465e_8b77_d386fba907b5.slice/crio-151a666b9f40880998e6d75692b5811a00562228672a6c082d0f1dc5ed47a05b WatchSource:0}: Error finding container 151a666b9f40880998e6d75692b5811a00562228672a6c082d0f1dc5ed47a05b: Status 404 returned error can't find the container with id 151a666b9f40880998e6d75692b5811a00562228672a6c082d0f1dc5ed47a05b Nov 04 05:49:51.317448 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:51.317410 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" event={"ID":"e8cce0a3-8ffd-465e-8b77-d386fba907b5","Type":"ContainerStarted","Data":"151a666b9f40880998e6d75692b5811a00562228672a6c082d0f1dc5ed47a05b"} Nov 04 05:49:51.318894 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:51.318866 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-hpqtm" event={"ID":"a9525137-701e-46b7-8582-322cd59aaf48","Type":"ContainerStarted","Data":"9627133d301f4d5b0c74c2e5f7d998369a9346ccf683c23b8f3c93d66935332b"} Nov 04 05:49:52.767501 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:52.767465 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs\") pod \"network-metrics-daemon-ssngm\" (UID: \"83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f\") " pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:52.767971 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:52.767626 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:52.868046 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:52.868021 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48twm\" (UniqueName: \"kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm\") pod \"network-check-target-zc9wk\" (UID: \"6bde7db4-687a-4dcb-b490-2f88e2e4ea71\") " pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:52.878376 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:52.878356 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 04 05:49:52.878376 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:52.878356 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 04 05:49:52.889841 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:52.889813 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs\") pod \"network-metrics-daemon-ssngm\" (UID: \"83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f\") " pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:52.889941 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:52.889923 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:52.924489 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:52.924456 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 04 05:49:52.984688 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:52.984664 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 04 05:49:52.991475 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:52.991453 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48twm\" (UniqueName: \"kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm\") pod \"network-check-target-zc9wk\" (UID: \"6bde7db4-687a-4dcb-b490-2f88e2e4ea71\") " pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:53.043602 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.043579 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fv6vj\"" Nov 04 05:49:53.047313 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.047294 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:49:53.048180 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.048166 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-gcv4b\"" Nov 04 05:49:53.052364 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.052348 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:49:53.053323 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.053310 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-mpd4s\"" Nov 04 05:49:53.058321 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.058302 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:49:53.332413 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.332379 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"118d5d6d-e2b1-483f-a184-504325584502","Type":"ContainerStarted","Data":"733888de895e7bc07d7eac07d68bbc821f0d7a1070da009efd6e9103e39f4761"} Nov 04 05:49:53.332587 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.332455 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"118d5d6d-e2b1-483f-a184-504325584502","Type":"ContainerStarted","Data":"8e0a6319d95fbb34adce7b3d2d4bbcd1b5b6d154f5f19db2a7e38206e0c56f53"} Nov 04 05:49:53.332587 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.332486 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"118d5d6d-e2b1-483f-a184-504325584502","Type":"ContainerStarted","Data":"5b7e16676510edaa758231bf5676dcaee38d5722b3060b27776c4430aea9723f"} Nov 04 05:49:53.332587 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.332509 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"118d5d6d-e2b1-483f-a184-504325584502","Type":"ContainerStarted","Data":"40869f32d4c952722524c5d727fdb5703d4c5aa030982407070a96159efac35a"} Nov 04 05:49:53.332587 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.332539 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"118d5d6d-e2b1-483f-a184-504325584502","Type":"ContainerStarted","Data":"dd87b816343b5b53c132b5874a69d21f73d144d6db265d92f1ee383c06070888"} Nov 04 05:49:53.335101 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.334044 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-hpqtm" event={"ID":"a9525137-701e-46b7-8582-322cd59aaf48","Type":"ContainerStarted","Data":"336f7bb4dc9d14bc1ca73b57b92555196ebfe0e34da9c20f3c9c6d6729832e37"} Nov 04 05:49:53.335101 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.334221 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-hpqtm" Nov 04 05:49:53.335777 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.335753 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" event={"ID":"e8cce0a3-8ffd-465e-8b77-d386fba907b5","Type":"ContainerStarted","Data":"183fa7620af119664c376a5ff47938fab489fc089d82ca87c7285669d0c25d22"} Nov 04 05:49:53.339441 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.339422 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-hpqtm" Nov 04 05:49:53.425490 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.425417 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ssngm"] Nov 04 05:49:53.472789 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:49:53.472745 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83e1cac7_f70a_4ddc_91d7_a6e9e8fd065f.slice/crio-bcd87f2907c350ed1f0aadfa0da8f8c196fbe9f4bb2919547ca83becc31c6985 WatchSource:0}: Error finding container bcd87f2907c350ed1f0aadfa0da8f8c196fbe9f4bb2919547ca83becc31c6985: Status 404 returned error can't find the container with id bcd87f2907c350ed1f0aadfa0da8f8c196fbe9f4bb2919547ca83becc31c6985 Nov 04 05:49:53.479367 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.479320 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-hpqtm" podStartSLOduration=2.670430507 podStartE2EDuration="4.479304485s" totalImagesPullingTime="1.808873978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:53.464354447 +0000 UTC m=+66.949144209" watchObservedRunningTime="2026-11-04 05:49:53.479304485 +0000 UTC m=+66.964094239" Nov 04 05:49:53.479748 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.479725 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zc9wk"] Nov 04 05:49:53.482185 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.481092 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9vrcj"] Nov 04 05:49:53.487133 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:49:53.487111 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod635418a3_d2fd_4dcc_8893_8488f45988c0.slice/crio-5af322646aa3d249aee8d87d5b897d8f01e333498eeb2b18efc4dd385bc2855f WatchSource:0}: Error finding container 5af322646aa3d249aee8d87d5b897d8f01e333498eeb2b18efc4dd385bc2855f: Status 404 returned error can't find the container with id 5af322646aa3d249aee8d87d5b897d8f01e333498eeb2b18efc4dd385bc2855f Nov 04 05:49:53.597964 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.597914 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" podStartSLOduration=1.5601503970000001 podStartE2EDuration="3.597900303s" totalImagesPullingTime="2.037749906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:53.597358807 +0000 UTC m=+67.082148566" watchObservedRunningTime="2026-11-04 05:49:53.597900303 +0000 UTC m=+67.082690062" Nov 04 05:49:53.818047 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.817974 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-d8dqj"] Nov 04 05:49:53.821371 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.821349 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-d8dqj" Nov 04 05:49:53.875707 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.875674 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a965dd43-4908-4a6a-9b2a-f3dc0590020e-tmp\") pod \"downloads-6dd789c8b7-d8dqj\" (UID: \"a965dd43-4908-4a6a-9b2a-f3dc0590020e\") " pod="openshift-console/downloads-6dd789c8b7-d8dqj" Nov 04 05:49:53.875707 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.875711 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg7t8\" (UniqueName: \"kubernetes.io/projected/a965dd43-4908-4a6a-9b2a-f3dc0590020e-kube-api-access-dg7t8\") pod \"downloads-6dd789c8b7-d8dqj\" (UID: \"a965dd43-4908-4a6a-9b2a-f3dc0590020e\") " pod="openshift-console/downloads-6dd789c8b7-d8dqj" Nov 04 05:49:53.881727 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.881684 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Nov 04 05:49:53.881854 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.881765 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-w257w\"" Nov 04 05:49:53.881907 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.881859 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Nov 04 05:49:53.883101 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.883078 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-d8dqj"] Nov 04 05:49:53.976866 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.976841 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a965dd43-4908-4a6a-9b2a-f3dc0590020e-tmp\") pod \"downloads-6dd789c8b7-d8dqj\" (UID: \"a965dd43-4908-4a6a-9b2a-f3dc0590020e\") " pod="openshift-console/downloads-6dd789c8b7-d8dqj" Nov 04 05:49:53.976984 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.976878 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg7t8\" (UniqueName: \"kubernetes.io/projected/a965dd43-4908-4a6a-9b2a-f3dc0590020e-kube-api-access-dg7t8\") pod \"downloads-6dd789c8b7-d8dqj\" (UID: \"a965dd43-4908-4a6a-9b2a-f3dc0590020e\") " pod="openshift-console/downloads-6dd789c8b7-d8dqj" Nov 04 05:49:53.977187 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:53.977168 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a965dd43-4908-4a6a-9b2a-f3dc0590020e-tmp\") pod \"downloads-6dd789c8b7-d8dqj\" (UID: \"a965dd43-4908-4a6a-9b2a-f3dc0590020e\") " pod="openshift-console/downloads-6dd789c8b7-d8dqj" Nov 04 05:49:54.042944 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.042910 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg7t8\" (UniqueName: \"kubernetes.io/projected/a965dd43-4908-4a6a-9b2a-f3dc0590020e-kube-api-access-dg7t8\") pod \"downloads-6dd789c8b7-d8dqj\" (UID: \"a965dd43-4908-4a6a-9b2a-f3dc0590020e\") " pod="openshift-console/downloads-6dd789c8b7-d8dqj" Nov 04 05:49:54.135141 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.135109 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-d8dqj" Nov 04 05:49:54.341612 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.341573 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9vrcj" event={"ID":"635418a3-d2fd-4dcc-8893-8488f45988c0","Type":"ContainerStarted","Data":"5af322646aa3d249aee8d87d5b897d8f01e333498eeb2b18efc4dd385bc2855f"} Nov 04 05:49:54.342905 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.342876 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zc9wk" event={"ID":"6bde7db4-687a-4dcb-b490-2f88e2e4ea71","Type":"ContainerStarted","Data":"9040211da883859f068fa3b6ca8e2100a5f4fe83476d3e06bd1ca9c79a85e51e"} Nov 04 05:49:54.348702 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.348672 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"118d5d6d-e2b1-483f-a184-504325584502","Type":"ContainerStarted","Data":"5ee88ab8ae9756eb80c09ae413c689af693455bbd339d9dd0f3b23c51301162b"} Nov 04 05:49:54.349861 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.349832 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ssngm" event={"ID":"83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f","Type":"ContainerStarted","Data":"bcd87f2907c350ed1f0aadfa0da8f8c196fbe9f4bb2919547ca83becc31c6985"} Nov 04 05:49:54.489002 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.488906 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.749448947 podStartE2EDuration="7.488891566s" totalImagesPullingTime="4.727309943s" totalInitContainerRuntime="12.132676ms" isStatefulPod=false podCreationTimestamp="2026-11-04 05:49:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:54.487938231 +0000 UTC m=+67.972727992" watchObservedRunningTime="2026-11-04 05:49:54.488891566 +0000 UTC m=+67.973681325" Nov 04 05:49:54.548102 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.543580 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-d8dqj"] Nov 04 05:49:54.548102 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:49:54.546798 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda965dd43_4908_4a6a_9b2a_f3dc0590020e.slice/crio-8bed2f9549b8e49a6cca67ac84190819a2eac0574bcc7dfc649dcda99e8cad92 WatchSource:0}: Error finding container 8bed2f9549b8e49a6cca67ac84190819a2eac0574bcc7dfc649dcda99e8cad92: Status 404 returned error can't find the container with id 8bed2f9549b8e49a6cca67ac84190819a2eac0574bcc7dfc649dcda99e8cad92 Nov 04 05:49:54.638994 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.638952 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 04 05:49:54.643852 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.643828 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.683213 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.683185 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.683341 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.683231 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.683341 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.683251 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.683341 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.683279 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.683341 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.683314 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.683341 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.683331 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nst9j\" (UniqueName: \"kubernetes.io/projected/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-kube-api-access-nst9j\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.683490 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.683348 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.683490 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.683363 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.683490 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.683378 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.683490 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.683394 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.683490 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.683412 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.683490 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.683430 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.683490 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.683454 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.683490 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.683480 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-web-config\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.683704 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.683501 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.683704 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.683517 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-config-out\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.683704 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.683545 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-config\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.683704 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.683567 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.683704 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.683581 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.683704 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.683597 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.702249 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.702221 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Nov 04 05:49:54.702372 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.702221 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Nov 04 05:49:54.702372 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.702228 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Nov 04 05:49:54.703111 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.703047 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Nov 04 05:49:54.703263 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.703128 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Nov 04 05:49:54.703263 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.703173 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h5w5l\"" Nov 04 05:49:54.703263 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.703219 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Nov 04 05:49:54.703263 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.703228 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Nov 04 05:49:54.703263 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.703265 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Nov 04 05:49:54.703748 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.703274 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Nov 04 05:49:54.703748 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.703382 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Nov 04 05:49:54.709411 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.709383 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cq7vabkalqm0d\"" Nov 04 05:49:54.709632 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.709616 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Nov 04 05:49:54.710122 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.709779 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Nov 04 05:49:54.758264 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.758184 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Nov 04 05:49:54.760379 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.760352 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Nov 04 05:49:54.784460 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.784427 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-config\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.784600 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.784478 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.784600 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.784504 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.784600 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.784523 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.784600 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.784561 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.784600 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.784597 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.784837 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.784625 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.784837 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.784652 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.784837 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.784738 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.784837 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.784763 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nst9j\" (UniqueName: \"kubernetes.io/projected/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-kube-api-access-nst9j\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.784837 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.784786 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.785080 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.784894 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.785080 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.784921 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.785080 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.784973 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.785080 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.785002 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.785080 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.785023 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.785314 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.785051 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.785314 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.785141 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-web-config\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.785314 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.785167 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.785314 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.785195 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-config-out\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.786017 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.785988 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.788794 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.787293 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.788794 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.787293 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.788794 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.787710 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.788794 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.787896 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.788794 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.788536 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.791582 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.789363 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.791582 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.789840 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.791582 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.790204 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.792318 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.792294 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.793727 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.793703 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.794416 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.794395 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-config-out\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.794890 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.794871 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.795538 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.795511 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.795622 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.795562 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.795697 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.795646 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.795916 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.795894 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-config\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.796191 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.796038 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.796748 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.796726 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-web-config\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.813884 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.813751 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 04 05:49:54.861819 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.861794 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nst9j\" (UniqueName: \"kubernetes.io/projected/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-kube-api-access-nst9j\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:54.982303 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:54.982274 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:49:55.357346 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:55.357270 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-d8dqj" event={"ID":"a965dd43-4908-4a6a-9b2a-f3dc0590020e","Type":"ContainerStarted","Data":"8bed2f9549b8e49a6cca67ac84190819a2eac0574bcc7dfc649dcda99e8cad92"} Nov 04 05:49:55.494974 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:55.494951 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 04 05:49:55.500088 ip-10-0-134-45 kubenswrapper[2580]: W1104 05:49:55.500024 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd3b4e2_6b29_4162_924a_4a36bf4bf647.slice/crio-4027b35de7271b28780d267b8e7996d75c315673757540daf62148a80743a6da WatchSource:0}: Error finding container 4027b35de7271b28780d267b8e7996d75c315673757540daf62148a80743a6da: Status 404 returned error can't find the container with id 4027b35de7271b28780d267b8e7996d75c315673757540daf62148a80743a6da Nov 04 05:49:56.369136 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:56.369095 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ssngm" event={"ID":"83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f","Type":"ContainerStarted","Data":"0d2ce3c9d82f2a2727b795e93c4f5e8cdc80402b93448106aa1d03feaa9af453"} Nov 04 05:49:56.369597 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:56.369169 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ssngm" event={"ID":"83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f","Type":"ContainerStarted","Data":"125b70c419e7c0953f68f773a3f65454b438af4343d84569aa4171738933e58f"} Nov 04 05:49:56.372470 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:56.372440 2580 generic.go:356] "Generic (PLEG): container finished" podID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerID="2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b" exitCode=0 Nov 04 05:49:56.372580 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:56.372493 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fd3b4e2-6b29-4162-924a-4a36bf4bf647","Type":"ContainerDied","Data":"2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b"} Nov 04 05:49:56.372580 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:56.372556 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fd3b4e2-6b29-4162-924a-4a36bf4bf647","Type":"ContainerStarted","Data":"4027b35de7271b28780d267b8e7996d75c315673757540daf62148a80743a6da"} Nov 04 05:49:56.496950 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:56.496890 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ssngm" podStartSLOduration=67.683153517 podStartE2EDuration="1m9.496871903s" totalImagesPullingTime="1.813718386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:49:56.495987036 +0000 UTC m=+69.980776823" watchObservedRunningTime="2026-11-04 05:49:56.496871903 +0000 UTC m=+69.981661642" Nov 04 05:49:58.385136 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:58.384338 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zc9wk" event={"ID":"6bde7db4-687a-4dcb-b490-2f88e2e4ea71","Type":"ContainerStarted","Data":"740a5584dec06d4d5e30e90f473032b050973c41d2e6e63dacad32b9211c913c"} Nov 04 05:49:58.385136 ip-10-0-134-45 kubenswrapper[2580]: I1104 05:49:58.385089 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:50:00.798247 ip-10-0-134-45 systemd[1]: Stopping Kubernetes Kubelet... Nov 04 05:50:00.811552 ip-10-0-134-45 systemd[1]: kubelet.service: Deactivated successfully. Nov 04 05:50:00.811760 ip-10-0-134-45 systemd[1]: Stopped Kubernetes Kubelet. Nov 04 05:50:00.811820 ip-10-0-134-45 systemd[1]: kubelet.service: Consumed 4.220s CPU time. Nov 04 05:50:00.820831 ip-10-0-134-45 systemd[1]: Starting Kubernetes Kubelet... Nov 04 05:50:00.899385 ip-10-0-134-45 kubenswrapper[5784]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 05:50:00.899385 ip-10-0-134-45 kubenswrapper[5784]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 04 05:50:00.899385 ip-10-0-134-45 kubenswrapper[5784]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 05:50:00.899385 ip-10-0-134-45 kubenswrapper[5784]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 05:50:00.903005 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.902913 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:50:00.903005 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903000 5784 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:50:00.903005 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903004 5784 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:50:00.903005 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903008 5784 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:50:00.903005 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903011 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:50:00.903005 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903015 5784 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:50:00.903376 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903018 5784 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:50:00.903376 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903021 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:50:00.903376 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903024 5784 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:50:00.903376 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903027 5784 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:50:00.903376 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903030 5784 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:50:00.903376 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903033 5784 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:50:00.903376 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903035 5784 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:50:00.903376 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903038 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:50:00.903376 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903041 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:50:00.903376 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903044 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:50:00.903376 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903047 5784 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:50:00.903376 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903049 5784 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:50:00.903376 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903052 5784 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:50:00.903376 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903055 5784 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:50:00.903376 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903058 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:50:00.903376 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903084 5784 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:50:00.903376 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903088 5784 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:50:00.903376 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903090 5784 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:50:00.903376 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903093 5784 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:50:00.904192 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903095 5784 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:50:00.904192 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903098 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:50:00.904192 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903101 5784 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:50:00.904192 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903103 5784 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:50:00.904192 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903106 5784 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:50:00.904192 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903109 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:50:00.904192 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903111 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:50:00.904192 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903114 5784 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:50:00.904192 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903116 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:50:00.904192 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903119 5784 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:50:00.904192 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903121 5784 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:50:00.904192 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903127 5784 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:50:00.904192 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903129 5784 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:50:00.904192 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903132 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:50:00.904192 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903135 5784 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:50:00.904192 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903139 5784 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:50:00.904192 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903143 5784 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:50:00.904192 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903147 5784 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:50:00.904192 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903152 5784 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:50:00.904192 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903155 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:50:00.905031 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903158 5784 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:50:00.905031 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903161 5784 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:50:00.905031 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903165 5784 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:50:00.905031 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903169 5784 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:50:00.905031 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903173 5784 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:50:00.905031 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903177 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:50:00.905031 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903180 5784 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:50:00.905031 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903183 5784 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:50:00.905031 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903188 5784 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:50:00.905031 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903194 5784 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:50:00.905031 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903197 5784 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:50:00.905031 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903200 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:50:00.905031 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903202 5784 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:50:00.905031 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903205 5784 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:50:00.905031 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903207 5784 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:50:00.905031 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903211 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:50:00.905031 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903216 5784 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:50:00.905031 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903220 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:50:00.905031 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903225 5784 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:50:00.905768 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903228 5784 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:50:00.905768 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903230 5784 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:50:00.905768 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903233 5784 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:50:00.905768 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903236 5784 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:50:00.905768 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903240 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:50:00.905768 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903242 5784 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:50:00.905768 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903245 5784 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:50:00.905768 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903248 5784 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:50:00.905768 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903252 5784 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:50:00.905768 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903256 5784 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:50:00.905768 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903258 5784 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:50:00.905768 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903261 5784 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:50:00.905768 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903264 5784 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:50:00.905768 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903266 5784 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:50:00.905768 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903269 5784 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:50:00.905768 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903271 5784 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:50:00.905768 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903274 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:50:00.905768 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903277 5784 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:50:00.905768 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903279 5784 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:50:00.906331 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903284 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:50:00.906331 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903286 5784 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:50:00.906331 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903289 5784 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:50:00.906331 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903291 5784 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:50:00.906331 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903294 5784 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:50:00.906331 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903297 5784 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:50:00.906331 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903299 5784 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:50:00.906331 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903302 5784 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:50:00.906331 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903305 5784 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:50:00.906331 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903307 5784 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:50:00.906331 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903310 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:50:00.906331 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903313 5784 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:50:00.906331 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903315 5784 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:50:00.906331 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903318 5784 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:50:00.906331 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903321 5784 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:50:00.906331 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903324 5784 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:50:00.906331 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903326 5784 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:50:00.906331 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903331 5784 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:50:00.906331 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903334 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:50:00.906331 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903336 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:50:00.906869 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903339 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:50:00.906869 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903341 5784 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:50:00.906869 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.903344 5784 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:50:00.906869 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904247 5784 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:50:00.906869 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904257 5784 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:50:00.906869 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904260 5784 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:50:00.906869 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904263 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:50:00.906869 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904265 5784 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:50:00.906869 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904270 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:50:00.906869 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904275 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:50:00.906869 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904280 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:50:00.906869 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904285 5784 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:50:00.906869 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904289 5784 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:50:00.906869 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904294 5784 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:50:00.906869 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904299 5784 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:50:00.906869 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904303 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:50:00.906869 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904308 5784 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:50:00.906869 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904312 5784 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:50:00.906869 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904317 5784 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:50:00.907426 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904322 5784 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:50:00.907426 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904326 5784 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:50:00.907426 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904331 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:50:00.907426 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904335 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:50:00.907426 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904340 5784 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:50:00.907426 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904344 5784 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:50:00.907426 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904349 5784 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:50:00.907426 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904353 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:50:00.907426 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904357 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:50:00.907426 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904363 5784 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:50:00.907426 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904369 5784 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:50:00.907426 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904374 5784 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:50:00.907426 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904378 5784 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:50:00.907426 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904382 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:50:00.907426 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904386 5784 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:50:00.907426 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904390 5784 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:50:00.907426 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904394 5784 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:50:00.907426 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904397 5784 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:50:00.907426 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904401 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:50:00.907426 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904405 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:50:00.908032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904409 5784 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:50:00.908032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904414 5784 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:50:00.908032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904417 5784 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:50:00.908032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904422 5784 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:50:00.908032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904427 5784 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:50:00.908032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904432 5784 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:50:00.908032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904436 5784 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:50:00.908032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904442 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:50:00.908032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904445 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:50:00.908032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904447 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:50:00.908032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904450 5784 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:50:00.908032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904453 5784 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:50:00.908032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904456 5784 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:50:00.908032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904458 5784 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:50:00.908032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904461 5784 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:50:00.908032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904463 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:50:00.908032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904466 5784 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:50:00.908032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904468 5784 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:50:00.908032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904471 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:50:00.908625 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904474 5784 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:50:00.908625 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904477 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:50:00.908625 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904479 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:50:00.908625 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904482 5784 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:50:00.908625 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904485 5784 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:50:00.908625 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904487 5784 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:50:00.908625 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904490 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:50:00.908625 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904492 5784 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:50:00.908625 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904495 5784 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:50:00.908625 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904499 5784 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:50:00.908625 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904505 5784 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:50:00.908625 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904509 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:50:00.908625 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904512 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:50:00.908625 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904515 5784 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:50:00.908625 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904518 5784 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:50:00.908625 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904521 5784 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:50:00.908625 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904524 5784 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:50:00.908625 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904527 5784 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:50:00.908625 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904530 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:50:00.909246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904532 5784 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:50:00.909246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904537 5784 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:50:00.909246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904541 5784 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:50:00.909246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904544 5784 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:50:00.909246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904546 5784 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:50:00.909246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904549 5784 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:50:00.909246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904551 5784 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:50:00.909246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904554 5784 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:50:00.909246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904557 5784 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:50:00.909246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904559 5784 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:50:00.909246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904562 5784 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:50:00.909246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904564 5784 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:50:00.909246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904567 5784 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:50:00.909246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904570 5784 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:50:00.909246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904572 5784 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:50:00.909246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904575 5784 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:50:00.909246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904577 5784 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:50:00.909246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904580 5784 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:50:00.909246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904583 5784 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:50:00.909246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904586 5784 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:50:00.909856 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904588 5784 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:50:00.909856 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904591 5784 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:50:00.909856 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904593 5784 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:50:00.909856 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904597 5784 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:50:00.909856 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904601 5784 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:50:00.909856 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904605 5784 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:50:00.909856 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904609 5784 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:50:00.909856 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904613 5784 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:50:00.909856 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904619 5784 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:50:00.909856 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904622 5784 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:50:00.909856 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904625 5784 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:50:00.909856 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.904629 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:50:00.909856 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905257 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:50:00.909856 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905267 5784 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:50:00.909856 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905272 5784 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:50:00.909856 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905275 5784 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:50:00.909856 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905278 5784 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:50:00.909856 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905280 5784 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:50:00.909856 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905283 5784 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:50:00.909856 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905285 5784 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:50:00.910533 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905288 5784 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:50:00.910533 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905290 5784 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:50:00.910533 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905294 5784 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:50:00.910533 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905298 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:50:00.910533 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905303 5784 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:50:00.910533 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905308 5784 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:50:00.910533 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905313 5784 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:50:00.910533 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905318 5784 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:50:00.910533 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905322 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:50:00.910533 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905325 5784 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:50:00.910533 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905328 5784 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:50:00.910533 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905330 5784 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:50:00.910533 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905333 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:50:00.910533 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905335 5784 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:50:00.910533 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905338 5784 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:50:00.910533 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905341 5784 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:50:00.910533 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905343 5784 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:50:00.910533 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905346 5784 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:50:00.910533 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905350 5784 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:50:00.910533 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905358 5784 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:50:00.911171 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905363 5784 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:50:00.911171 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905367 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:50:00.911171 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905371 5784 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:50:00.911171 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905376 5784 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:50:00.911171 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905379 5784 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:50:00.911171 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905382 5784 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:50:00.911171 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905385 5784 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:50:00.911171 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905388 5784 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:50:00.911171 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905392 5784 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:50:00.911171 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905394 5784 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:50:00.911171 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905397 5784 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:50:00.911171 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905401 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:50:00.911171 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905406 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:50:00.911171 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905411 5784 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:50:00.911171 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905415 5784 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:50:00.911171 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905419 5784 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:50:00.911171 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905424 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:50:00.911171 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905426 5784 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:50:00.911171 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905430 5784 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:50:00.911171 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905434 5784 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:50:00.911822 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905438 5784 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:50:00.911822 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905442 5784 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:50:00.911822 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905447 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:50:00.911822 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905451 5784 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:50:00.911822 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905456 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:50:00.911822 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905461 5784 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:50:00.911822 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905466 5784 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:50:00.911822 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905470 5784 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:50:00.911822 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905475 5784 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:50:00.911822 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905480 5784 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:50:00.911822 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905483 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:50:00.911822 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905488 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:50:00.911822 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905492 5784 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:50:00.911822 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905496 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:50:00.911822 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905500 5784 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:50:00.911822 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905505 5784 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:50:00.911822 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905509 5784 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:50:00.911822 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905514 5784 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:50:00.911822 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905519 5784 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:50:00.912422 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905523 5784 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:50:00.912422 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905528 5784 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:50:00.912422 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905533 5784 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:50:00.912422 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905537 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:50:00.912422 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905544 5784 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:50:00.912422 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905550 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:50:00.912422 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905553 5784 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:50:00.912422 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905557 5784 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:50:00.912422 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905559 5784 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:50:00.912422 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905562 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:50:00.912422 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905566 5784 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:50:00.912422 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905570 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:50:00.912422 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905575 5784 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:50:00.912422 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905579 5784 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:50:00.912422 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905583 5784 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:50:00.912422 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905587 5784 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:50:00.912422 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905591 5784 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:50:00.912422 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905596 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:50:00.912985 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905602 5784 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:50:00.912985 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905608 5784 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:50:00.912985 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905612 5784 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:50:00.912985 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905617 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:50:00.912985 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905622 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:50:00.912985 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905626 5784 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:50:00.912985 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905633 5784 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:50:00.912985 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905638 5784 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:50:00.912985 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905641 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:50:00.912985 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905644 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:50:00.912985 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905648 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:50:00.912985 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905651 5784 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:50:00.912985 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905654 5784 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:50:00.912985 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905657 5784 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:50:00.912985 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905659 5784 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:50:00.912985 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905662 5784 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:50:00.912985 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905665 5784 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:50:00.912985 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905668 5784 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:50:00.912985 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905670 5784 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:50:00.913608 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905673 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:50:00.913608 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.905676 5784 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:50:00.913608 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905792 5784 flags.go:64] FLAG: --address="0.0.0.0" Nov 04 05:50:00.913608 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905809 5784 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 04 05:50:00.913608 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905815 5784 flags.go:64] FLAG: --anonymous-auth="true" Nov 04 05:50:00.913608 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905820 5784 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 04 05:50:00.913608 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905824 5784 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 04 05:50:00.913608 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905828 5784 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 04 05:50:00.913608 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905832 5784 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 04 05:50:00.913608 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905836 5784 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 04 05:50:00.913608 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905839 5784 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 04 05:50:00.913608 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905843 5784 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 04 05:50:00.913608 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905848 5784 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 04 05:50:00.913608 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905852 5784 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 04 05:50:00.913608 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905855 5784 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 04 05:50:00.913608 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905858 5784 flags.go:64] FLAG: --cgroup-root="" Nov 04 05:50:00.913608 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905862 5784 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 04 05:50:00.913608 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905865 5784 flags.go:64] FLAG: --client-ca-file="" Nov 04 05:50:00.913608 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905870 5784 flags.go:64] FLAG: --cloud-provider="external" Nov 04 05:50:00.913608 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905877 5784 flags.go:64] FLAG: --cluster-dns="[]" Nov 04 05:50:00.913608 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905885 5784 flags.go:64] FLAG: --cluster-domain="" Nov 04 05:50:00.913608 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905891 5784 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 04 05:50:00.913608 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905897 5784 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905902 5784 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905908 5784 flags.go:64] FLAG: --container-log-max-files="5" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905918 5784 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905924 5784 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905930 5784 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905936 5784 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905940 5784 flags.go:64] FLAG: --contention-profiling="false" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905947 5784 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905952 5784 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905958 5784 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905962 5784 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905969 5784 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905974 5784 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905978 5784 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905981 5784 flags.go:64] FLAG: --enable-load-reader="false" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905984 5784 flags.go:64] FLAG: --enable-server="true" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905986 5784 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905991 5784 flags.go:64] FLAG: --event-burst="100" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905994 5784 flags.go:64] FLAG: --event-qps="50" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.905997 5784 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906000 5784 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906005 5784 flags.go:64] FLAG: --eviction-hard="" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906009 5784 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 04 05:50:00.914352 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906012 5784 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 04 05:50:00.915027 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906015 5784 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 04 05:50:00.915027 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906018 5784 flags.go:64] FLAG: --eviction-soft="" Nov 04 05:50:00.915027 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906021 5784 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 04 05:50:00.915027 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906024 5784 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 04 05:50:00.915027 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906028 5784 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 04 05:50:00.915027 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906031 5784 flags.go:64] FLAG: --experimental-mounter-path="" Nov 04 05:50:00.915027 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906034 5784 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 04 05:50:00.915027 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906037 5784 flags.go:64] FLAG: --fail-swap-on="true" Nov 04 05:50:00.915027 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906040 5784 flags.go:64] FLAG: --feature-gates="" Nov 04 05:50:00.915027 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906044 5784 flags.go:64] FLAG: --file-check-frequency="20s" Nov 04 05:50:00.915027 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906047 5784 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 04 05:50:00.915027 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906051 5784 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 04 05:50:00.915027 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906054 5784 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 04 05:50:00.915027 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906057 5784 flags.go:64] FLAG: --healthz-port="10248" Nov 04 05:50:00.915027 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906073 5784 flags.go:64] FLAG: --help="false" Nov 04 05:50:00.915027 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906077 5784 flags.go:64] FLAG: --hostname-override="ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:50:00.915027 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906082 5784 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 04 05:50:00.915027 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906085 5784 flags.go:64] FLAG: --http-check-frequency="20s" Nov 04 05:50:00.915027 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906088 5784 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 04 05:50:00.915027 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906092 5784 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 04 05:50:00.915027 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906095 5784 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 04 05:50:00.915027 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906099 5784 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 04 05:50:00.915027 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906102 5784 flags.go:64] FLAG: --image-service-endpoint="" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906104 5784 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906108 5784 flags.go:64] FLAG: --kube-api-burst="100" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906111 5784 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906114 5784 flags.go:64] FLAG: --kube-api-qps="50" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906117 5784 flags.go:64] FLAG: --kube-reserved="" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906120 5784 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906124 5784 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906128 5784 flags.go:64] FLAG: --kubelet-cgroups="" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906131 5784 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906134 5784 flags.go:64] FLAG: --lock-file="" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906137 5784 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906140 5784 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906143 5784 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906151 5784 flags.go:64] FLAG: --log-json-split-stream="false" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906156 5784 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906161 5784 flags.go:64] FLAG: --log-text-split-stream="false" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906166 5784 flags.go:64] FLAG: --logging-format="text" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906171 5784 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906177 5784 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906183 5784 flags.go:64] FLAG: --manifest-url="" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906187 5784 flags.go:64] FLAG: --manifest-url-header="" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906193 5784 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906197 5784 flags.go:64] FLAG: --max-open-files="1000000" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906201 5784 flags.go:64] FLAG: --max-pods="110" Nov 04 05:50:00.915749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906204 5784 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906207 5784 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906211 5784 flags.go:64] FLAG: --memory-manager-policy="None" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906214 5784 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906217 5784 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906221 5784 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906224 5784 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906231 5784 flags.go:64] FLAG: --node-status-max-images="50" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906235 5784 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906238 5784 flags.go:64] FLAG: --oom-score-adj="-999" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906241 5784 flags.go:64] FLAG: --pod-cidr="" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906244 5784 flags.go:64] FLAG: --pod-manifest-path="" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906247 5784 flags.go:64] FLAG: --pod-max-pids="-1" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906250 5784 flags.go:64] FLAG: --pods-per-core="0" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906254 5784 flags.go:64] FLAG: --port="10250" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906257 5784 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906260 5784 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-09963d41d2e1814c5" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906263 5784 flags.go:64] FLAG: --qos-reserved="" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906266 5784 flags.go:64] FLAG: --read-only-port="10255" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906270 5784 flags.go:64] FLAG: --register-node="true" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906272 5784 flags.go:64] FLAG: --register-with-taints="" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906277 5784 flags.go:64] FLAG: --registry-burst="10" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906280 5784 flags.go:64] FLAG: --registry-qps="5" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906283 5784 flags.go:64] FLAG: --reserved-cpus="" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906286 5784 flags.go:64] FLAG: --reserved-memory="" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906290 5784 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 04 05:50:00.916671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906293 5784 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906297 5784 flags.go:64] FLAG: --rotate-certificates="false" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906299 5784 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906303 5784 flags.go:64] FLAG: --runonce="false" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906306 5784 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906309 5784 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906312 5784 flags.go:64] FLAG: --seccomp-default="false" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906315 5784 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906318 5784 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906322 5784 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906326 5784 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906329 5784 flags.go:64] FLAG: --storage-driver-password="root" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906332 5784 flags.go:64] FLAG: --storage-driver-secure="false" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906335 5784 flags.go:64] FLAG: --storage-driver-table="stats" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906339 5784 flags.go:64] FLAG: --storage-driver-user="root" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906342 5784 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906345 5784 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906348 5784 flags.go:64] FLAG: --system-cgroups="" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906353 5784 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906362 5784 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906369 5784 flags.go:64] FLAG: --tls-cert-file="" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906373 5784 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906378 5784 flags.go:64] FLAG: --tls-min-version="" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906382 5784 flags.go:64] FLAG: --tls-private-key-file="" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906385 5784 flags.go:64] FLAG: --topology-manager-policy="none" Nov 04 05:50:00.917531 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906387 5784 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 04 05:50:00.918272 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906391 5784 flags.go:64] FLAG: --topology-manager-scope="container" Nov 04 05:50:00.918272 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906395 5784 flags.go:64] FLAG: --v="2" Nov 04 05:50:00.918272 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906400 5784 flags.go:64] FLAG: --version="false" Nov 04 05:50:00.918272 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906404 5784 flags.go:64] FLAG: --vmodule="" Nov 04 05:50:00.918272 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906408 5784 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 04 05:50:00.918272 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906411 5784 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 04 05:50:00.918272 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906577 5784 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:50:00.918272 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906585 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:50:00.918272 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906591 5784 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:50:00.918272 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906595 5784 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:50:00.918272 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906600 5784 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:50:00.918272 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906604 5784 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:50:00.918272 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906607 5784 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:50:00.918272 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906610 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:50:00.918272 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906613 5784 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:50:00.918272 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906616 5784 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:50:00.918272 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906619 5784 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:50:00.918272 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906622 5784 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:50:00.918272 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906624 5784 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:50:00.918272 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906627 5784 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:50:00.918272 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906629 5784 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:50:00.918962 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906632 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:50:00.918962 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906635 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:50:00.918962 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906637 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:50:00.918962 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906640 5784 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:50:00.918962 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906643 5784 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:50:00.918962 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906647 5784 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:50:00.918962 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906650 5784 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:50:00.918962 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906653 5784 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:50:00.918962 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906655 5784 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:50:00.918962 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906658 5784 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:50:00.918962 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906661 5784 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:50:00.918962 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906663 5784 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:50:00.918962 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906667 5784 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:50:00.918962 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906670 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:50:00.918962 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906673 5784 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:50:00.918962 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906676 5784 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:50:00.918962 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906679 5784 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:50:00.918962 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906681 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:50:00.918962 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906684 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:50:00.919777 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906686 5784 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:50:00.919777 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906689 5784 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:50:00.919777 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906692 5784 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:50:00.919777 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906694 5784 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:50:00.919777 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906697 5784 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:50:00.919777 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906699 5784 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:50:00.919777 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906702 5784 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:50:00.919777 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906704 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:50:00.919777 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906707 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:50:00.919777 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906710 5784 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:50:00.919777 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906713 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:50:00.919777 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906716 5784 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:50:00.919777 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906719 5784 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:50:00.919777 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906721 5784 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:50:00.919777 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906724 5784 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:50:00.919777 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906727 5784 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:50:00.919777 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906729 5784 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:50:00.919777 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906733 5784 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:50:00.919777 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906736 5784 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:50:00.919777 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906739 5784 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:50:00.920697 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906742 5784 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:50:00.920697 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906744 5784 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:50:00.920697 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906748 5784 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:50:00.920697 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906752 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:50:00.920697 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906755 5784 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:50:00.920697 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906759 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:50:00.920697 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906762 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:50:00.920697 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906764 5784 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:50:00.920697 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906767 5784 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:50:00.920697 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906770 5784 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:50:00.920697 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906772 5784 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:50:00.920697 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906775 5784 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:50:00.920697 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906777 5784 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:50:00.920697 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906780 5784 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:50:00.920697 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906783 5784 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:50:00.920697 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906788 5784 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:50:00.920697 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906792 5784 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:50:00.920697 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906796 5784 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:50:00.920697 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906800 5784 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:50:00.921445 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906802 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:50:00.921445 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906805 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:50:00.921445 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906807 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:50:00.921445 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906811 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:50:00.921445 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906813 5784 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:50:00.921445 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906816 5784 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:50:00.921445 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906819 5784 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:50:00.921445 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906821 5784 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:50:00.921445 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906824 5784 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:50:00.921445 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906827 5784 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:50:00.921445 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906829 5784 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:50:00.921445 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906833 5784 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:50:00.921445 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906836 5784 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:50:00.921445 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906838 5784 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:50:00.921445 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906841 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:50:00.921445 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906844 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:50:00.921445 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906846 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:50:00.921445 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906849 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:50:00.921445 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906852 5784 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:50:00.922213 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906856 5784 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:50:00.922213 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906860 5784 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:50:00.922213 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906863 5784 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:50:00.922213 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906866 5784 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:50:00.922213 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906868 5784 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:50:00.922213 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906871 5784 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:50:00.922213 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906874 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:50:00.922213 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906877 5784 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:50:00.922213 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906880 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:50:00.922213 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906883 5784 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:50:00.922213 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906885 5784 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:50:00.922213 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906888 5784 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:50:00.922213 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906891 5784 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:50:00.922213 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906893 5784 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:50:00.922213 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.906921 5784 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 05:50:00.922213 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906973 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:50:00.922734 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906980 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:50:00.922734 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906986 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:50:00.922734 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906991 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:50:00.922734 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906994 5784 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:50:00.922734 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.906997 5784 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:50:00.922734 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907000 5784 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:50:00.922734 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907003 5784 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:50:00.922734 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907005 5784 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:50:00.922734 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907009 5784 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:50:00.922734 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907012 5784 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:50:00.922734 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907014 5784 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:50:00.922734 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907017 5784 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:50:00.922734 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907019 5784 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:50:00.922734 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907022 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:50:00.922734 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907025 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:50:00.922734 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907027 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:50:00.922734 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907033 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:50:00.922734 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907035 5784 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:50:00.922734 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907039 5784 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:50:00.923580 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907043 5784 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:50:00.923580 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907046 5784 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:50:00.923580 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907050 5784 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:50:00.923580 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907053 5784 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:50:00.923580 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907055 5784 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:50:00.923580 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907058 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:50:00.923580 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907075 5784 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:50:00.923580 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907078 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:50:00.923580 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907081 5784 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:50:00.923580 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907084 5784 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:50:00.923580 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907086 5784 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:50:00.923580 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907089 5784 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:50:00.923580 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907092 5784 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:50:00.923580 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907094 5784 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:50:00.923580 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907097 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:50:00.923580 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907100 5784 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:50:00.923580 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907105 5784 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:50:00.923580 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907109 5784 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:50:00.923580 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907113 5784 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:50:00.923580 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907118 5784 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:50:00.924339 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907123 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:50:00.924339 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907131 5784 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:50:00.924339 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907136 5784 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:50:00.924339 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907141 5784 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:50:00.924339 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907146 5784 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:50:00.924339 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907150 5784 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:50:00.924339 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907155 5784 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:50:00.924339 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907159 5784 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:50:00.924339 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907164 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:50:00.924339 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907171 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:50:00.924339 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907176 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:50:00.924339 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907180 5784 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:50:00.924339 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907183 5784 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:50:00.924339 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907186 5784 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:50:00.924339 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907189 5784 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:50:00.924339 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907191 5784 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:50:00.924339 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907194 5784 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:50:00.924339 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907196 5784 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:50:00.924339 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907199 5784 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:50:00.924339 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907201 5784 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:50:00.925032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907205 5784 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:50:00.925032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907209 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:50:00.925032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907211 5784 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:50:00.925032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907214 5784 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:50:00.925032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907217 5784 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:50:00.925032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907219 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:50:00.925032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907222 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:50:00.925032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907224 5784 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:50:00.925032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907227 5784 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:50:00.925032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907230 5784 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:50:00.925032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907233 5784 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:50:00.925032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907235 5784 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:50:00.925032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907238 5784 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:50:00.925032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907242 5784 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:50:00.925032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907245 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:50:00.925032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907247 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:50:00.925032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907250 5784 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:50:00.925032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907252 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:50:00.925032 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907255 5784 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:50:00.925703 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907257 5784 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:50:00.925703 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907260 5784 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:50:00.925703 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907265 5784 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:50:00.925703 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907268 5784 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:50:00.925703 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907270 5784 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:50:00.925703 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907273 5784 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:50:00.925703 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907276 5784 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:50:00.925703 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907279 5784 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:50:00.925703 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907281 5784 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:50:00.925703 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907284 5784 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:50:00.925703 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907288 5784 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:50:00.925703 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907294 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:50:00.925703 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907297 5784 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:50:00.925703 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907300 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:50:00.925703 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907303 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:50:00.925703 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907305 5784 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:50:00.925703 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907308 5784 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:50:00.925703 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907311 5784 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:50:00.925703 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907313 5784 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:50:00.926287 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907316 5784 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:50:00.926287 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907318 5784 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:50:00.926287 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907321 5784 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:50:00.926287 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907324 5784 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:50:00.926287 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907326 5784 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:50:00.926287 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907330 5784 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:50:00.926287 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907335 5784 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:50:00.926287 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.907342 5784 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:50:00.926287 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.912178 5784 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 04 05:50:00.926287 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.912199 5784 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 04 05:50:00.926287 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.912223 5784 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 04 05:50:00.926287 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.912231 5784 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 04 05:50:00.926287 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912315 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:50:00.926287 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912322 5784 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:50:00.926287 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912329 5784 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:50:00.926287 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912333 5784 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:50:00.926287 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912338 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:50:00.926287 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912343 5784 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:50:00.926287 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912349 5784 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:50:00.926287 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912353 5784 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:50:00.927014 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912357 5784 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:50:00.927014 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912362 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:50:00.927014 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912367 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:50:00.927014 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912371 5784 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:50:00.927014 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912376 5784 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:50:00.927014 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912380 5784 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:50:00.927014 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912384 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:50:00.927014 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912389 5784 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:50:00.927014 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912395 5784 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:50:00.927014 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912399 5784 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:50:00.927014 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912404 5784 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:50:00.927014 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912409 5784 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:50:00.927014 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912413 5784 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:50:00.927014 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912420 5784 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:50:00.927014 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912427 5784 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:50:00.927014 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912434 5784 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:50:00.927014 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912440 5784 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:50:00.927014 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912447 5784 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:50:00.927014 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912452 5784 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:50:00.927647 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912457 5784 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:50:00.927647 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912462 5784 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:50:00.927647 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912468 5784 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:50:00.927647 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912472 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:50:00.927647 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912477 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:50:00.927647 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912481 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:50:00.927647 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912485 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:50:00.927647 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912489 5784 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:50:00.927647 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912494 5784 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:50:00.927647 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912498 5784 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:50:00.927647 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912502 5784 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:50:00.927647 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912506 5784 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:50:00.927647 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912510 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:50:00.927647 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912515 5784 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:50:00.927647 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912519 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:50:00.927647 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912523 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:50:00.927647 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912527 5784 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:50:00.927647 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912531 5784 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:50:00.927647 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912535 5784 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:50:00.928246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912540 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:50:00.928246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912545 5784 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:50:00.928246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912549 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:50:00.928246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912553 5784 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:50:00.928246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912557 5784 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:50:00.928246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912562 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:50:00.928246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912566 5784 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:50:00.928246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912570 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:50:00.928246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912574 5784 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:50:00.928246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912578 5784 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:50:00.928246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912582 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:50:00.928246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912588 5784 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:50:00.928246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912592 5784 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:50:00.928246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912597 5784 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:50:00.928246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912601 5784 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:50:00.928246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912605 5784 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:50:00.928246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912610 5784 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:50:00.928246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912614 5784 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:50:00.928246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912619 5784 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:50:00.928246 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912623 5784 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:50:00.928910 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912627 5784 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:50:00.928910 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912631 5784 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:50:00.928910 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912635 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:50:00.928910 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912639 5784 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:50:00.928910 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912643 5784 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:50:00.928910 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912647 5784 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:50:00.928910 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912651 5784 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:50:00.928910 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912655 5784 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:50:00.928910 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912659 5784 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:50:00.928910 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912664 5784 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:50:00.928910 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912668 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:50:00.928910 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912672 5784 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:50:00.928910 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912677 5784 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:50:00.928910 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912682 5784 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:50:00.928910 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912687 5784 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:50:00.928910 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912691 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:50:00.928910 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912695 5784 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:50:00.928910 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912699 5784 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:50:00.928910 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912703 5784 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:50:00.928910 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912707 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:50:00.929652 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912712 5784 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:50:00.929652 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912716 5784 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:50:00.929652 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912721 5784 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:50:00.929652 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912725 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:50:00.929652 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912729 5784 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:50:00.929652 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912733 5784 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:50:00.929652 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912737 5784 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:50:00.929652 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912741 5784 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:50:00.929652 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912745 5784 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:50:00.929652 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912750 5784 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:50:00.929652 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912756 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:50:00.929652 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912760 5784 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:50:00.929652 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912764 5784 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:50:00.929652 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912768 5784 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:50:00.929652 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912772 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:50:00.929652 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912777 5784 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:50:00.929652 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912781 5784 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:50:00.929652 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912785 5784 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:50:00.929652 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912790 5784 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:50:00.929652 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.912794 5784 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:50:00.930362 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.912832 5784 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 05:50:00.930362 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913088 5784 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:50:00.930362 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913097 5784 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:50:00.930362 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913102 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:50:00.930362 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913108 5784 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:50:00.930362 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913112 5784 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:50:00.930362 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913117 5784 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:50:00.930362 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913121 5784 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:50:00.930362 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913126 5784 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:50:00.930362 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913130 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:50:00.930362 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913134 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:50:00.930362 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913138 5784 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:50:00.930362 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913142 5784 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:50:00.930362 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913146 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:50:00.930362 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913150 5784 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:50:00.930362 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913155 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:50:00.930843 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913159 5784 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:50:00.930843 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913163 5784 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:50:00.930843 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913167 5784 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:50:00.930843 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913172 5784 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:50:00.930843 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913176 5784 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:50:00.930843 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913180 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:50:00.930843 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913185 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:50:00.930843 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913189 5784 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:50:00.930843 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913193 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:50:00.930843 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913197 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:50:00.930843 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913201 5784 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:50:00.930843 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913208 5784 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:50:00.930843 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913214 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:50:00.930843 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913218 5784 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:50:00.930843 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913222 5784 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:50:00.930843 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913226 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:50:00.930843 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913230 5784 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:50:00.930843 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913234 5784 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:50:00.930843 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913238 5784 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:50:00.931555 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913242 5784 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:50:00.931555 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913246 5784 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:50:00.931555 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913251 5784 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:50:00.931555 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913255 5784 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:50:00.931555 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913259 5784 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:50:00.931555 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913263 5784 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:50:00.931555 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913267 5784 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:50:00.931555 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913271 5784 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:50:00.931555 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913275 5784 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:50:00.931555 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913279 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:50:00.931555 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913283 5784 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:50:00.931555 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913287 5784 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:50:00.931555 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913291 5784 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:50:00.931555 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913295 5784 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:50:00.931555 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913299 5784 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:50:00.931555 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913304 5784 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:50:00.931555 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913308 5784 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:50:00.931555 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913313 5784 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:50:00.931555 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913318 5784 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:50:00.931555 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913322 5784 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:50:00.932243 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913327 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:50:00.932243 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913331 5784 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:50:00.932243 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913338 5784 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:50:00.932243 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913343 5784 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:50:00.932243 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913348 5784 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:50:00.932243 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913352 5784 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:50:00.932243 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913356 5784 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:50:00.932243 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913361 5784 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:50:00.932243 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913365 5784 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:50:00.932243 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913370 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:50:00.932243 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913374 5784 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:50:00.932243 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913378 5784 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:50:00.932243 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913382 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:50:00.932243 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913386 5784 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:50:00.932243 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913390 5784 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:50:00.932243 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913395 5784 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:50:00.932243 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913399 5784 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:50:00.932243 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913403 5784 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:50:00.932243 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913408 5784 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:50:00.932243 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913412 5784 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:50:00.932928 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913416 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:50:00.932928 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913420 5784 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:50:00.932928 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913424 5784 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:50:00.932928 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913428 5784 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:50:00.932928 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913432 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:50:00.932928 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913436 5784 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:50:00.932928 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913440 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:50:00.932928 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913444 5784 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:50:00.932928 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913449 5784 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:50:00.932928 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913453 5784 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:50:00.932928 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913457 5784 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:50:00.932928 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913461 5784 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:50:00.932928 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913465 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:50:00.932928 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913469 5784 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:50:00.932928 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913473 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:50:00.932928 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913477 5784 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:50:00.932928 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913482 5784 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:50:00.932928 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913486 5784 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:50:00.932928 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913491 5784 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:50:00.932928 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913495 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:50:00.933529 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913499 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:50:00.933529 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913503 5784 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:50:00.933529 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913507 5784 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:50:00.933529 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913512 5784 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:50:00.933529 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913517 5784 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:50:00.933529 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913521 5784 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:50:00.933529 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913525 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:50:00.933529 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913529 5784 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:50:00.933529 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913533 5784 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:50:00.933529 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913538 5784 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:50:00.933529 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913542 5784 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:50:00.933529 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913546 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:50:00.933529 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.913582 5784 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 05:50:00.933529 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913632 5784 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 05:50:00.933529 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913638 5784 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 05:50:00.933529 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913644 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 05:50:00.934019 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913649 5784 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 05:50:00.934019 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913655 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 05:50:00.934019 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913660 5784 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 05:50:00.934019 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913664 5784 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 05:50:00.934019 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913669 5784 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 05:50:00.934019 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913673 5784 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 05:50:00.934019 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913680 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 05:50:00.934019 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913686 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 05:50:00.934019 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913690 5784 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 05:50:00.934019 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913695 5784 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 05:50:00.934019 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913700 5784 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 05:50:00.934019 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913704 5784 feature_gate.go:386] unrecognized feature gate: Example Nov 04 05:50:00.934019 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913708 5784 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 05:50:00.934019 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913713 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 05:50:00.934019 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913718 5784 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 05:50:00.934019 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913722 5784 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 05:50:00.934019 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913726 5784 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 05:50:00.934019 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913730 5784 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 05:50:00.934019 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913735 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 05:50:00.934761 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913739 5784 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 05:50:00.934761 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913743 5784 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 05:50:00.934761 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913747 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 05:50:00.934761 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913751 5784 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 05:50:00.934761 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913755 5784 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 05:50:00.934761 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913760 5784 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 05:50:00.934761 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913764 5784 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 05:50:00.934761 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913768 5784 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 05:50:00.934761 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913772 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 05:50:00.934761 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913776 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 05:50:00.934761 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913781 5784 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 05:50:00.934761 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913785 5784 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 05:50:00.934761 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913789 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 05:50:00.934761 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913793 5784 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 05:50:00.934761 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913797 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 05:50:00.934761 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913801 5784 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 05:50:00.934761 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913805 5784 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 05:50:00.934761 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913809 5784 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 05:50:00.934761 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913813 5784 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 05:50:00.935447 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913820 5784 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 05:50:00.935447 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913824 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 05:50:00.935447 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913828 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 05:50:00.935447 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913833 5784 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 05:50:00.935447 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913837 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 05:50:00.935447 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913841 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 05:50:00.935447 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913847 5784 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 05:50:00.935447 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913854 5784 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 05:50:00.935447 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913861 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 05:50:00.935447 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913865 5784 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 05:50:00.935447 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913870 5784 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 05:50:00.935447 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913874 5784 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 05:50:00.935447 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913878 5784 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 05:50:00.935447 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913883 5784 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 05:50:00.935447 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913887 5784 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 05:50:00.935447 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913891 5784 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 05:50:00.935447 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913895 5784 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 05:50:00.935447 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913899 5784 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 05:50:00.936176 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913903 5784 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 05:50:00.936176 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913908 5784 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 05:50:00.936176 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913912 5784 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 05:50:00.936176 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913916 5784 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 05:50:00.936176 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913920 5784 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 05:50:00.936176 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913924 5784 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 05:50:00.936176 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913928 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 05:50:00.936176 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913932 5784 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 05:50:00.936176 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913936 5784 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 05:50:00.936176 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913941 5784 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 05:50:00.936176 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913945 5784 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 05:50:00.936176 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913949 5784 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 05:50:00.936176 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913953 5784 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 05:50:00.936176 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913958 5784 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 05:50:00.936176 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913965 5784 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 05:50:00.936176 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913969 5784 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 05:50:00.936176 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913973 5784 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 05:50:00.936176 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913977 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 05:50:00.936176 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913982 5784 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 05:50:00.936176 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913988 5784 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 05:50:00.936821 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.913994 5784 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 05:50:00.936821 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914000 5784 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 05:50:00.936821 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914006 5784 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 05:50:00.936821 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914011 5784 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 05:50:00.936821 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914016 5784 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 05:50:00.936821 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914021 5784 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 05:50:00.936821 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914027 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 05:50:00.936821 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914031 5784 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 05:50:00.936821 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914035 5784 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 05:50:00.936821 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914039 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 05:50:00.936821 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914043 5784 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 05:50:00.936821 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914048 5784 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 05:50:00.936821 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914052 5784 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 05:50:00.936821 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914056 5784 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 05:50:00.936821 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914073 5784 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 05:50:00.936821 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914078 5784 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 05:50:00.936821 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914082 5784 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 05:50:00.936821 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914086 5784 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 05:50:00.936821 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914091 5784 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 05:50:00.936821 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914095 5784 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 05:50:00.937467 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914099 5784 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 05:50:00.937467 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914103 5784 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 05:50:00.937467 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914107 5784 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 05:50:00.937467 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914111 5784 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 05:50:00.937467 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914115 5784 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 05:50:00.937467 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914120 5784 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 05:50:00.937467 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:00.914125 5784 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 05:50:00.937467 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.914204 5784 server.go:957] "Client rotation is on, will bootstrap in background" Nov 04 05:50:00.937467 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.915812 5784 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Nov 04 05:50:00.937467 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.915882 5784 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Nov 04 05:50:00.937467 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.916155 5784 server.go:1014] "Starting client certificate rotation" Nov 04 05:50:00.937467 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.916311 5784 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 04 05:50:00.937467 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.916372 5784 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 05:43:46 +0000 UTC" deadline="2028-04-23 09:20:26.599994121 +0000 UTC" Nov 04 05:50:00.937467 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.916411 5784 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12867h30m25.683586808s" Nov 04 05:50:00.937467 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.916835 5784 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 05:50:00.937467 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.918436 5784 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 05:50:00.937998 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.920433 5784 log.go:25] "Validated CRI v1 runtime API" Nov 04 05:50:00.937998 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.923225 5784 log.go:25] "Validated CRI v1 image API" Nov 04 05:50:00.937998 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.924149 5784 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 04 05:50:00.937998 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.926700 5784 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e84a8552-4023-42d4-bf93-c72a1a96ca1b:/dev/nvme0n1p4 f082d6cb-69fd-466a-88bc-da0ca4d879cc:/dev/nvme0n1p3] Nov 04 05:50:00.938216 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.926719 5784 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0367a099754e6a89c49e94e75bbb15f99f7c47afd13b44f320d68b06c22ad3cb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0367a099754e6a89c49e94e75bbb15f99f7c47afd13b44f320d68b06c22ad3cb/userdata/shm major:0 minor:292 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/151a666b9f40880998e6d75692b5811a00562228672a6c082d0f1dc5ed47a05b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/151a666b9f40880998e6d75692b5811a00562228672a6c082d0f1dc5ed47a05b/userdata/shm major:0 minor:364 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1d38f8e2f93226f6cb3c4bedb1db12059b988f24e6f6413aa97d2028c7db5b2f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1d38f8e2f93226f6cb3c4bedb1db12059b988f24e6f6413aa97d2028c7db5b2f/userdata/shm major:0 minor:212 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2ac8cbdb3dd8d88f9cb85e2e857897daf971faae2aa2fb6bce19a180506fd10b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2ac8cbdb3dd8d88f9cb85e2e857897daf971faae2aa2fb6bce19a180506fd10b/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2b09245e3ed95759d032b02dffced1eade477eb95cc522e71d7c62caacb272f3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2b09245e3ed95759d032b02dffced1eade477eb95cc522e71d7c62caacb272f3/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/32a03eca3efac02dd990719640a77603f8fd42784a5d827b73cb4101d30bd356/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/32a03eca3efac02dd990719640a77603f8fd42784a5d827b73cb4101d30bd356/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/34a6ce100bb4dbad797d44b391da8ba21a9ee9f45fc3d51cf1a3675b34f178e8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/34a6ce100bb4dbad797d44b391da8ba21a9ee9f45fc3d51cf1a3675b34f178e8/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4027b35de7271b28780d267b8e7996d75c315673757540daf62148a80743a6da/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4027b35de7271b28780d267b8e7996d75c315673757540daf62148a80743a6da/userdata/shm major:0 minor:445 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4435416caffc8da3d173f24d06308c1332679baaee17b9f9a385eade822318c5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4435416caffc8da3d173f24d06308c1332679baaee17b9f9a385eade822318c5/userdata/shm major:0 minor:92 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/50986f63cea9bb5f61995667a88c6f2fa90b6a533101e17451da766c8ceb46f3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/50986f63cea9bb5f61995667a88c6f2fa90b6a533101e17451da766c8ceb46f3/userdata/shm major:0 minor:81 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/59576fa1bb34c8f7627eacf1552499708c21a069a8c0945aae0223492bb17af7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/59576fa1bb34c8f7627eacf1552499708c21a069a8c0945aae0223492bb17af7/userdata/shm major:0 minor:286 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5af322646aa3d249aee8d87d5b897d8f01e333498eeb2b18efc4dd385bc2855f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5af322646aa3d249aee8d87d5b897d8f01e333498eeb2b18efc4dd385bc2855f/userdata/shm major:0 minor:413 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/623b03da3fb7c889ae6d19eaa905cc6a601e2efc209a6e691b9e998e1c5d9e11/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/623b03da3fb7c889ae6d19eaa905cc6a601e2efc209a6e691b9e998e1c5d9e11/userdata/shm major:0 minor:69 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8bed2f9549b8e49a6cca67ac84190819a2eac0574bcc7dfc649dcda99e8cad92/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8bed2f9549b8e49a6cca67ac84190819a2eac0574bcc7dfc649dcda99e8cad92/userdata/shm major:0 minor:429 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8c1dc9ece389634bcb19fbf5d6bf13066353cd2ab4b25119f62a84b19485ceb0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8c1dc9ece389634bcb19fbf5d6bf13066353cd2ab4b25119f62a84b19485ceb0/userdata/shm major:0 minor:77 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8eb39cf29ab7476d1d8bde56c93f41de6aa848f51f0b835ec286fd847ddfd8a5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8eb39cf29ab7476d1d8bde56c93f41de6aa848f51f0b835ec286fd847ddfd8a5/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9040211da883859f068fa3b6ca8e2100a5f4fe83476d3e06bd1ca9c79a85e51e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9040211da883859f068fa3b6ca8e2100a5f4fe83476d3e06bd1ca9c79a85e51e/userdata/shm major:0 minor:415 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/947312d04ab16fffbf256934ca093dc2ff8dc342e406b87874751e2faa1a43de/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/947312d04ab16fffbf256934ca093dc2ff8dc342e406b87874751e2faa1a43de/userdata/shm major:0 minor:290 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9627133d301f4d5b0c74c2e5f7d998369a9346ccf683c23b8f3c93d66935332b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9627133d301f4d5b0c74c2e5f7d998369a9346ccf683c23b8f3c93d66935332b/userdata/shm major:0 minor:361 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a396ba5736233f1901d46140af01c70266994f35bea8f5955343ec8467a9d7ab/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a396ba5736233f1901d46140af01c70266994f35bea8f5955343ec8467a9d7ab/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bc7e49420dda09f988b8df21ba90c69fa996b0633c7c9af4bc14027b257bf4a5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bc7e49420dda09f988b8df21ba90c69fa996b0633c7c9af4bc14027b257bf4a5/userdata/shm major:0 minor:88 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bcd87f2907c350ed1f0aadfa0da8f8c196fbe9f4bb2919547ca83becc31c6985/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bcd87f2907c350ed1f0aadfa0da8f8c196fbe9f4bb2919547ca83becc31c6985/userdata/shm major:0 minor:411 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c6d5d696cce085b262640af2bcdf3f34ea286ed770e40988c5dbee5ae7c7d22d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c6d5d696cce085b262640af2bcdf3f34ea286ed770e40988c5dbee5ae7c7d22d/userdata/shm major:0 minor:326 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/dc72ae2f62b98449fa1adf7cba30a5346084c61fc6d55bdc95fec98330fe640b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/dc72ae2f62b98449fa1adf7cba30a5346084c61fc6d55bdc95fec98330fe640b/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/eb615e71882ee05bb30a724fb0cd0ab0a4d40b9401bb75cf7945d32ef2a3300d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/eb615e71882ee05bb30a724fb0cd0ab0a4d40b9401bb75cf7945d32ef2a3300d/userdata/shm major:0 minor:264 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f14fa1521bab7cd19bbd391605e9a73ddcf336ec685a2203d87653121e1ca2b4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f14fa1521bab7cd19bbd391605e9a73ddcf336ec685a2203d87653121e1ca2b4/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0742c411-7597-48ae-a35d-82a7d69fafdb/volumes/kubernetes.io~projected/kube-api-access-z8fdz:{mountpoint:/var/lib/kubelet/pods/0742c411-7597-48ae-a35d-82a7d69fafdb/volumes/kubernetes.io~projected/kube-api-access-z8fdz major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0742c411-7597-48ae-a35d-82a7d69fafdb/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/0742c411-7597-48ae-a35d-82a7d69fafdb/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:320 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volume-subpaths/web-config/alertmanager/9 major:0 minor:321 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volume-subpaths/web-config/config-reloader/6 major:0 minor:321 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:321 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~empty-dir/config-out major:0 minor:317 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~projected/kube-api-access-4fldv:{mountpoint:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~projected/kube-api-access-4fldv major:0 minor:325 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~projected/tls-assets major:0 minor:323 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:320 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~secret/config-volume major:0 minor:313 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:324 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:318 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:322 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:319 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~secret/web-config major:0 minor:321 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/124a28d1-9d05-42d1-99d4-721942b23062/volumes/kubernetes.io~projected/kube-api-access-mtt5b:{mountpoint:/var/lib/kubelet/pods/124a28d1-9d05-42d1-99d4-721942b23062/volumes/kubernetes.io~projected/kube-api-access-mtt5b major:0 minor:281 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/124a28d1-9d05-42d1-99d4-721942b23062/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/124a28d1-9d05-42d1-99d4-721942b23062/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:276 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/124a28d1-9d05-42d1-99d4-721942b23062/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/124a28d1-9d05-42d1-99d4-721942b23062/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:280 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/206b2e75-0735-49df-a53c-bdd17aab8ae6/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/206b2e75-0735-49df-a53c-bdd17aab8ae6/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/206b2e75-0735-49df-a53c-bdd17aab8ae6/volumes/kubernetes.io~projected/kube-api-access-hcqrv:{mountpoint:/var/lib/kubelet/pods/206b2e75-0735-49df-a53c-bdd17aab8ae6/volumes/kubernetes.io~projected/kube-api-access-hcqrv major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/206b2e75-0735-49df-a53c-bdd17aab8ae6/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/206b2e75-0735-49df-a53c-bdd17aab8ae6/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/237e2f40-006a-4b40-aa3e-6d0d05295e6d/volumes/kubernetes.io~projected/kube-api-access-kbrdw:{mountpoint:/var/lib/kubelet/pods/237e2f40-006a-4b40-aa3e-6d0d05295e6d/volumes/kubernetes.io~projected/kube-api-access-kbrdw major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2bc8ee82-0a82-4157-99b0-53360f1cd919/volumes/kubernetes.io~projected/kube-api-access-5wx9c:{mountpoint:/var/lib/kubelet/pods/2bc8ee82-0a82-4157-99b0-53360f1cd919/volumes/kubernetes.io~projected/kube-api-access-5wx9c major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3b41e530-bd50-4905-8887-32286cfdedbf/volumes/kubernetes.io~projected/kube-api-access-nfhg5:{mountpoint:/var/lib/kubelet/pods/3b41e530-bd50-4905-8887-32286cfdedbf/volumes/kubernetes.io~projected/kube-api-access-nfhg5 major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3b41e530-bd50-4905-8887-32286cfdedbf/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/3b41e530-bd50-4905-8887-32286cfdedbf/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:285 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3b41e530-bd50-4905-8887-32286cfdedbf/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/3b41e530-bd50-4905-8887-32286cfdedbf/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:282 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/59bf3884-8cc8-4a80-a064-470c85186dda/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/59bf3884-8cc8-4a80-a064-470c85186dda/volumes/kubernetes.io~secret/agent-certs major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5dadf5f9-5bb9-4652-9d12-c4f17d327528/volumes/kubernetes.io~projected/kube-api-access-5tlhk:{mountpoint:/var/lib/kubelet/pods/5dadf5f9-5bb9-4652-9d12-c4f17d327528/volumes/kubernetes.io~projected/kube-api-access-5tlhk major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/63258d2f-36fe-483c-9d98-fefeffd43533/volumes/kubernetes.io~projected/kube-api-access-ljlvq:{mountpoint:/var/lib/kubelet/pods/63258d2f-36fe-483c-9d98-fefeffd43533/volumes/kubernetes.io~projected/kube-api-access-ljlvq major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/63258d2f-36fe-483c-9d98-fefeffd43533/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/63258d2f-36fe-483c-9d98-fefeffd43533/volumes/kubernetes.io~secret/cert major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/635418a3-d2fd-4dcc-8893-8488f45988c0/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/635418a3-d2fd-4dcc-8893-8488f45988c0/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:409 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6bde7db4-687a-4dcb-b490-2f88e2e4ea71/volumes/kubernetes.io~projected/kube-api-access-48twm:{mountpoint:/var/lib/kubelet/pods/6bde7db4-687a-4dcb-b490-2f88e2e4ea71/volumes/kubernetes.io~projected/kube-api-access-48twm major:0 minor:410 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volume-subpaths/web-config/init-config-reloader/2:{mountpoint:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volume-subpaths/web-config/init-config-reloader/2 major:0 minor:443 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~empty-dir/config-out major:0 minor:439 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~projected/kube-api-access-nst9j:{mountpoint:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~projected/kube-api-access-nst9j major:0 minor:444 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~projected/tls-assets major:0 minor:437 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/config:{mountpoint:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/config major:0 minor:433 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:436 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/secret-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/secret-kube-rbac-proxy major:0 minor:438 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/secret-metrics-client-certs:{mountpoint:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/secret-metrics-client-certs major:0 minor:441 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web major:0 minor:442 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls:{mountpoint:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls major:0 minor:434 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls:{mountpoint:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls major:0 minor:435 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file:{mountpoint:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file major:0 minor:440 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/web-config major:0 minor:443 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7f227a09-ac46-4ab4-85db-cf57670ae3c1/volumes/kubernetes.io~projected/kube-api-access-44hld:{mountpoint:/var/lib/kubelet/pods/7f227a09-ac46-4ab4-85db-cf57670ae3c1/volumes/kubernetes.io~projected/kube-api-access-44hld major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/807edbb8-055e-4796-b4dd-b254a93313f6/volumes/kubernetes.io~projected/kube-api-access-xpvdq:{mountpoint:/var/lib/kubelet/pods/807edbb8-055e-4796-b4dd-b254a93313f6/volumes/kubernetes.io~projected/kube-api-access-xpvdq major:0 minor:289 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/807edbb8-055e-4796-b4dd-b254a93313f6/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/807edbb8-055e-4796-b4dd-b254a93313f6/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:283 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/807edbb8-055e-4796-b4dd-b254a93313f6/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/807edbb8-055e-4796-b4dd-b254a93313f6/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:284 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f/volumes/kubernetes.io~projected/kube-api-access-n6jqz:{mountpoint:/var/lib/kubelet/pods/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f/volumes/kubernetes.io~projected/kube-api-access-n6jqz major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f/volumes/kubernetes.io~secret/metrics-certs major:0 minor:404 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8c71ae38-62e0-4de3-9cf9-c4ee58edd96a/volumes/kubernetes.io~secret/tls-certificates:{mountpoint:/var/lib/kubelet/pods/8c71ae38-62e0-4de3-9cf9-c4ee58edd96a/volumes/kubernetes.io~secret/tls-certificates major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc/volumes/kubernetes.io~projected/kube-api-access-dxkfl:{mountpoint:/var/lib/kubelet/pods/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc/volumes/kubernetes.io~projected/kube-api-access-dxkfl major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a9525137-701e-46b7-8582-322cd59aaf48/volumes/kubernetes.io~projected/kube-api-access-nkggn:{mountpoint:/var/lib/kubelet/pods/a9525137-701e-46b7-8582-322cd59aaf48/volumes/kubernetes.io~projected/kube-api-access-nkggn major:0 minor:357 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a9525137-701e-46b7-8582-322cd59aaf48/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/a9525137-701e-46b7-8582-322cd59aaf48/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:351 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a956a93b-8cf1-45ad-bcbf-409e331a02d1/volumes/kubernetes.io~projected/kube-api-access-fjfjp:{mountpoint:/var/lib/kubelet/pods/a956a93b-8cf1-45ad-bcbf-409e331a02d1/volumes/kubernetes.io~projected/kube-api-access-fjfjp major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a956a93b-8cf1-45ad-bcbf-409e331a02d1/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/a956a93b-8cf1-45ad-bcbf-409e331a02d1/volumes/kubernetes.io~secret/metrics-tls major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a965dd43-4908-4a6a-9b2a-f3dc0590020e/volumes/kubernetes.io~projected/kube-api-access-dg7t8:{mountpoint:/var/lib/kubelet/pods/a965dd43-4908-4a6a-9b2a-f3dc0590020e/volumes/kubernetes.io~projected/kube-api-access-dg7t8 major:0 minor:425 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bcf9e13b-7029-4567-85b8-4d53bca32fef/volumes/kubernetes.io~projected/kube-api-access-w44fz:{mountpoint:/var/lib/kubelet/pods/bcf9e13b-7029-4567-85b8-4d53bca32fef/volumes/kubernetes.io~projected/kube-api-access-w44fz major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ccf93b8e-80a1-4ae6-9d4e-643760607116/volumes/kubernetes.io~projected/kube-api-access-lmxjw:{mountpoint:/var/lib/kubelet/pods/ccf93b8e-80a1-4ae6-9d4e-643760607116/volumes/kubernetes.io~projected/kube-api-access-lmxjw major:0 minor:263 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ccf93b8e-80a1-4ae6-9d4e-643760607116/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/ccf93b8e-80a1-4ae6-9d4e-643760607116/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config major:0 minor:257 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ccf93b8e-80a1-4ae6-9d4e-643760607116/volumes/kubernetes.io~secret/prometheus-operator-tls:{mountpoint:/var/lib/kubelet/pods/ccf93b8e-80a1-4ae6-9d4e-643760607116/volumes/kubernetes.io~secret/prometheus-operator-tls major:0 minor:262 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e8cce0a3-8ffd-465e-8b77-d386fba907b5/volumes/kubernetes.io~projected/kube-api-access-4rh8m:{mountpoint:/var/lib/kubelet/pods/e8cce0a3-8ffd-465e-8b77-d386fba907b5/volumes/kubernetes.io~projected/kube-api-access-4rh8m major:0 minor:363 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e8cce0a3-8ffd-465e-8b77-d386fba907b5/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/e8cce0a3-8ffd-465e-8b77-d386fba907b5/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:359 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e8cce0a3-8ffd-465e-8b77-d386fba907b5/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/e8cce0a3-8ffd-465e-8b77-d386fba907b5/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:358 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e8cce0a3-8ffd-465e-8b77-d386fba907b5/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/e8cce0a3-8ffd-465e-8b77-d386fba907b5/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:360 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f678b061-520c-474f-b4ab-7e5e6949100e/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/f678b061-520c-474f-b4ab-7e5e6949100e/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f678b061-520c-474f-b4ab-7e5e6949100e/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/f678b061-520c-474f-b4ab-7e5e6949100e/volumes/kubernetes.io~empty-dir/tmp major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f678b061-520c-474f-b4ab-7e5e6949100e/volumes/kubernetes.io~projected/kube-api-access-wrpdw:{mountpoint:/var/lib/kubelet/pods/f678b061-520c-474f-b4ab-7e5e6949100e/volumes/kubernetes.io~projected/kube-api-access-wrpdw major:0 minor:64 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/51b953954be78badf1cb95f38e62c0899195cd12d85d85acfb1b05f98d50b1e7/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/27ec20fb78a8c3c67cc25906420ffb21f3959117b02df9ca012b2fba8fedd0f9/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/c6426caa281bea0824256cb8bc6c1b2de169ee810783ac3266d0ee897fca4c94/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/d48d13609a01dcb2f06780a55160f581888d82ea017a475029e6bbca1d744664/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-111:{mountpoint:/var/lib/containers/storage/overlay/d8cccb2243c9143a32730af4e2c3425179d456de770c62f9844cd18586a84ba3/merged major:0 minor:111 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/398c330f2d09a812a468a59d14178e426148518848e68402114d72bac662f4ba/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/6ced942fa1ea2d61d9bc07c9e60e6fafb86adaccf0dfe6c1f8e94644fc6a9e67/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/7035a4f0da502787bc4c9f2219bf914da5f1db6c3509f9d1371c8501c558fa71/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/a7ca35f1c41127e9076240315e50689184c527c20438b0fbb8b222b09d90bd61/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-133:{mountpoint:/var/lib/containers/storage/overlay/276f53931d18a81162fb799860b4e04a2ffafd4f8b242fa3f66d80a8d267d829/merged major:0 minor:133 fsType:overlay blockSize:0} overlay_0-143:{mountpoint:/var/lib/containers/storage/overlay/bb88f3a36236ad25e1ed6d75bb1385208818fbc4a6b16474e7f309977c712207/merged major:0 minor:143 fsType:overlay blockSize:0} overlay_0-146:{mountpoint:/var/lib/containers/storage/overlay/0e8135d0863e3509521a5960de3bac4b78ee6a0f45ad98266750336d9aba9efb/merged major:0 minor:146 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/526022c1a7c966fedcf0ccfa4959b726d470999c33f517f4b54b004a98e1061b/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/9864a39116ffc6400b29aa2861b4cce3a12a63421c6ac6754101afda672743f8/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/dea8366da16435353a6212960cd9eb9cc8f57aca325e64a152f211e773e0baac/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/7a319f1b0889f2308e8e17ac3ec8af6257fdf364908245b29b5b47914d5af312/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/c34d441fb6e169fb341510d86a5abb4f873b02cba8b20941227c61e03f1fecc0/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/2a4ae272ae2ab56fe0b6b1af73eaafa50a02df331388fedf2789e8ea2951814e/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/2a812d2dfe5afea332f92e6048e055c2660360b556a937a2c57dfc0048b5f318/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-184:{mountpoint:/var/lib/containers/storage/overlay/b421f8e9d4a686c274b9841f90f3fe0b265eb2a0dd31d4ab87e47f45882b6e9f/merged major:0 minor:184 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/6f286357a4e55c1437e05ba1ba570ade2da699453b515d074b7c544956719379/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-214:{mountpoint:/var/lib/containers/storage/overlay/2018a6a7bb826c34fcb8ffde021f3d2b2a4a27fd9f47606c78c66e5c63857d78/merged major:0 minor:214 fsType:overlay blockSize:0} overlay_0-216:{mountpoint:/var/lib/containers/storage/overlay/26ccded0bede726b90deae117fbffaf1b3e8135748bc84bd592874ca1d15a7df/merged major:0 minor:216 fsType:overlay blockSize:0} overlay_0-218:{mountpoint:/var/lib/containers/storage/overlay/9e4202abbae7411f39b608577d0834860cee1d8c7bcd29d033c85e95011977cd/merged major:0 minor:218 fsType:overlay blockSize:0} overlay_0-220:{mountpoint:/var/lib/containers/storage/overlay/0a0f38598b8083452a5ff289f0b290fa0968f4a19c2b115a12cc3e27e03bc304/merged major:0 minor:220 fsType:overlay blockSize:0} overlay_0-222:{mountpoint:/var/lib/containers/storage/overlay/eb47472b0df3021a8faca602011c66aad9d7616ee2fe9e415be84a5903f92bd1/merged major:0 minor:222 fsType:overlay blockSize:0} overlay_0-228:{mountpoint:/var/lib/containers/storage/overlay/3f4e4183fb06d987b64379441a1ebbb454c298f42367c93e7816d7ff1676f586/merged major:0 minor:228 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/3736d9f23c1d63cedd7cc8274136ecd33052a766b1e5584c7e14e6c64dc08a8c/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-235:{mountpoint:/var/lib/containers/storage/overlay/1ab59fc5a06dd6149fd3702fc31b2aa75a97339d3dcb2d226f8009d312a58267/merged major:0 minor:235 fsType:overlay blockSize:0} overlay_0-241:{mountpoint:/var/lib/containers/storage/overlay/7a24bebccd0e9508d65ea7e71cd0daa1d37d1a674d71abc35f9d9d6eca19756a/merged major:0 minor:241 fsType:overlay blockSize:0} overlay_0-247:{mountpoint:/var/lib/containers/storage/overlay/8d18a90d6e4568d5c0920c8cfaeed79ca7e907adef374ee0b6aa6523151c853b/merged major:0 minor:247 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/f1d2c0b9b235ff8e76c05b437150d809e29e48489e95d15f38e10730a34899dc/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/f713eb9460b02dba7021112b224e38f347c97aee124a4484dde4c676d84dfcc7/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-268:{mountpoint:/var/lib/containers/storage/overlay/af40668d4afdf316f2ee89cbd385769c465c53e881746903205f97cd50888362/merged major:0 minor:268 fsType:overlay blockSize:0} overlay_0-270:{mountpoint:/var/lib/containers/storage/overlay/edf134b9d8b0d4ed77f7d6fc1bb38a1f967f0c32c4af148aff2aeea94fd8835b/merged major:0 minor:270 fsType:overlay blockSize:0} overlay_0-294:{mountpoint:/var/lib/containers/storage/overlay/74bb752b9c004309e43e7b79f357454fb642a4263e014fccd8c156650a2930b5/merged major:0 minor:294 fsType:overlay blockSize:0} overlay_0-296:{mountpoint:/var/lib/containers/storage/overlay/1190bba6017c5861dad1d9c3d0439b1e81f1cc4bb9a6c164e0988b55b9691a31/merged major:0 minor:296 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/e014780227c347757e2529a8f6cfd35926f0138930acf3c0389a8239a2063823/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/220487169a0e1d0df7410effbed5b4ff22aa541c7f58c13153e20c7ae0beb749/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-306:{mountpoint:/var/lib/containers/storage/overlay/83d891c370da3acd4fd2d449e05ad9dce63ff34dcd1fadd335cd14032f5aecf7/merged major:0 minor:306 fsType:overlay blockSize:0} overlay_0-310:{mountpoint:/var/lib/containers/storage/overlay/2c2c47be2e7ccee9cc6210c42aac2dbc091c6b65198dde217f8a375beb14cfcc/merged major:0 minor:310 fsType:overlay blockSize:0} overlay_0-328:{mountpoint:/var/lib/containers/storage/overlay/31c8c57242feb8fa42db355ef06b64f554dfe3bad3f1bf83df6cfd27d6e6b373/merged major:0 minor:328 fsType:overlay blockSize:0} overlay_0-330:{mountpoint:/var/lib/containers/storage/overlay/3a271b70d7deba986f688a9249e2e28d09e65a9d115a837b4b92fa6bc31d8f54/merged major:0 minor:330 fsType:overlay blockSize:0} overlay_0-336:{mountpoint:/var/lib/containers/storage/overlay/2d180c904b7f4a1d23c5385472eac842712bf5d2228bf5bfec05567bf72f74e6/merged major:0 minor:336 fsType:overlay blockSize:0} overlay_0-341:{mountpoint:/var/lib/containers/storage/overlay/faad83c80b741d3b08b20f1ee36a8dfd0ae86a939ab6c53f7094ccd2b6ad81f0/merged major:0 minor:341 fsType:overlay blockSize:0} overlay_0-346:{mountpoint:/var/lib/containers/storage/overlay/c91b680c78c8f2961cf9fb32bb909f7c18caafb090bf388c335eb422090b101c/merged major:0 minor:346 fsType:overlay blockSize:0} overlay_0-355:{mountpoint:/var/lib/containers/storage/overlay/eb9e3a95d22d43b803919575dd892701db4c90fb89bb88f86f848ad7042f424e/merged major:0 minor:355 fsType:overlay blockSize:0} overlay_0-366:{mountpoint:/var/lib/containers/storage/overlay/b3d32c835cc4887f843a40a3d384d8e861269e5a0e362f9f0613a3e6d9e2945c/merged major:0 minor:366 fsType:overlay blockSize:0} overlay_0-368:{mountpoint:/var/lib/containers/storage/overlay/a0bbe32b314746c231373bdb5e8eea1efc1df4258f428ca955c8187ca1a1c467/merged major:0 minor:368 fsType:overlay blockSize:0} overlay_0-370:{mountpoint:/var/lib/containers/storage/overlay/653887c595bdece0762c5650bdfdede930747bf3167bbca9edaedf6aac43a1f2/merged major:0 minor:370 fsType:overlay blockSize:0} overlay_0-372:{mountpoint:/var/lib/containers/storage/overlay/4286c77bc29cf67ff8dd1ce3dacc0fdb98a8171845d051d4f8590abe68f57a0e/merged major:0 minor:372 fsType:overlay blockSize:0} overlay_0-378:{mountpoint:/var/lib/containers/storage/overlay/4f832f2f08b9cfb9f2ed3749fa14214dc5c3f581c2b1d1168b4ab169fd1e2f20/merged major:0 minor:378 fsType:overlay blockSize:0} overlay_0-380:{mountpoint:/var/lib/containers/storage/overlay/73e07f2da77f5839d8bcc9e372e00bae58551c3bc15545a08d9649bc609af21d/merged major:0 minor:380 fsType:overlay blockSize:0} overlay_0-389:{mountpoint:/var/lib/containers/storage/overlay/580ac33bfc1fe2a4852570ae2f4767a95bb1fb5babcd719b5fcca1aa52982755/merged major:0 minor:389 fsType:overlay blockSize:0} overlay_0-394:{mountpoint:/var/lib/containers/storage/overlay/5bd75e89eeee8edbda121665fc717bb32f33836e2ddbee0cb6609200923dd752/merged major:0 minor:394 fsType:overlay blockSize:0} overlay_0-399:{mountpoint:/var/lib/containers/storage/overlay/1a314a2000909e23edf9bf46902c36c216a4fca497f98c34ebb616153657bde7/merged major:0 minor:399 fsType:overlay blockSize:0} overlay_0-417:{mountpoint:/var/lib/containers/storage/overlay/05387065f714256fafd0774b09a589b323bc5b99ab004df2894f29401b281369/merged major:0 minor:417 fsType:overlay blockSize:0} overlay_0-419:{mountpoint:/var/lib/containers/storage/overlay/a0b5785cc7f5d12b46937229adc43ee3e12843e788054233a154766cac1c597f/merged major:0 minor:419 fsType:overlay blockSize:0} overlay_0-421:{mountpoint:/var/lib/containers/storage/overlay/74f294e4fa69da4356de0f6478b5bbcfaf8304efed4b2c842b3d292fd472faf1/merged major:0 minor:421 fsType:overlay blockSize:0} overlay_0-423:{mountpoint:/var/lib/containers/storage/overlay/172edf0731eb2c4b7d71ce9a9314c75d41db89b325bfb4d0b8667416587be128/merged major:0 minor:423 fsType:overlay blockSize:0} overlay_0-431:{mountpoint:/var/lib/containers/storage/overlay/369a3431dcab9b9d8eebb15153a3f819d84676b73f1eabd63f33cc409b361d0a/merged major:0 minor:431 fsType:overlay blockSize:0} overlay_0-447:{mountpoint:/var/lib/containers/storage/overlay/1997ff9ef2a8e904e680309bf1582235e9f35eb4534e36f508dff475ebe98368/merged major:0 minor:447 fsType:overlay blockSize:0} overlay_0-449:{mountpoint:/var/lib/containers/storage/overlay/34068ae837ca5cebeb112f5686f15cb7f340c674ab6f6c38b4247ea2885867ba/merged major:0 minor:449 fsType:overlay blockSize:0} overlay_0-455:{mountpoint:/var/lib/containers/storage/overlay/a813767491ce7c7baefde625eb6b47b72944546526634ff4adaafbae47f61e91/merged major:0 minor:455 fsType:overlay blockSize:0} overlay_0-459:{mountpoint:/var/lib/containers/storage/overlay/1ad6bc6ed7913d4bf318c890fba868181863a657004b0cf6c80418222e2aca68/merged major:0 minor:459 fsType:overlay blockSize:0} overlay_0-462:{mountpoint:/var/lib/containers/storage/overlay/4f3570837e25da94964b6f23be68fca4b850fd1f718821353294df3ca8b2c740/merged major:0 minor:462 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/7f045e9c1257f8528612389652a1185e7e263374b8d31b46455101353ba9619e/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/7d45adcf015962fda3fae88bbf6a81cbc4d8ab250223310d597842533d8ce0d3/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-71:{mountpoint:/var/lib/containers/storage/overlay/6ebac3c4858cef7126ce890fa18f73d48121c0326152361be9cf8dbc721c3b3a/merged major:0 minor:71 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/9f667204103fe4fc38da7cd077013dbf8372be07cdd7f0c5359abe74c7e0cf91/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-79:{mountpoint:/var/lib/containers/storage/overlay/462390c5b95374f4f4268fb2d87f95ae9b4d022af78a3969e450dc54271b2050/merged major:0 minor:79 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/880a3152eafed7b21d36757f9f06e9bdb87d624a73a8c56aede54bdbfaa98688/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/b7d7839c816cc36a40674acfb1f15b5e78414f1aa735411c57cc572a56fe85da/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/16bf633f29645b421623c310fe839fb39c170a2a585b8d21b348f14f11768efb/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-94:{mountpoint:/var/lib/containers/storage/overlay/778e6ffe1d65c51736b17dbc46f3dfd586447b20155618812f2a1e40d43ff495/merged major:0 minor:94 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/d8047f5ad3afb12321c109577e2bdca8655b064630c35ba9940c24c0804d0046/merged major:0 minor:96 fsType:overlay blockSize:0}] Nov 04 05:50:00.938643 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.937118 5784 manager.go:217] Machine: {Timestamp:2026-11-04 05:50:00.936498043 +0000 UTC m=+0.073194439 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100451 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20f35966886088e35dbe1094bb6a2f SystemUUID:ec20f359-6688-6088-e35d-be1094bb6a2f BootID:77ea3b13-f997-4b86-8dba-71d36c51056d Filesystems:[{Device:overlay_0-399 DeviceMajor:0 DeviceMinor:399 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/50986f63cea9bb5f61995667a88c6f2fa90b6a533101e17451da766c8ceb46f3/userdata/shm DeviceMajor:0 DeviceMinor:81 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-222 DeviceMajor:0 DeviceMinor:222 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:404 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:437 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-459 DeviceMajor:0 DeviceMinor:459 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3b41e530-bd50-4905-8887-32286cfdedbf/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:285 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:320 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-378 DeviceMajor:0 DeviceMinor:378 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/config DeviceMajor:0 DeviceMinor:433 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:436 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-447 DeviceMajor:0 DeviceMinor:447 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-449 DeviceMajor:0 DeviceMinor:449 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-462 DeviceMajor:0 DeviceMinor:462 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/206b2e75-0735-49df-a53c-bdd17aab8ae6/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/63258d2f-36fe-483c-9d98-fefeffd43533/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0742c411-7597-48ae-a35d-82a7d69fafdb/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-346 DeviceMajor:0 DeviceMinor:346 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/206b2e75-0735-49df-a53c-bdd17aab8ae6/volumes/kubernetes.io~projected/kube-api-access-hcqrv DeviceMajor:0 DeviceMinor:66 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bcd87f2907c350ed1f0aadfa0da8f8c196fbe9f4bb2919547ca83becc31c6985/userdata/shm DeviceMajor:0 DeviceMinor:411 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-423 DeviceMajor:0 DeviceMinor:423 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f678b061-520c-474f-b4ab-7e5e6949100e/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:62 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0742c411-7597-48ae-a35d-82a7d69fafdb/volumes/kubernetes.io~projected/kube-api-access-z8fdz DeviceMajor:0 DeviceMinor:204 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/8c71ae38-62e0-4de3-9cf9-c4ee58edd96a/volumes/kubernetes.io~secret/tls-certificates DeviceMajor:0 DeviceMinor:211 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-235 DeviceMajor:0 DeviceMinor:235 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ccf93b8e-80a1-4ae6-9d4e-643760607116/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:257 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-270 DeviceMajor:0 DeviceMinor:270 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6bde7db4-687a-4dcb-b490-2f88e2e4ea71/volumes/kubernetes.io~projected/kube-api-access-48twm DeviceMajor:0 DeviceMinor:410 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/59bf3884-8cc8-4a80-a064-470c85186dda/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2bc8ee82-0a82-4157-99b0-53360f1cd919/volumes/kubernetes.io~projected/kube-api-access-5wx9c DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2b09245e3ed95759d032b02dffced1eade477eb95cc522e71d7c62caacb272f3/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/124a28d1-9d05-42d1-99d4-721942b23062/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:276 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8bed2f9549b8e49a6cca67ac84190819a2eac0574bcc7dfc649dcda99e8cad92/userdata/shm DeviceMajor:0 DeviceMinor:429 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1d38f8e2f93226f6cb3c4bedb1db12059b988f24e6f6413aa97d2028c7db5b2f/userdata/shm DeviceMajor:0 DeviceMinor:212 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-218 DeviceMajor:0 DeviceMinor:218 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3b41e530-bd50-4905-8887-32286cfdedbf/volumes/kubernetes.io~projected/kube-api-access-nfhg5 DeviceMajor:0 DeviceMinor:288 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:323 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:320 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-389 DeviceMajor:0 DeviceMinor:389 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:318 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:439 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7f227a09-ac46-4ab4-85db-cf57670ae3c1/volumes/kubernetes.io~projected/kube-api-access-44hld DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/623b03da3fb7c889ae6d19eaa905cc6a601e2efc209a6e691b9e998e1c5d9e11/userdata/shm DeviceMajor:0 DeviceMinor:69 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ccf93b8e-80a1-4ae6-9d4e-643760607116/volumes/kubernetes.io~secret/prometheus-operator-tls DeviceMajor:0 DeviceMinor:262 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~projected/kube-api-access-nst9j DeviceMajor:0 DeviceMinor:444 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bc7e49420dda09f988b8df21ba90c69fa996b0633c7c9af4bc14027b257bf4a5/userdata/shm DeviceMajor:0 DeviceMinor:88 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-355 DeviceMajor:0 DeviceMinor:355 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/32a03eca3efac02dd990719640a77603f8fd42784a5d827b73cb4101d30bd356/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-111 DeviceMajor:0 DeviceMinor:111 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/63258d2f-36fe-483c-9d98-fefeffd43533/volumes/kubernetes.io~projected/kube-api-access-ljlvq DeviceMajor:0 DeviceMinor:202 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-220 DeviceMajor:0 DeviceMinor:220 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/124a28d1-9d05-42d1-99d4-721942b23062/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:280 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-421 DeviceMajor:0 DeviceMinor:421 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-228 DeviceMajor:0 DeviceMinor:228 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/eb615e71882ee05bb30a724fb0cd0ab0a4d40b9401bb75cf7945d32ef2a3300d/userdata/shm DeviceMajor:0 DeviceMinor:264 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:322 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/secret-metrics-client-certs DeviceMajor:0 DeviceMinor:441 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:442 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a956a93b-8cf1-45ad-bcbf-409e331a02d1/volumes/kubernetes.io~projected/kube-api-access-fjfjp DeviceMajor:0 DeviceMinor:203 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3b41e530-bd50-4905-8887-32286cfdedbf/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:282 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a9525137-701e-46b7-8582-322cd59aaf48/volumes/kubernetes.io~projected/kube-api-access-nkggn DeviceMajor:0 DeviceMinor:357 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a965dd43-4908-4a6a-9b2a-f3dc0590020e/volumes/kubernetes.io~projected/kube-api-access-dg7t8 DeviceMajor:0 DeviceMinor:425 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/secret-kube-rbac-proxy DeviceMajor:0 DeviceMinor:438 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/34a6ce100bb4dbad797d44b391da8ba21a9ee9f45fc3d51cf1a3675b34f178e8/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/f678b061-520c-474f-b4ab-7e5e6949100e/volumes/kubernetes.io~projected/kube-api-access-wrpdw DeviceMajor:0 DeviceMinor:64 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc/volumes/kubernetes.io~projected/kube-api-access-dxkfl DeviceMajor:0 DeviceMinor:67 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-184 DeviceMajor:0 DeviceMinor:184 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:321 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:443 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-133 DeviceMajor:0 DeviceMinor:133 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/807edbb8-055e-4796-b4dd-b254a93313f6/volumes/kubernetes.io~projected/kube-api-access-xpvdq DeviceMajor:0 DeviceMinor:289 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-328 DeviceMajor:0 DeviceMinor:328 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f14fa1521bab7cd19bbd391605e9a73ddcf336ec685a2203d87653121e1ca2b4/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5af322646aa3d249aee8d87d5b897d8f01e333498eeb2b18efc4dd385bc2855f/userdata/shm DeviceMajor:0 DeviceMinor:413 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-455 DeviceMajor:0 DeviceMinor:455 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-268 DeviceMajor:0 DeviceMinor:268 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-296 DeviceMajor:0 DeviceMinor:296 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-419 DeviceMajor:0 DeviceMinor:419 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-431 DeviceMajor:0 DeviceMinor:431 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls DeviceMajor:0 DeviceMinor:435 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-241 DeviceMajor:0 DeviceMinor:241 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/124a28d1-9d05-42d1-99d4-721942b23062/volumes/kubernetes.io~projected/kube-api-access-mtt5b DeviceMajor:0 DeviceMinor:281 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/237e2f40-006a-4b40-aa3e-6d0d05295e6d/volumes/kubernetes.io~projected/kube-api-access-kbrdw DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-214 DeviceMajor:0 DeviceMinor:214 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-294 DeviceMajor:0 DeviceMinor:294 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-310 DeviceMajor:0 DeviceMinor:310 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c6d5d696cce085b262640af2bcdf3f34ea286ed770e40988c5dbee5ae7c7d22d/userdata/shm DeviceMajor:0 DeviceMinor:326 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/635418a3-d2fd-4dcc-8893-8488f45988c0/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:409 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9040211da883859f068fa3b6ca8e2100a5f4fe83476d3e06bd1ca9c79a85e51e/userdata/shm DeviceMajor:0 DeviceMinor:415 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8eb39cf29ab7476d1d8bde56c93f41de6aa848f51f0b835ec286fd847ddfd8a5/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-306 DeviceMajor:0 DeviceMinor:306 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:324 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:321 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-380 DeviceMajor:0 DeviceMinor:380 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a396ba5736233f1901d46140af01c70266994f35bea8f5955343ec8467a9d7ab/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~projected/kube-api-access-4fldv DeviceMajor:0 DeviceMinor:325 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/947312d04ab16fffbf256934ca093dc2ff8dc342e406b87874751e2faa1a43de/userdata/shm DeviceMajor:0 DeviceMinor:290 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0367a099754e6a89c49e94e75bbb15f99f7c47afd13b44f320d68b06c22ad3cb/userdata/shm DeviceMajor:0 DeviceMinor:292 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-330 DeviceMajor:0 DeviceMinor:330 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-366 DeviceMajor:0 DeviceMinor:366 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-368 DeviceMajor:0 DeviceMinor:368 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:321 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f/volumes/kubernetes.io~projected/kube-api-access-n6jqz DeviceMajor:0 DeviceMinor:60 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4027b35de7271b28780d267b8e7996d75c315673757540daf62148a80743a6da/userdata/shm DeviceMajor:0 DeviceMinor:445 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-216 DeviceMajor:0 DeviceMinor:216 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/807edbb8-055e-4796-b4dd-b254a93313f6/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:284 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e8cce0a3-8ffd-465e-8b77-d386fba907b5/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:358 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volume-subpaths/web-config/init-config-reloader/2 DeviceMajor:0 DeviceMinor:443 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-94 DeviceMajor:0 DeviceMinor:94 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ccf93b8e-80a1-4ae6-9d4e-643760607116/volumes/kubernetes.io~projected/kube-api-access-lmxjw DeviceMajor:0 DeviceMinor:263 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/807edbb8-055e-4796-b4dd-b254a93313f6/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:283 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-336 DeviceMajor:0 DeviceMinor:336 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e8cce0a3-8ffd-465e-8b77-d386fba907b5/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:360 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-417 DeviceMajor:0 DeviceMinor:417 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5dadf5f9-5bb9-4652-9d12-c4f17d327528/volumes/kubernetes.io~projected/kube-api-access-5tlhk DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8c1dc9ece389634bcb19fbf5d6bf13066353cd2ab4b25119f62a84b19485ceb0/userdata/shm DeviceMajor:0 DeviceMinor:77 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-247 DeviceMajor:0 DeviceMinor:247 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-341 DeviceMajor:0 DeviceMinor:341 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/151a666b9f40880998e6d75692b5811a00562228672a6c082d0f1dc5ed47a05b/userdata/shm DeviceMajor:0 DeviceMinor:364 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls DeviceMajor:0 DeviceMinor:434 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file DeviceMajor:0 DeviceMinor:440 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-71 DeviceMajor:0 DeviceMinor:71 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2ac8cbdb3dd8d88f9cb85e2e857897daf971faae2aa2fb6bce19a180506fd10b/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/206b2e75-0735-49df-a53c-bdd17aab8ae6/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:61 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/59576fa1bb34c8f7627eacf1552499708c21a069a8c0945aae0223492bb17af7/userdata/shm DeviceMajor:0 DeviceMinor:286 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-370 DeviceMajor:0 DeviceMinor:370 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:313 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:321 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a9525137-701e-46b7-8582-322cd59aaf48/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:351 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e8cce0a3-8ffd-465e-8b77-d386fba907b5/volumes/kubernetes.io~projected/kube-api-access-4rh8m DeviceMajor:0 DeviceMinor:363 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-394 DeviceMajor:0 DeviceMinor:394 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a956a93b-8cf1-45ad-bcbf-409e331a02d1/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:317 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:319 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4435416caffc8da3d173f24d06308c1332679baaee17b9f9a385eade822318c5/userdata/shm DeviceMajor:0 DeviceMinor:92 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/dc72ae2f62b98449fa1adf7cba30a5346084c61fc6d55bdc95fec98330fe640b/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-143 DeviceMajor:0 DeviceMinor:143 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e8cce0a3-8ffd-465e-8b77-d386fba907b5/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:359 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f678b061-520c-474f-b4ab-7e5e6949100e/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:63 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/bcf9e13b-7029-4567-85b8-4d53bca32fef/volumes/kubernetes.io~projected/kube-api-access-w44fz DeviceMajor:0 DeviceMinor:65 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-79 DeviceMajor:0 DeviceMinor:79 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-146 DeviceMajor:0 DeviceMinor:146 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9627133d301f4d5b0c74c2e5f7d998369a9346ccf683c23b8f3c93d66935332b/userdata/shm DeviceMajor:0 DeviceMinor:361 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-372 DeviceMajor:0 DeviceMinor:372 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:151a666b9f40880 MacAddress:72:3b:6e:34:67:94 Speed:10000 Mtu:8901} {Name:1d38f8e2f93226f MacAddress:32:62:0f:71:cb:bd Speed:10000 Mtu:8901} {Name:2ac8cbdb3dd8d88 MacAddress:fa:27:f5:8e:7d:27 Speed:10000 Mtu:8901} {Name:34a6ce100bb4dba MacAddress:02:eb:f6:1e:ca:2b Speed:10000 Mtu:8901} {Name:4027b35de7271b2 MacAddress:e6:ff:c1:35:02:27 Speed:10000 Mtu:8901} {Name:59576fa1bb34c8f MacAddress:ae:f9:ba:64:d7:b7 Speed:10000 Mtu:8901} {Name:5af322646aa3d24 MacAddress:86:aa:16:3f:fd:14 Speed:10000 Mtu:8901} {Name:8bed2f9549b8e49 MacAddress:0e:64:58:d3:4c:d9 Speed:10000 Mtu:8901} {Name:9040211da883859 MacAddress:aa:d2:d6:3d:48:40 Speed:10000 Mtu:8901} {Name:947312d04ab16ff MacAddress:d2:56:f1:e0:1c:67 Speed:10000 Mtu:8901} {Name:9627133d301f4d5 MacAddress:56:2a:b0:09:20:f0 Speed:10000 Mtu:8901} {Name:bcd87f2907c350e MacAddress:fa:cc:27:0e:57:4b Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:31:99:18:5f:f9 Speed:0 Mtu:9001} {Name:br-int MacAddress:da:8e:5f:c7:98:66 Speed:0 Mtu:8901} {Name:c6d5d696cce085b MacAddress:96:85:15:d2:f0:bc Speed:10000 Mtu:8901} {Name:eb615e71882ee05 MacAddress:3a:ce:a8:da:86:f2 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:31:99:18:5f:f9 Speed:0 Mtu:9001} {Name:f14fa1521bab7cd MacAddress:26:f1:92:4a:5c:e1 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:3e:40:d5:70:1c:27 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:b2:8f:7e:49:ba:4a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 04 05:50:00.938643 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.937660 5784 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 04 05:50:00.938643 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.937718 5784 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 04 05:50:00.938643 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.938026 5784 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 04 05:50:00.938643 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.938048 5784 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-45.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 04 05:50:00.938643 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.938226 5784 topology_manager.go:143] "Creating topology manager with none policy" Nov 04 05:50:00.938643 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.938235 5784 container_manager_linux.go:311] "Creating device plugin manager" Nov 04 05:50:00.938643 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.938249 5784 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 05:50:00.938643 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.938264 5784 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 05:50:00.938643 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.938348 5784 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 04 05:50:00.938643 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.938563 5784 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 04 05:50:00.939381 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.938685 5784 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 04 05:50:00.939381 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.938733 5784 kubelet.go:493] "Attempting to sync node with API server" Nov 04 05:50:00.939381 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.938747 5784 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 04 05:50:00.939381 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.938760 5784 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 04 05:50:00.939381 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.938773 5784 kubelet.go:405] "Adding apiserver pod source" Nov 04 05:50:00.939381 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.938785 5784 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 04 05:50:00.939744 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.939725 5784 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 04 05:50:00.939744 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.939744 5784 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 05:50:00.940285 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.940265 5784 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 04 05:50:00.960571 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.960547 5784 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 04 05:50:00.960571 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.960569 5784 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 05:50:00.960776 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.960694 5784 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Nov 04 05:50:00.960903 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.960888 5784 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 04 05:50:00.960959 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.960925 5784 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 04 05:50:00.961052 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.961041 5784 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 04 05:50:00.961116 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.961056 5784 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 04 05:50:00.961116 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.961080 5784 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 04 05:50:00.961116 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.961087 5784 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 04 05:50:00.961116 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.961093 5784 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 04 05:50:00.961116 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.961099 5784 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 04 05:50:00.961116 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.961105 5784 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 04 05:50:00.961116 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.961111 5784 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 04 05:50:00.961116 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.961118 5784 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 04 05:50:00.961481 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.961124 5784 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 04 05:50:00.961481 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.961133 5784 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 04 05:50:00.961481 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.961144 5784 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 04 05:50:00.961481 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.961168 5784 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 04 05:50:00.961481 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.961175 5784 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 04 05:50:00.964967 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.964952 5784 server.go:1263] "Started kubelet" Nov 04 05:50:00.965109 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.965030 5784 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 04 05:50:00.965163 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.965092 5784 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 04 05:50:00.965227 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.965170 5784 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 04 05:50:00.965628 ip-10-0-134-45 systemd[1]: Started Kubernetes Kubelet. Nov 04 05:50:00.965731 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.965646 5784 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 04 05:50:00.966607 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.966346 5784 server.go:317] "Adding debug handlers to kubelet server" Nov 04 05:50:00.970048 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.970029 5784 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 04 05:50:00.970895 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.970052 5784 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 04 05:50:00.970895 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.970146 5784 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 04 05:50:00.970895 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.970156 5784 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 04 05:50:00.970895 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.970131 5784 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 05:43:48 +0000 UTC" deadline="2028-07-15 16:06:53.444434284 +0000 UTC" Nov 04 05:50:00.970895 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.970198 5784 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14866h16m52.474239921s" Nov 04 05:50:00.970895 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:00.970172 5784 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-45.us-west-1.compute.internal\" not found" Nov 04 05:50:00.970895 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.970261 5784 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 04 05:50:00.971716 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.971204 5784 factory.go:55] Registering systemd factory Nov 04 05:50:00.971716 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.971222 5784 factory.go:223] Registration of the systemd container factory successfully Nov 04 05:50:00.971716 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.971516 5784 factory.go:153] Registering CRI-O factory Nov 04 05:50:00.971716 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.971531 5784 factory.go:223] Registration of the crio container factory successfully Nov 04 05:50:00.971874 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.971857 5784 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 04 05:50:00.971926 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.971894 5784 factory.go:103] Registering Raw factory Nov 04 05:50:00.971926 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.971917 5784 manager.go:1199] Started watching for new ooms in manager Nov 04 05:50:00.973364 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.972350 5784 manager.go:319] Starting recovery of all containers Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978448 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" volumeName="kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-web-config" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978492 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0742c411-7597-48ae-a35d-82a7d69fafdb" volumeName="kubernetes.io/configmap/0742c411-7597-48ae-a35d-82a7d69fafdb-kube-rbac-proxy-cm" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978501 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" volumeName="kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-metrics-client-certs" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978509 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" volumeName="kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-kube-rbac-proxy" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978516 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="807edbb8-055e-4796-b4dd-b254a93313f6" volumeName="kubernetes.io/empty-dir/807edbb8-055e-4796-b4dd-b254a93313f6-volume-directive-shadow" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978523 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" volumeName="kubernetes.io/projected/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-kube-api-access-n6jqz" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978531 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bcf9e13b-7029-4567-85b8-4d53bca32fef" volumeName="kubernetes.io/configmap/bcf9e13b-7029-4567-85b8-4d53bca32fef-iptables-alerter-script" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978539 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f678b061-520c-474f-b4ab-7e5e6949100e" volumeName="kubernetes.io/empty-dir/f678b061-520c-474f-b4ab-7e5e6949100e-tmp" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978549 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="118d5d6d-e2b1-483f-a184-504325584502" volumeName="kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-config-volume" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978557 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="124a28d1-9d05-42d1-99d4-721942b23062" volumeName="kubernetes.io/secret/124a28d1-9d05-42d1-99d4-721942b23062-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978565 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="124a28d1-9d05-42d1-99d4-721942b23062" volumeName="kubernetes.io/secret/124a28d1-9d05-42d1-99d4-721942b23062-openshift-state-metrics-tls" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978572 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2bc8ee82-0a82-4157-99b0-53360f1cd919" volumeName="kubernetes.io/projected/2bc8ee82-0a82-4157-99b0-53360f1cd919-kube-api-access-5wx9c" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978581 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" volumeName="kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-2" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978589 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="807edbb8-055e-4796-b4dd-b254a93313f6" volumeName="kubernetes.io/configmap/807edbb8-055e-4796-b4dd-b254a93313f6-metrics-client-ca" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978600 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8c71ae38-62e0-4de3-9cf9-c4ee58edd96a" volumeName="kubernetes.io/secret/8c71ae38-62e0-4de3-9cf9-c4ee58edd96a-tls-certificates" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978607 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a9525137-701e-46b7-8582-322cd59aaf48" volumeName="kubernetes.io/projected/a9525137-701e-46b7-8582-322cd59aaf48-kube-api-access-nkggn" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978615 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3b41e530-bd50-4905-8887-32286cfdedbf" volumeName="kubernetes.io/configmap/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-accelerators-collector-config" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978624 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="635418a3-d2fd-4dcc-8893-8488f45988c0" volumeName="kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978632 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ccf93b8e-80a1-4ae6-9d4e-643760607116" volumeName="kubernetes.io/projected/ccf93b8e-80a1-4ae6-9d4e-643760607116-kube-api-access-lmxjw" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978640 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0742c411-7597-48ae-a35d-82a7d69fafdb" volumeName="kubernetes.io/secret/0742c411-7597-48ae-a35d-82a7d69fafdb-insights-runtime-extractor-tls" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978647 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="118d5d6d-e2b1-483f-a184-504325584502" volumeName="kubernetes.io/configmap/118d5d6d-e2b1-483f-a184-504325584502-metrics-client-ca" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978655 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="206b2e75-0735-49df-a53c-bdd17aab8ae6" volumeName="kubernetes.io/configmap/206b2e75-0735-49df-a53c-bdd17aab8ae6-ovnkube-script-lib" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978664 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="237e2f40-006a-4b40-aa3e-6d0d05295e6d" volumeName="kubernetes.io/projected/237e2f40-006a-4b40-aa3e-6d0d05295e6d-kube-api-access-kbrdw" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978672 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3b41e530-bd50-4905-8887-32286cfdedbf" volumeName="kubernetes.io/projected/3b41e530-bd50-4905-8887-32286cfdedbf-kube-api-access-nfhg5" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978681 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5dadf5f9-5bb9-4652-9d12-c4f17d327528" volumeName="kubernetes.io/empty-dir/5dadf5f9-5bb9-4652-9d12-c4f17d327528-tmp-dir" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978701 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5dadf5f9-5bb9-4652-9d12-c4f17d327528" volumeName="kubernetes.io/projected/5dadf5f9-5bb9-4652-9d12-c4f17d327528-kube-api-access-5tlhk" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978710 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" volumeName="kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-grpc-tls" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978717 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" volumeName="kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-serving-certs-ca-bundle" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978735 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" volumeName="kubernetes.io/empty-dir/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-config-out" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978755 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="206b2e75-0735-49df-a53c-bdd17aab8ae6" volumeName="kubernetes.io/projected/206b2e75-0735-49df-a53c-bdd17aab8ae6-kube-api-access-hcqrv" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978768 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2bc8ee82-0a82-4157-99b0-53360f1cd919" volumeName="kubernetes.io/configmap/2bc8ee82-0a82-4157-99b0-53360f1cd919-cni-binary-copy" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978775 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" volumeName="kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-0" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978782 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" volumeName="kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-thanos-prometheus-http-client-file" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978790 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7f227a09-ac46-4ab4-85db-cf57670ae3c1" volumeName="kubernetes.io/projected/7f227a09-ac46-4ab4-85db-cf57670ae3c1-kube-api-access-44hld" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978797 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a956a93b-8cf1-45ad-bcbf-409e331a02d1" volumeName="kubernetes.io/secret/a956a93b-8cf1-45ad-bcbf-409e331a02d1-metrics-tls" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978804 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="118d5d6d-e2b1-483f-a184-504325584502" volumeName="kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-cluster-tls-config" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978812 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63258d2f-36fe-483c-9d98-fefeffd43533" volumeName="kubernetes.io/secret/63258d2f-36fe-483c-9d98-fefeffd43533-cert" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978820 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ccf93b8e-80a1-4ae6-9d4e-643760607116" volumeName="kubernetes.io/secret/ccf93b8e-80a1-4ae6-9d4e-643760607116-prometheus-operator-tls" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978829 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e8cce0a3-8ffd-465e-8b77-d386fba907b5" volumeName="kubernetes.io/configmap/e8cce0a3-8ffd-465e-8b77-d386fba907b5-metrics-server-audit-profiles" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978836 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f678b061-520c-474f-b4ab-7e5e6949100e" volumeName="kubernetes.io/projected/f678b061-520c-474f-b4ab-7e5e6949100e-kube-api-access-wrpdw" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978844 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="118d5d6d-e2b1-483f-a184-504325584502" volumeName="kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-main-tls" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978853 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="206b2e75-0735-49df-a53c-bdd17aab8ae6" volumeName="kubernetes.io/configmap/206b2e75-0735-49df-a53c-bdd17aab8ae6-ovnkube-config" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978870 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2bc8ee82-0a82-4157-99b0-53360f1cd919" volumeName="kubernetes.io/configmap/2bc8ee82-0a82-4157-99b0-53360f1cd919-whereabouts-flatfile-configmap" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978878 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" volumeName="kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-kube-rbac-proxy-web" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978885 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7f227a09-ac46-4ab4-85db-cf57670ae3c1" volumeName="kubernetes.io/configmap/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-daemon-config" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978893 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="807edbb8-055e-4796-b4dd-b254a93313f6" volumeName="kubernetes.io/configmap/807edbb8-055e-4796-b4dd-b254a93313f6-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978900 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a965dd43-4908-4a6a-9b2a-f3dc0590020e" volumeName="kubernetes.io/empty-dir/a965dd43-4908-4a6a-9b2a-f3dc0590020e-tmp" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978907 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ccf93b8e-80a1-4ae6-9d4e-643760607116" volumeName="kubernetes.io/secret/ccf93b8e-80a1-4ae6-9d4e-643760607116-prometheus-operator-kube-rbac-proxy-config" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978916 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="118d5d6d-e2b1-483f-a184-504325584502" volumeName="kubernetes.io/projected/118d5d6d-e2b1-483f-a184-504325584502-tls-assets" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978923 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="118d5d6d-e2b1-483f-a184-504325584502" volumeName="kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-web-config" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978931 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" volumeName="kubernetes.io/projected/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-kube-api-access-nst9j" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978938 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" volumeName="kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-thanos-sidecar-tls" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978966 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a9525137-701e-46b7-8582-322cd59aaf48" volumeName="kubernetes.io/secret/a9525137-701e-46b7-8582-322cd59aaf48-monitoring-plugin-cert" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978977 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e8cce0a3-8ffd-465e-8b77-d386fba907b5" volumeName="kubernetes.io/secret/e8cce0a3-8ffd-465e-8b77-d386fba907b5-client-ca-bundle" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.978988 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="118d5d6d-e2b1-483f-a184-504325584502" volumeName="kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979000 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3b41e530-bd50-4905-8887-32286cfdedbf" volumeName="kubernetes.io/secret/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-tls" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979016 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="59bf3884-8cc8-4a80-a064-470c85186dda" volumeName="kubernetes.io/secret/59bf3884-8cc8-4a80-a064-470c85186dda-agent-certs" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979025 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" volumeName="kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-metrics-client-ca" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979032 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" volumeName="kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-config" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979041 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a956a93b-8cf1-45ad-bcbf-409e331a02d1" volumeName="kubernetes.io/projected/a956a93b-8cf1-45ad-bcbf-409e331a02d1-kube-api-access-fjfjp" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979049 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0742c411-7597-48ae-a35d-82a7d69fafdb" volumeName="kubernetes.io/empty-dir/0742c411-7597-48ae-a35d-82a7d69fafdb-data-volume" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979057 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="118d5d6d-e2b1-483f-a184-504325584502" volumeName="kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979081 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" volumeName="kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-trusted-ca-bundle" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979092 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e8cce0a3-8ffd-465e-8b77-d386fba907b5" volumeName="kubernetes.io/configmap/e8cce0a3-8ffd-465e-8b77-d386fba907b5-configmap-kubelet-serving-ca-bundle" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979102 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e8cce0a3-8ffd-465e-8b77-d386fba907b5" volumeName="kubernetes.io/projected/e8cce0a3-8ffd-465e-8b77-d386fba907b5-kube-api-access-4rh8m" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979113 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3b41e530-bd50-4905-8887-32286cfdedbf" volumeName="kubernetes.io/configmap/3b41e530-bd50-4905-8887-32286cfdedbf-metrics-client-ca" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979124 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" volumeName="kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-kubelet-serving-ca-bundle" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979135 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" volumeName="kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-tls" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979146 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="807edbb8-055e-4796-b4dd-b254a93313f6" volumeName="kubernetes.io/secret/807edbb8-055e-4796-b4dd-b254a93313f6-kube-state-metrics-tls" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979157 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8d1e5946-91d6-4ab7-a2da-1fafe37ceffc" volumeName="kubernetes.io/projected/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-kube-api-access-dxkfl" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979169 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a956a93b-8cf1-45ad-bcbf-409e331a02d1" volumeName="kubernetes.io/configmap/a956a93b-8cf1-45ad-bcbf-409e331a02d1-config-volume" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979180 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f678b061-520c-474f-b4ab-7e5e6949100e" volumeName="kubernetes.io/empty-dir/f678b061-520c-474f-b4ab-7e5e6949100e-etc-tuned" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979190 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="118d5d6d-e2b1-483f-a184-504325584502" volumeName="kubernetes.io/empty-dir/118d5d6d-e2b1-483f-a184-504325584502-alertmanager-main-db" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979201 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7f227a09-ac46-4ab4-85db-cf57670ae3c1" volumeName="kubernetes.io/configmap/7f227a09-ac46-4ab4-85db-cf57670ae3c1-cni-binary-copy" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979214 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f" volumeName="kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979224 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e8cce0a3-8ffd-465e-8b77-d386fba907b5" volumeName="kubernetes.io/secret/e8cce0a3-8ffd-465e-8b77-d386fba907b5-secret-metrics-server-tls" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979232 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" volumeName="kubernetes.io/empty-dir/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-db" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979238 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" volumeName="kubernetes.io/projected/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-tls-assets" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979246 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0742c411-7597-48ae-a35d-82a7d69fafdb" volumeName="kubernetes.io/projected/0742c411-7597-48ae-a35d-82a7d69fafdb-kube-api-access-z8fdz" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979253 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="118d5d6d-e2b1-483f-a184-504325584502" volumeName="kubernetes.io/configmap/118d5d6d-e2b1-483f-a184-504325584502-alertmanager-trusted-ca-bundle" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979261 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="118d5d6d-e2b1-483f-a184-504325584502" volumeName="kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979273 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="124a28d1-9d05-42d1-99d4-721942b23062" volumeName="kubernetes.io/projected/124a28d1-9d05-42d1-99d4-721942b23062-kube-api-access-mtt5b" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979284 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3b41e530-bd50-4905-8887-32286cfdedbf" volumeName="kubernetes.io/secret/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-kube-rbac-proxy-config" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979295 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="807edbb8-055e-4796-b4dd-b254a93313f6" volumeName="kubernetes.io/projected/807edbb8-055e-4796-b4dd-b254a93313f6-kube-api-access-xpvdq" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979306 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="237e2f40-006a-4b40-aa3e-6d0d05295e6d" volumeName="kubernetes.io/configmap/237e2f40-006a-4b40-aa3e-6d0d05295e6d-serviceca" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979317 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a956a93b-8cf1-45ad-bcbf-409e331a02d1" volumeName="kubernetes.io/empty-dir/a956a93b-8cf1-45ad-bcbf-409e331a02d1-tmp-dir" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979328 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a965dd43-4908-4a6a-9b2a-f3dc0590020e" volumeName="kubernetes.io/projected/a965dd43-4908-4a6a-9b2a-f3dc0590020e-kube-api-access-dg7t8" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979338 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bcf9e13b-7029-4567-85b8-4d53bca32fef" volumeName="kubernetes.io/projected/bcf9e13b-7029-4567-85b8-4d53bca32fef-kube-api-access-w44fz" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979350 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ccf93b8e-80a1-4ae6-9d4e-643760607116" volumeName="kubernetes.io/configmap/ccf93b8e-80a1-4ae6-9d4e-643760607116-metrics-client-ca" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979362 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="118d5d6d-e2b1-483f-a184-504325584502" volumeName="kubernetes.io/empty-dir/118d5d6d-e2b1-483f-a184-504325584502-config-out" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979374 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="118d5d6d-e2b1-483f-a184-504325584502" volumeName="kubernetes.io/projected/118d5d6d-e2b1-483f-a184-504325584502-kube-api-access-4fldv" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979385 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="124a28d1-9d05-42d1-99d4-721942b23062" volumeName="kubernetes.io/configmap/124a28d1-9d05-42d1-99d4-721942b23062-metrics-client-ca" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979395 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" volumeName="kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-1" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979403 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="807edbb8-055e-4796-b4dd-b254a93313f6" volumeName="kubernetes.io/secret/807edbb8-055e-4796-b4dd-b254a93313f6-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979411 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e8cce0a3-8ffd-465e-8b77-d386fba907b5" volumeName="kubernetes.io/empty-dir/e8cce0a3-8ffd-465e-8b77-d386fba907b5-audit-log" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979420 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e8cce0a3-8ffd-465e-8b77-d386fba907b5" volumeName="kubernetes.io/secret/e8cce0a3-8ffd-465e-8b77-d386fba907b5-secret-metrics-server-client-certs" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979432 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="206b2e75-0735-49df-a53c-bdd17aab8ae6" volumeName="kubernetes.io/configmap/206b2e75-0735-49df-a53c-bdd17aab8ae6-env-overrides" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979445 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="206b2e75-0735-49df-a53c-bdd17aab8ae6" volumeName="kubernetes.io/secret/206b2e75-0735-49df-a53c-bdd17aab8ae6-ovn-node-metrics-cert" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979458 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2bc8ee82-0a82-4157-99b0-53360f1cd919" volumeName="kubernetes.io/configmap/2bc8ee82-0a82-4157-99b0-53360f1cd919-cni-sysctl-allowlist" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979466 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3b41e530-bd50-4905-8887-32286cfdedbf" volumeName="kubernetes.io/empty-dir/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-textfile" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979473 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="59bf3884-8cc8-4a80-a064-470c85186dda" volumeName="kubernetes.io/configmap/59bf3884-8cc8-4a80-a064-470c85186dda-konnectivity-ca" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979481 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63258d2f-36fe-483c-9d98-fefeffd43533" volumeName="kubernetes.io/projected/63258d2f-36fe-483c-9d98-fefeffd43533-kube-api-access-ljlvq" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979491 5784 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6bde7db4-687a-4dcb-b490-2f88e2e4ea71" volumeName="kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm" seLinuxMountContext="" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979499 5784 reconstruct.go:97] "Volume reconstruction finished" Nov 04 05:50:00.980035 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:00.979504 5784 reconciler.go:29] "Reconciler: start to sync state" Nov 04 05:50:01.001849 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.001821 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvgv2_206b2e75-0735-49df-a53c-bdd17aab8ae6/ovn-acl-logging/0.log" Nov 04 05:50:01.005435 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.005410 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvgv2_206b2e75-0735-49df-a53c-bdd17aab8ae6/ovn-acl-logging/0.log" Nov 04 05:50:01.006259 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.006228 5784 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 04 05:50:01.007946 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.007926 5784 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 04 05:50:01.008074 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.007954 5784 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 04 05:50:01.008074 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.007972 5784 kubelet.go:2521] "Starting kubelet main sync loop" Nov 04 05:50:01.008074 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:01.008014 5784 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Nov 04 05:50:01.019699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.019660 5784 generic.go:356] "Generic (PLEG): container finished" podID="2bc8ee82-0a82-4157-99b0-53360f1cd919" containerID="224114d088b78bf017f7e21aea4978f13e55a39d29b7187ae3f17661e6b6a7ca" exitCode=0 Nov 04 05:50:01.019699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.019696 5784 generic.go:356] "Generic (PLEG): container finished" podID="2bc8ee82-0a82-4157-99b0-53360f1cd919" containerID="2dff308fd0c7dea34d8ab01f15594f64acf74cf57c255dab9e6acfbac2a7f356" exitCode=0 Nov 04 05:50:01.019699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.019702 5784 generic.go:356] "Generic (PLEG): container finished" podID="2bc8ee82-0a82-4157-99b0-53360f1cd919" containerID="4de3ab06e92c29c9f8a076c722a756ec0d1f37f3db0900673ce7c8eb78acc563" exitCode=0 Nov 04 05:50:01.019884 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.019708 5784 generic.go:356] "Generic (PLEG): container finished" podID="2bc8ee82-0a82-4157-99b0-53360f1cd919" containerID="009657dcd7065815b628cb7cc557ba8c54a8ab4452f36335fb2f44cfe09e6b86" exitCode=0 Nov 04 05:50:01.019884 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.019713 5784 generic.go:356] "Generic (PLEG): container finished" podID="2bc8ee82-0a82-4157-99b0-53360f1cd919" containerID="9348a9eabb513b93009f81dcdcf053a786fb8b1bc394e120cef19e4d47071013" exitCode=0 Nov 04 05:50:01.019884 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.019718 5784 generic.go:356] "Generic (PLEG): container finished" podID="2bc8ee82-0a82-4157-99b0-53360f1cd919" containerID="c5d0100f613164b11ef14ae77b7f846485c08095755e5064c8cbd049ccd305f5" exitCode=0 Nov 04 05:50:01.023179 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.023157 5784 generic.go:356] "Generic (PLEG): container finished" podID="3b41e530-bd50-4905-8887-32286cfdedbf" containerID="ecbfc39e77ff26e04a73ca036032d9b2e22932dd6694797bfe70f58ac7a6a13b" exitCode=0 Nov 04 05:50:01.029470 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.029453 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvgv2_206b2e75-0735-49df-a53c-bdd17aab8ae6/ovn-acl-logging/0.log" Nov 04 05:50:01.029777 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.029754 5784 generic.go:356] "Generic (PLEG): container finished" podID="206b2e75-0735-49df-a53c-bdd17aab8ae6" containerID="425e7f5d3610bed852709d9f97a7610dd4f2f5c047bdeb3ec662747d56fa114a" exitCode=1 Nov 04 05:50:01.045014 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.044987 5784 generic.go:356] "Generic (PLEG): container finished" podID="aea09c4c566ff629316b6657597f6b06" containerID="e3d283c8959c8b56152c3b520b917b9dd303263f1d65b444f00582ee42a1a2f0" exitCode=0 Nov 04 05:50:01.047981 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.047959 5784 generic.go:356] "Generic (PLEG): container finished" podID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerID="2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b" exitCode=0 Nov 04 05:50:01.054454 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.054398 5784 generic.go:356] "Generic (PLEG): container finished" podID="118d5d6d-e2b1-483f-a184-504325584502" containerID="6b2276a8819cb9615329740c4650032907a9938d58e7f017f007cf028b173db9" exitCode=0 Nov 04 05:50:01.070259 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:01.070236 5784 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-45.us-west-1.compute.internal\" not found" Nov 04 05:50:01.089522 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.089507 5784 manager.go:324] Recovery completed Nov 04 05:50:01.108103 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:01.108056 5784 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Nov 04 05:50:01.109964 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.109952 5784 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:50:01.113853 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.113828 5784 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:50:01.113928 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.113868 5784 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:50:01.113928 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.113885 5784 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:50:01.116834 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.116817 5784 cpu_manager.go:226] "Starting" policy="none" Nov 04 05:50:01.116834 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.116833 5784 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 04 05:50:01.116994 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.116857 5784 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 04 05:50:01.116994 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.116902 5784 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:50:01.117135 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.117113 5784 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Nov 04 05:50:01.117205 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.117136 5784 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Nov 04 05:50:01.117205 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.117161 5784 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Nov 04 05:50:01.120847 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.120196 5784 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:50:01.120847 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.120239 5784 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:50:01.120847 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.120256 5784 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:50:01.121153 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.121132 5784 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Nov 04 05:50:01.121269 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.121249 5784 policy_none.go:50] "Start" Nov 04 05:50:01.121397 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.121281 5784 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 04 05:50:01.121397 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.121299 5784 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 04 05:50:01.121640 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.121599 5784 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Nov 04 05:50:01.121872 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.121854 5784 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Nov 04 05:50:01.121872 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.121869 5784 policy_none.go:44] "Start" Nov 04 05:50:01.126969 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.126939 5784 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 04 05:50:01.130614 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.130598 5784 manager.go:341] "Starting Device Plugin manager" Nov 04 05:50:01.130693 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:01.130628 5784 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 04 05:50:01.130693 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.130640 5784 server.go:87] "Starting device plugin registration server" Nov 04 05:50:01.131100 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.130945 5784 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 04 05:50:01.131100 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.130982 5784 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 04 05:50:01.131300 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.131275 5784 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 04 05:50:01.131431 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.131383 5784 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 04 05:50:01.131511 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.131437 5784 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 04 05:50:01.131511 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.131442 5784 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 04 05:50:01.131978 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.131470 5784 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T05:50:01.131429144Z","UUID":"25efbcd4-f334-4647-af43-1abe12bd17f7","Handler":null,"Name":"","Endpoint":""} Nov 04 05:50:01.134056 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.134036 5784 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 04 05:50:01.134056 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.134079 5784 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 04 05:50:01.134339 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:01.134304 5784 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 04 05:50:01.134418 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:01.134348 5784 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-45.us-west-1.compute.internal\" not found" Nov 04 05:50:01.182548 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.182510 5784 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 05:50:01.182729 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.182640 5784 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 05:50:01.182729 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.182677 5784 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 05:50:01.182729 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.182694 5784 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Nov 04 05:50:01.231971 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.231936 5784 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 05:50:01.233192 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.233157 5784 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 05:50:01.233295 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.233199 5784 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 05:50:01.233295 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.233214 5784 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 05:50:01.233295 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.233271 5784 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:50:01.291376 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.291345 5784 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 05:50:01.308962 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.308875 5784 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal"] Nov 04 05:50:01.309600 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.309583 5784 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:50:01.309640 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.309563 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" event={"ID":"aea09c4c566ff629316b6657597f6b06","Type":"ContainerStarted","Data":"e1272b5f5fdb65c5da233f63fe1e553cf1f85ed76fc0936a31ab1e0a3e039949"} Nov 04 05:50:01.309671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.309636 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" event={"ID":"aea09c4c566ff629316b6657597f6b06","Type":"ContainerDied","Data":"e3d283c8959c8b56152c3b520b917b9dd303263f1d65b444f00582ee42a1a2f0"} Nov 04 05:50:01.309671 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.309658 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" event={"ID":"aea09c4c566ff629316b6657597f6b06","Type":"ContainerStarted","Data":"32a03eca3efac02dd990719640a77603f8fd42784a5d827b73cb4101d30bd356"} Nov 04 05:50:01.309795 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.309678 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal" event={"ID":"cac56becdfbf016c3dc7fcb0c6060f7b","Type":"ContainerStarted","Data":"4d043ed524a922c20b76263fcbcfcdfa17cea61f9d46b64e31f5f6d79c1b0859"} Nov 04 05:50:01.309795 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.309695 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal" event={"ID":"cac56becdfbf016c3dc7fcb0c6060f7b","Type":"ContainerStarted","Data":"8eb39cf29ab7476d1d8bde56c93f41de6aa848f51f0b835ec286fd847ddfd8a5"} Nov 04 05:50:01.309855 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.309832 5784 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:50:01.355542 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.355511 5784 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:50:01.355695 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.355584 5784 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:50:01.356149 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.356131 5784 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeNotReady" Nov 04 05:50:01.356247 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.356165 5784 setters.go:546] "Node became not ready" node="ip-10-0-134-45.us-west-1.compute.internal" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-11-04T05:50:01Z","lastTransitionTime":"2026-11-04T05:50:01Z","reason":"KubeletNotReady","message":"CSINode is not yet initialized"} Nov 04 05:50:01.383829 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.383799 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cac56becdfbf016c3dc7fcb0c6060f7b-config\") pod \"kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal\" (UID: \"cac56becdfbf016c3dc7fcb0c6060f7b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:50:01.383829 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.383830 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aea09c4c566ff629316b6657597f6b06-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal\" (UID: \"aea09c4c566ff629316b6657597f6b06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:50:01.383974 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.383848 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aea09c4c566ff629316b6657597f6b06-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal\" (UID: \"aea09c4c566ff629316b6657597f6b06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:50:01.386439 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.386419 5784 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 05:50:01.386551 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:01.386476 5784 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:50:01.387630 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.387617 5784 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 05:50:01.387696 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:01.387659 5784 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:50:01.418354 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.418323 5784 nodeinfomanager.go:471] existing CSINode "ip-10-0-134-45.us-west-1.compute.internal" is owned by different node (oldNodeID="8d57a406-6979-424f-beb3-1377c1c010c1", newNodeID=""), cleaning up... Nov 04 05:50:01.484829 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.484795 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cac56becdfbf016c3dc7fcb0c6060f7b-config\") pod \"kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal\" (UID: \"cac56becdfbf016c3dc7fcb0c6060f7b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:50:01.484829 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.484831 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aea09c4c566ff629316b6657597f6b06-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal\" (UID: \"aea09c4c566ff629316b6657597f6b06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:50:01.485085 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.484859 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aea09c4c566ff629316b6657597f6b06-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal\" (UID: \"aea09c4c566ff629316b6657597f6b06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:50:01.485085 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.484915 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aea09c4c566ff629316b6657597f6b06-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal\" (UID: \"aea09c4c566ff629316b6657597f6b06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:50:01.485085 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.484934 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aea09c4c566ff629316b6657597f6b06-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal\" (UID: \"aea09c4c566ff629316b6657597f6b06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:50:01.485085 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.484976 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cac56becdfbf016c3dc7fcb0c6060f7b-config\") pod \"kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal\" (UID: \"cac56becdfbf016c3dc7fcb0c6060f7b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:50:01.940309 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:01.940278 5784 apiserver.go:52] "Watching apiserver" Nov 04 05:50:02.079636 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.079607 5784 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:50:02.079782 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.079686 5784 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:50:02.084332 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.084311 5784 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 04 05:50:02.085008 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.084982 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-qvgv2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal","openshift-monitoring/metrics-server-f6b6d94bc-bxlj7","openshift-multus/multus-5jn26","openshift-ingress-canary/ingress-canary-vtpdd","openshift-insights/insights-runtime-extractor-flcbl","kube-system/kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal","openshift-monitoring/node-exporter-lzjh2","openshift-monitoring/monitoring-plugin-77f4f76594-hpqtm","openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4","openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx","openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sj64z","kube-system/konnectivity-agent-plf2w","openshift-dns/node-resolver-7cdk6","openshift-monitoring/prometheus-k8s-0","kube-system/global-pull-secret-syncer-9vrcj","openshift-dns/dns-default-dxkjf","openshift-network-diagnostics/network-check-target-zc9wk","openshift-network-operator/iptables-alerter-pc5sk","openshift-cluster-node-tuning-operator/tuned-848sz","openshift-multus/multus-additional-cni-plugins-tqz8r","openshift-console/downloads-6dd789c8b7-d8dqj","openshift-multus/network-metrics-daemon-ssngm","openshift-image-registry/node-ca-xzkmv","openshift-monitoring/alertmanager-main-0","openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r"] Nov 04 05:50:02.148302 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.148271 5784 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 05:50:02.148510 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:02.148336 5784 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:50:02.148510 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.148414 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 04 05:50:02.148510 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.148414 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 04 05:50:02.148510 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.148437 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 04 05:50:02.148510 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.148494 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 04 05:50:02.148787 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.148581 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 04 05:50:02.148787 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.148608 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 04 05:50:02.148787 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.148629 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 04 05:50:02.148787 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.148643 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 04 05:50:02.148787 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.148661 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 04 05:50:02.149031 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.148840 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 04 05:50:02.149031 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.148892 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 04 05:50:02.149031 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.148894 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 04 05:50:02.149031 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.148907 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 04 05:50:02.149031 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.148920 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 04 05:50:02.149031 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.148955 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 04 05:50:02.149031 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.149006 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 04 05:50:02.149331 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.149044 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 04 05:50:02.149331 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.149081 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 04 05:50:02.149331 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.149083 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 04 05:50:02.149331 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.149103 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 04 05:50:02.149331 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.149104 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 04 05:50:02.149331 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.149118 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 04 05:50:02.149331 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.149173 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 04 05:50:02.152335 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.152318 5784 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 05:50:02.152403 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:02.152361 5784 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.us-west-1.compute.internal" Nov 04 05:50:02.173126 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.173095 5784 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 04 05:50:02.188898 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.188858 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-kubelet\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.189050 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.188908 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-var-lib-cni-multus\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.189050 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.188987 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e8cce0a3-8ffd-465e-8b77-d386fba907b5-metrics-server-audit-profiles\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:50:02.189050 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.189023 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs\") pod \"network-metrics-daemon-ssngm\" (UID: \"83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f\") " pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:50:02.189050 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.189040 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/118d5d6d-e2b1-483f-a184-504325584502-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.189349 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.189076 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-node-log\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.189349 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.189102 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-var-lib-cni-bin\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.189349 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.189125 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b41e530-bd50-4905-8887-32286cfdedbf-sys\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:50:02.189349 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.189172 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-accelerators-collector-config\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:50:02.189349 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.189203 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/118d5d6d-e2b1-483f-a184-504325584502-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.189349 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.189233 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2bc8ee82-0a82-4157-99b0-53360f1cd919-system-cni-dir\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:50:02.189349 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.189255 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-slash\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.189349 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.189307 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/206b2e75-0735-49df-a53c-bdd17aab8ae6-env-overrides\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.189647 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.189352 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-daemon-config\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.189647 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.189407 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtt5b\" (UniqueName: \"kubernetes.io/projected/124a28d1-9d05-42d1-99d4-721942b23062-kube-api-access-mtt5b\") pod \"openshift-state-metrics-7bd7489957-dmklg\" (UID: \"124a28d1-9d05-42d1-99d4-721942b23062\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" Nov 04 05:50:02.189647 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.189436 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrpdw\" (UniqueName: \"kubernetes.io/projected/f678b061-520c-474f-b4ab-7e5e6949100e-kube-api-access-wrpdw\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.189647 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.189463 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0742c411-7597-48ae-a35d-82a7d69fafdb-crio-socket\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:50:02.189647 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.189501 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/206b2e75-0735-49df-a53c-bdd17aab8ae6-env-overrides\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.189647 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.189506 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxkfl\" (UniqueName: \"kubernetes.io/projected/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-kube-api-access-dxkfl\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:50:02.189647 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.189559 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-daemon-config\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.189647 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.189564 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tlhk\" (UniqueName: \"kubernetes.io/projected/5dadf5f9-5bb9-4652-9d12-c4f17d327528-kube-api-access-5tlhk\") pod \"node-resolver-7cdk6\" (UID: \"5dadf5f9-5bb9-4652-9d12-c4f17d327528\") " pod="openshift-dns/node-resolver-7cdk6" Nov 04 05:50:02.189971 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.189957 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b41e530-bd50-4905-8887-32286cfdedbf-root\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:50:02.190019 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.189989 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:50:02.190054 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190026 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w44fz\" (UniqueName: \"kubernetes.io/projected/bcf9e13b-7029-4567-85b8-4d53bca32fef-kube-api-access-w44fz\") pod \"iptables-alerter-pc5sk\" (UID: \"bcf9e13b-7029-4567-85b8-4d53bca32fef\") " pod="openshift-network-operator/iptables-alerter-pc5sk" Nov 04 05:50:02.190122 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190100 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg7t8\" (UniqueName: \"kubernetes.io/projected/a965dd43-4908-4a6a-9b2a-f3dc0590020e-kube-api-access-dg7t8\") pod \"downloads-6dd789c8b7-d8dqj\" (UID: \"a965dd43-4908-4a6a-9b2a-f3dc0590020e\") " pod="openshift-console/downloads-6dd789c8b7-d8dqj" Nov 04 05:50:02.190156 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190139 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-etc-selinux\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:50:02.190229 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190164 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a956a93b-8cf1-45ad-bcbf-409e331a02d1-config-volume\") pod \"dns-default-dxkjf\" (UID: \"a956a93b-8cf1-45ad-bcbf-409e331a02d1\") " pod="openshift-dns/dns-default-dxkjf" Nov 04 05:50:02.190287 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190218 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2bc8ee82-0a82-4157-99b0-53360f1cd919-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:50:02.190287 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190260 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-etc-openvswitch\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.190389 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190287 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-etc-kubernetes\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.190389 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190335 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-host\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.190389 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190375 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e8cce0a3-8ffd-465e-8b77-d386fba907b5-secret-metrics-server-client-certs\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:50:02.190490 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190410 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2bc8ee82-0a82-4157-99b0-53360f1cd919-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:50:02.190490 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190399 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5dadf5f9-5bb9-4652-9d12-c4f17d327528-hosts-file\") pod \"node-resolver-7cdk6\" (UID: \"5dadf5f9-5bb9-4652-9d12-c4f17d327528\") " pod="openshift-dns/node-resolver-7cdk6" Nov 04 05:50:02.190544 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190493 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-textfile\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:50:02.190572 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190548 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/807edbb8-055e-4796-b4dd-b254a93313f6-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:50:02.190615 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190577 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.190615 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190595 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.190615 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190588 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-textfile\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:50:02.190719 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190616 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-modprobe-d\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.190719 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190644 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e8cce0a3-8ffd-465e-8b77-d386fba907b5-audit-log\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:50:02.190790 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190729 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e8cce0a3-8ffd-465e-8b77-d386fba907b5-audit-log\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:50:02.190790 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190785 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfhg5\" (UniqueName: \"kubernetes.io/projected/3b41e530-bd50-4905-8887-32286cfdedbf-kube-api-access-nfhg5\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:50:02.190868 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190803 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:50:02.190868 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190821 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8c71ae38-62e0-4de3-9cf9-c4ee58edd96a-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-sj64z\" (UID: \"8c71ae38-62e0-4de3-9cf9-c4ee58edd96a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sj64z" Nov 04 05:50:02.190868 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190848 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-run-k8s-cni-cncf-io\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.191004 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190909 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-var-lib-kubelet\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.191004 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190945 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-run-systemd\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.191004 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190964 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/206b2e75-0735-49df-a53c-bdd17aab8ae6-ovnkube-script-lib\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.191004 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.190978 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f678b061-520c-474f-b4ab-7e5e6949100e-etc-tuned\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.191004 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191000 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f678b061-520c-474f-b4ab-7e5e6949100e-tmp\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.191301 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191025 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/124a28d1-9d05-42d1-99d4-721942b23062-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-dmklg\" (UID: \"124a28d1-9d05-42d1-99d4-721942b23062\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" Nov 04 05:50:02.191301 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191051 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48twm\" (UniqueName: \"kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm\") pod \"network-check-target-zc9wk\" (UID: \"6bde7db4-687a-4dcb-b490-2f88e2e4ea71\") " pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:50:02.191301 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191098 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wx9c\" (UniqueName: \"kubernetes.io/projected/2bc8ee82-0a82-4157-99b0-53360f1cd919-kube-api-access-5wx9c\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:50:02.191301 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191106 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f678b061-520c-474f-b4ab-7e5e6949100e-etc-tuned\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.191301 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191125 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.191301 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191156 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:50:02.191301 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191108 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f678b061-520c-474f-b4ab-7e5e6949100e-tmp\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.191301 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191184 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.191301 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191204 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/206b2e75-0735-49df-a53c-bdd17aab8ae6-ovnkube-script-lib\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.191301 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191209 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/118d5d6d-e2b1-483f-a184-504325584502-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.191301 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191278 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63258d2f-36fe-483c-9d98-fefeffd43533-cert\") pod \"ingress-canary-vtpdd\" (UID: \"63258d2f-36fe-483c-9d98-fefeffd43533\") " pod="openshift-ingress-canary/ingress-canary-vtpdd" Nov 04 05:50:02.191301 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191306 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-socket-dir-parent\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.191816 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191325 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-sysconfig\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.191816 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191341 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-config-volume\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.191816 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191357 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-lib-modules\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.191816 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191393 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpvdq\" (UniqueName: \"kubernetes.io/projected/807edbb8-055e-4796-b4dd-b254a93313f6-kube-api-access-xpvdq\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:50:02.191816 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191409 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/635418a3-d2fd-4dcc-8893-8488f45988c0-dbus\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:50:02.191816 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191428 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmxjw\" (UniqueName: \"kubernetes.io/projected/ccf93b8e-80a1-4ae6-9d4e-643760607116-kube-api-access-lmxjw\") pod \"prometheus-operator-9cd89b74c-d4p9r\" (UID: \"ccf93b8e-80a1-4ae6-9d4e-643760607116\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" Nov 04 05:50:02.191816 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191518 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/807edbb8-055e-4796-b4dd-b254a93313f6-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:50:02.191816 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191590 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.191816 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191656 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a956a93b-8cf1-45ad-bcbf-409e331a02d1-tmp-dir\") pod \"dns-default-dxkjf\" (UID: \"a956a93b-8cf1-45ad-bcbf-409e331a02d1\") " pod="openshift-dns/dns-default-dxkjf" Nov 04 05:50:02.191816 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191692 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-run-ovn-kubernetes\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.191816 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191721 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a956a93b-8cf1-45ad-bcbf-409e331a02d1-tmp-dir\") pod \"dns-default-dxkjf\" (UID: \"a956a93b-8cf1-45ad-bcbf-409e331a02d1\") " pod="openshift-dns/dns-default-dxkjf" Nov 04 05:50:02.191816 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191742 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.192333 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191852 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8cce0a3-8ffd-465e-8b77-d386fba907b5-client-ca-bundle\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:50:02.192333 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191887 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a965dd43-4908-4a6a-9b2a-f3dc0590020e-tmp\") pod \"downloads-6dd789c8b7-d8dqj\" (UID: \"a965dd43-4908-4a6a-9b2a-f3dc0590020e\") " pod="openshift-console/downloads-6dd789c8b7-d8dqj" Nov 04 05:50:02.192333 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191907 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/124a28d1-9d05-42d1-99d4-721942b23062-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-dmklg\" (UID: \"124a28d1-9d05-42d1-99d4-721942b23062\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" Nov 04 05:50:02.192333 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191950 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bcf9e13b-7029-4567-85b8-4d53bca32fef-iptables-alerter-script\") pod \"iptables-alerter-pc5sk\" (UID: \"bcf9e13b-7029-4567-85b8-4d53bca32fef\") " pod="openshift-network-operator/iptables-alerter-pc5sk" Nov 04 05:50:02.192333 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191980 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-log-socket\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.192333 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.191980 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a965dd43-4908-4a6a-9b2a-f3dc0590020e-tmp\") pod \"downloads-6dd789c8b7-d8dqj\" (UID: \"a965dd43-4908-4a6a-9b2a-f3dc0590020e\") " pod="openshift-console/downloads-6dd789c8b7-d8dqj" Nov 04 05:50:02.192333 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192007 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.192333 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192106 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/807edbb8-055e-4796-b4dd-b254a93313f6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:50:02.192333 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192126 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2bc8ee82-0a82-4157-99b0-53360f1cd919-cni-binary-copy\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:50:02.192333 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192260 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.192333 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192301 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-cni-dir\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.192333 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192309 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bcf9e13b-7029-4567-85b8-4d53bca32fef-iptables-alerter-script\") pod \"iptables-alerter-pc5sk\" (UID: \"bcf9e13b-7029-4567-85b8-4d53bca32fef\") " pod="openshift-network-operator/iptables-alerter-pc5sk" Nov 04 05:50:02.192333 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192322 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2bc8ee82-0a82-4157-99b0-53360f1cd919-cni-binary-copy\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:50:02.192333 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192328 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-cnibin\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.192916 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192387 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-run\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.192916 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192417 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-socket-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:50:02.192916 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192444 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/118d5d6d-e2b1-483f-a184-504325584502-tls-assets\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.192916 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192496 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-systemd-units\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.192916 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192522 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-run-ovn\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.192916 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192541 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.192916 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192557 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-tls\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:50:02.192916 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192591 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.192916 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192624 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/807edbb8-055e-4796-b4dd-b254a93313f6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:50:02.192916 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192696 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.192916 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192725 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e8cce0a3-8ffd-465e-8b77-d386fba907b5-secret-metrics-server-tls\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:50:02.192916 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192752 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/237e2f40-006a-4b40-aa3e-6d0d05295e6d-serviceca\") pod \"node-ca-xzkmv\" (UID: \"237e2f40-006a-4b40-aa3e-6d0d05295e6d\") " pod="openshift-image-registry/node-ca-xzkmv" Nov 04 05:50:02.192916 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192796 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dadf5f9-5bb9-4652-9d12-c4f17d327528-tmp-dir\") pod \"node-resolver-7cdk6\" (UID: \"5dadf5f9-5bb9-4652-9d12-c4f17d327528\") " pod="openshift-dns/node-resolver-7cdk6" Nov 04 05:50:02.192916 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192828 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-wtmp\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:50:02.192916 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192855 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/118d5d6d-e2b1-483f-a184-504325584502-config-out\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.192916 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192879 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fldv\" (UniqueName: \"kubernetes.io/projected/118d5d6d-e2b1-483f-a184-504325584502-kube-api-access-4fldv\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.192916 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192902 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-sys\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192926 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/635418a3-d2fd-4dcc-8893-8488f45988c0-kubelet-config\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192953 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-run-openvswitch\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.192979 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljlvq\" (UniqueName: \"kubernetes.io/projected/63258d2f-36fe-483c-9d98-fefeffd43533-kube-api-access-ljlvq\") pod \"ingress-canary-vtpdd\" (UID: \"63258d2f-36fe-483c-9d98-fefeffd43533\") " pod="openshift-ingress-canary/ingress-canary-vtpdd" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193014 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-var-lib-kubelet\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193038 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193108 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59bf3884-8cc8-4a80-a064-470c85186dda-konnectivity-ca\") pod \"konnectivity-agent-plf2w\" (UID: \"59bf3884-8cc8-4a80-a064-470c85186dda\") " pod="kube-system/konnectivity-agent-plf2w" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193134 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-registration-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193161 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193184 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bcf9e13b-7029-4567-85b8-4d53bca32fef-host-slash\") pod \"iptables-alerter-pc5sk\" (UID: \"bcf9e13b-7029-4567-85b8-4d53bca32fef\") " pod="openshift-network-operator/iptables-alerter-pc5sk" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193208 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193235 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjfjp\" (UniqueName: \"kubernetes.io/projected/a956a93b-8cf1-45ad-bcbf-409e331a02d1-kube-api-access-fjfjp\") pod \"dns-default-dxkjf\" (UID: \"a956a93b-8cf1-45ad-bcbf-409e331a02d1\") " pod="openshift-dns/dns-default-dxkjf" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193261 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/807edbb8-055e-4796-b4dd-b254a93313f6-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193285 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a956a93b-8cf1-45ad-bcbf-409e331a02d1-metrics-tls\") pod \"dns-default-dxkjf\" (UID: \"a956a93b-8cf1-45ad-bcbf-409e331a02d1\") " pod="openshift-dns/dns-default-dxkjf" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193309 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccf93b8e-80a1-4ae6-9d4e-643760607116-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-d4p9r\" (UID: \"ccf93b8e-80a1-4ae6-9d4e-643760607116\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193339 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193363 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193399 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-run-multus-certs\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193440 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-sysctl-d\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193452 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/237e2f40-006a-4b40-aa3e-6d0d05295e6d-serviceca\") pod \"node-ca-xzkmv\" (UID: \"237e2f40-006a-4b40-aa3e-6d0d05295e6d\") " pod="openshift-image-registry/node-ca-xzkmv" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193466 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0742c411-7597-48ae-a35d-82a7d69fafdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193507 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcqrv\" (UniqueName: \"kubernetes.io/projected/206b2e75-0735-49df-a53c-bdd17aab8ae6-kube-api-access-hcqrv\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193539 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkggn\" (UniqueName: \"kubernetes.io/projected/a9525137-701e-46b7-8582-322cd59aaf48-kube-api-access-nkggn\") pod \"monitoring-plugin-77f4f76594-hpqtm\" (UID: \"a9525137-701e-46b7-8582-322cd59aaf48\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-hpqtm" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193585 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193611 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dadf5f9-5bb9-4652-9d12-c4f17d327528-tmp-dir\") pod \"node-resolver-7cdk6\" (UID: \"5dadf5f9-5bb9-4652-9d12-c4f17d327528\") " pod="openshift-dns/node-resolver-7cdk6" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193617 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-sysctl-conf\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193647 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59bf3884-8cc8-4a80-a064-470c85186dda-agent-certs\") pod \"konnectivity-agent-plf2w\" (UID: \"59bf3884-8cc8-4a80-a064-470c85186dda\") " pod="kube-system/konnectivity-agent-plf2w" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193675 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-run-netns\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193705 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44hld\" (UniqueName: \"kubernetes.io/projected/7f227a09-ac46-4ab4-85db-cf57670ae3c1-kube-api-access-44hld\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.193699 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193713 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/118d5d6d-e2b1-483f-a184-504325584502-config-out\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.195240 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193730 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0742c411-7597-48ae-a35d-82a7d69fafdb-data-volume\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:50:02.195240 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193758 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.195240 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193789 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.195240 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193847 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6jqz\" (UniqueName: \"kubernetes.io/projected/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-kube-api-access-n6jqz\") pod \"network-metrics-daemon-ssngm\" (UID: \"83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f\") " pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:50:02.195240 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193879 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-var-lib-openvswitch\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.195240 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193906 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-config\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.195240 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193933 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.195240 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.193979 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-web-config\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.195240 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.194561 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/807edbb8-055e-4796-b4dd-b254a93313f6-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:50:02.195240 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.195093 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0742c411-7597-48ae-a35d-82a7d69fafdb-data-volume\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:50:02.195240 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.195229 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/118d5d6d-e2b1-483f-a184-504325584502-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.195589 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.195292 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59bf3884-8cc8-4a80-a064-470c85186dda-konnectivity-ca\") pod \"konnectivity-agent-plf2w\" (UID: \"59bf3884-8cc8-4a80-a064-470c85186dda\") " pod="kube-system/konnectivity-agent-plf2w" Nov 04 05:50:02.195589 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.195342 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9525137-701e-46b7-8582-322cd59aaf48-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-hpqtm\" (UID: \"a9525137-701e-46b7-8582-322cd59aaf48\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-hpqtm" Nov 04 05:50:02.195589 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.195465 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nst9j\" (UniqueName: \"kubernetes.io/projected/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-kube-api-access-nst9j\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.195589 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.195509 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f227a09-ac46-4ab4-85db-cf57670ae3c1-cni-binary-copy\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.195589 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.195533 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b41e530-bd50-4905-8887-32286cfdedbf-metrics-client-ca\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:50:02.195589 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.195579 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.195750 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.195606 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-system-cni-dir\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.195750 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.195634 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8fdz\" (UniqueName: \"kubernetes.io/projected/0742c411-7597-48ae-a35d-82a7d69fafdb-kube-api-access-z8fdz\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:50:02.195750 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.195662 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rh8m\" (UniqueName: \"kubernetes.io/projected/e8cce0a3-8ffd-465e-8b77-d386fba907b5-kube-api-access-4rh8m\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:50:02.195750 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.195716 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-sys-fs\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:50:02.195750 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.195743 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccf93b8e-80a1-4ae6-9d4e-643760607116-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-d4p9r\" (UID: \"ccf93b8e-80a1-4ae6-9d4e-643760607116\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" Nov 04 05:50:02.195898 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.195771 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-hostroot\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.195898 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.195803 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-conf-dir\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.195898 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.195827 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-kubernetes\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.195898 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.195854 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-device-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:50:02.195898 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.195881 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.196084 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.195907 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-web-config\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.196084 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.196005 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccf93b8e-80a1-4ae6-9d4e-643760607116-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-d4p9r\" (UID: \"ccf93b8e-80a1-4ae6-9d4e-643760607116\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" Nov 04 05:50:02.196084 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.196051 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2bc8ee82-0a82-4157-99b0-53360f1cd919-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:50:02.196213 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.196202 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-cni-bin\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.196448 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.196417 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f227a09-ac46-4ab4-85db-cf57670ae3c1-cni-binary-copy\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.196581 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.196563 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.196664 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.196620 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/206b2e75-0735-49df-a53c-bdd17aab8ae6-ovn-node-metrics-cert\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.196756 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.196741 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2bc8ee82-0a82-4157-99b0-53360f1cd919-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:50:02.196805 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.196786 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2bc8ee82-0a82-4157-99b0-53360f1cd919-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:50:02.196837 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.196791 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-cni-netd\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.196865 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.196839 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-systemd\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.196894 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.196867 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/124a28d1-9d05-42d1-99d4-721942b23062-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-dmklg\" (UID: \"124a28d1-9d05-42d1-99d4-721942b23062\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" Nov 04 05:50:02.196926 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.196900 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8cce0a3-8ffd-465e-8b77-d386fba907b5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:50:02.196958 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.196937 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2bc8ee82-0a82-4157-99b0-53360f1cd919-cnibin\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:50:02.196987 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.196967 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/206b2e75-0735-49df-a53c-bdd17aab8ae6-ovnkube-config\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.197039 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.197028 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-config-out\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.197121 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.197108 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-config-out\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.197153 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.197109 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-run-netns\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.197153 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.197143 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0742c411-7597-48ae-a35d-82a7d69fafdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:50:02.197218 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.197182 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/237e2f40-006a-4b40-aa3e-6d0d05295e6d-host\") pod \"node-ca-xzkmv\" (UID: \"237e2f40-006a-4b40-aa3e-6d0d05295e6d\") " pod="openshift-image-registry/node-ca-xzkmv" Nov 04 05:50:02.197218 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.197197 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/206b2e75-0735-49df-a53c-bdd17aab8ae6-ovnkube-config\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.197272 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.197225 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbrdw\" (UniqueName: \"kubernetes.io/projected/237e2f40-006a-4b40-aa3e-6d0d05295e6d-kube-api-access-kbrdw\") pod \"node-ca-xzkmv\" (UID: \"237e2f40-006a-4b40-aa3e-6d0d05295e6d\") " pod="openshift-image-registry/node-ca-xzkmv" Nov 04 05:50:02.219214 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219028 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Nov 04 05:50:02.219214 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219044 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Nov 04 05:50:02.219214 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219090 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Nov 04 05:50:02.219214 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219134 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 04 05:50:02.219214 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219173 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Nov 04 05:50:02.219214 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219178 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Nov 04 05:50:02.219730 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219473 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-plv46\"" Nov 04 05:50:02.219730 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219472 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 04 05:50:02.219730 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219473 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Nov 04 05:50:02.219730 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219519 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Nov 04 05:50:02.219730 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219536 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Nov 04 05:50:02.219730 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219551 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-w257w\"" Nov 04 05:50:02.219730 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219539 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-njggn\"" Nov 04 05:50:02.219730 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219586 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fv6vj\"" Nov 04 05:50:02.219730 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219623 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h5w5l\"" Nov 04 05:50:02.219730 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219627 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4mrpf\"" Nov 04 05:50:02.219730 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219649 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Nov 04 05:50:02.219730 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219666 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-9zvpc\"" Nov 04 05:50:02.219730 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219690 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z7wx5\"" Nov 04 05:50:02.219730 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219701 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-mpd4s\"" Nov 04 05:50:02.219730 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219705 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Nov 04 05:50:02.220527 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219852 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 04 05:50:02.220527 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219855 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qt7t9\"" Nov 04 05:50:02.220527 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219873 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-7m57f\"" Nov 04 05:50:02.220527 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219871 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 04 05:50:02.220527 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219898 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Nov 04 05:50:02.220527 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219902 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Nov 04 05:50:02.220527 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.219984 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Nov 04 05:50:02.220527 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.220095 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-tk5dx\"" Nov 04 05:50:02.220527 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.220134 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tjrmr\"" Nov 04 05:50:02.220527 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.220156 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lflbx\"" Nov 04 05:50:02.220527 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.220161 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c8frb\"" Nov 04 05:50:02.220527 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.220179 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Nov 04 05:50:02.220527 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.220378 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Nov 04 05:50:02.220527 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.220434 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cq7vabkalqm0d\"" Nov 04 05:50:02.220527 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.220466 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Nov 04 05:50:02.220527 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.220529 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:50:02.221295 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.220592 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Nov 04 05:50:02.221295 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.220671 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Nov 04 05:50:02.221295 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.220740 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Nov 04 05:50:02.221295 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.220754 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-n6rcb\"" Nov 04 05:50:02.221295 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.220805 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 04 05:50:02.221295 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.221169 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-gcv4b\"" Nov 04 05:50:02.221295 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.221251 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Nov 04 05:50:02.221295 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.221280 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/635418a3-d2fd-4dcc-8893-8488f45988c0-original-pull-secret\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:50:02.221623 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.221317 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Nov 04 05:50:02.221623 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.221326 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Nov 04 05:50:02.221623 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.221322 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Nov 04 05:50:02.221623 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.221330 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Nov 04 05:50:02.221623 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.221349 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Nov 04 05:50:02.221623 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.221457 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Nov 04 05:50:02.221838 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.221684 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.221959 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.221942 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cxbnx\"" Nov 04 05:50:02.222090 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.222058 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-rt5s6\"" Nov 04 05:50:02.222156 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.222125 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jwct4\"" Nov 04 05:50:02.222156 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.222149 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/807edbb8-055e-4796-b4dd-b254a93313f6-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:50:02.222277 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.222209 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 04 05:50:02.222277 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.222252 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.222505 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.222489 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Nov 04 05:50:02.222582 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.222563 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/807edbb8-055e-4796-b4dd-b254a93313f6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:50:02.226394 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.222659 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.226394 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.222844 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-tls\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:50:02.226394 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.222990 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.226394 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.223183 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-cpsjc\"" Nov 04 05:50:02.226394 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.223254 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.226394 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.223318 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-965kt\"" Nov 04 05:50:02.226394 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.223681 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Nov 04 05:50:02.226394 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.223744 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-n6dm2\"" Nov 04 05:50:02.226394 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.223948 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/118d5d6d-e2b1-483f-a184-504325584502-tls-assets\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.226394 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.223996 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 04 05:50:02.226394 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.224122 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.226394 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.224403 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-config-volume\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.226394 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.224727 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.226394 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.224760 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 04 05:50:02.226394 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.224899 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-56hpuqiqiu35s\"" Nov 04 05:50:02.226394 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.225041 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a956a93b-8cf1-45ad-bcbf-409e331a02d1-metrics-tls\") pod \"dns-default-dxkjf\" (UID: \"a956a93b-8cf1-45ad-bcbf-409e331a02d1\") " pod="openshift-dns/dns-default-dxkjf" Nov 04 05:50:02.226394 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.225328 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.226394 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.225343 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59bf3884-8cc8-4a80-a064-470c85186dda-agent-certs\") pod \"konnectivity-agent-plf2w\" (UID: \"59bf3884-8cc8-4a80-a064-470c85186dda\") " pod="kube-system/konnectivity-agent-plf2w" Nov 04 05:50:02.226394 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.225525 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccf93b8e-80a1-4ae6-9d4e-643760607116-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-d4p9r\" (UID: \"ccf93b8e-80a1-4ae6-9d4e-643760607116\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" Nov 04 05:50:02.226394 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.226011 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9525137-701e-46b7-8582-322cd59aaf48-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-hpqtm\" (UID: \"a9525137-701e-46b7-8582-322cd59aaf48\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-hpqtm" Nov 04 05:50:02.226394 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.226352 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.227509 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.226573 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-web-config\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.227509 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.226749 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-web-config\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.227509 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.226783 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.227509 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.226813 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/124a28d1-9d05-42d1-99d4-721942b23062-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-dmklg\" (UID: \"124a28d1-9d05-42d1-99d4-721942b23062\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" Nov 04 05:50:02.227509 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.226927 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.227509 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.226973 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ccf93b8e-80a1-4ae6-9d4e-643760607116-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-d4p9r\" (UID: \"ccf93b8e-80a1-4ae6-9d4e-643760607116\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" Nov 04 05:50:02.227509 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.227006 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.227509 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.227055 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e8cce0a3-8ffd-465e-8b77-d386fba907b5-client-ca-bundle\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:50:02.227509 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.227110 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Nov 04 05:50:02.227509 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.227116 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5jcm9\"" Nov 04 05:50:02.227509 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.227292 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-config\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.227509 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.227293 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/206b2e75-0735-49df-a53c-bdd17aab8ae6-ovn-node-metrics-cert\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.227509 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.227361 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/124a28d1-9d05-42d1-99d4-721942b23062-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-dmklg\" (UID: \"124a28d1-9d05-42d1-99d4-721942b23062\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" Nov 04 05:50:02.229299 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.229270 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8z5zb\"" Nov 04 05:50:02.229516 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.229497 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-metrics-certs\") pod \"network-metrics-daemon-ssngm\" (UID: \"83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f\") " pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:50:02.230891 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.230871 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e8cce0a3-8ffd-465e-8b77-d386fba907b5-secret-metrics-server-client-certs\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:50:02.231447 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.231423 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.231557 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.231535 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8c71ae38-62e0-4de3-9cf9-c4ee58edd96a-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-sj64z\" (UID: \"8c71ae38-62e0-4de3-9cf9-c4ee58edd96a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sj64z" Nov 04 05:50:02.231607 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.231579 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63258d2f-36fe-483c-9d98-fefeffd43533-cert\") pod \"ingress-canary-vtpdd\" (UID: \"63258d2f-36fe-483c-9d98-fefeffd43533\") " pod="openshift-ingress-canary/ingress-canary-vtpdd" Nov 04 05:50:02.234907 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.234885 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e8cce0a3-8ffd-465e-8b77-d386fba907b5-secret-metrics-server-tls\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:50:02.234985 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.234904 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0742c411-7597-48ae-a35d-82a7d69fafdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:50:02.249235 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.249201 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 04 05:50:02.249235 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.249206 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Nov 04 05:50:02.249235 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.249220 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Nov 04 05:50:02.249477 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.249262 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Nov 04 05:50:02.249477 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.249323 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Nov 04 05:50:02.249477 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.249381 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 04 05:50:02.249477 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.249394 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 04 05:50:02.249477 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.249434 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 04 05:50:02.249477 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.249462 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 04 05:50:02.249764 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.249497 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 04 05:50:02.249764 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.249530 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 04 05:50:02.249764 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.249556 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Nov 04 05:50:02.249764 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.249565 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 04 05:50:02.249764 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.249556 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Nov 04 05:50:02.249980 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.249767 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Nov 04 05:50:02.249980 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.249805 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 04 05:50:02.249980 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.249833 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Nov 04 05:50:02.249980 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.249852 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 04 05:50:02.249980 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.249855 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 04 05:50:02.249980 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.249930 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Nov 04 05:50:02.255081 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.252577 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/124a28d1-9d05-42d1-99d4-721942b23062-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-dmklg\" (UID: \"124a28d1-9d05-42d1-99d4-721942b23062\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" Nov 04 05:50:02.255081 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.252590 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a956a93b-8cf1-45ad-bcbf-409e331a02d1-config-volume\") pod \"dns-default-dxkjf\" (UID: \"a956a93b-8cf1-45ad-bcbf-409e331a02d1\") " pod="openshift-dns/dns-default-dxkjf" Nov 04 05:50:02.255081 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.252635 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/118d5d6d-e2b1-483f-a184-504325584502-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.255081 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.252635 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/807edbb8-055e-4796-b4dd-b254a93313f6-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:50:02.255081 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.252697 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.255081 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.252759 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.255081 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.255015 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.255353 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.255121 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.255353 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.255129 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.257378 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.257335 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccf93b8e-80a1-4ae6-9d4e-643760607116-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-d4p9r\" (UID: \"ccf93b8e-80a1-4ae6-9d4e-643760607116\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" Nov 04 05:50:02.259666 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.259590 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0742c411-7597-48ae-a35d-82a7d69fafdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:50:02.259666 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.259609 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-accelerators-collector-config\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:50:02.259666 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.259622 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b41e530-bd50-4905-8887-32286cfdedbf-metrics-client-ca\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:50:02.259666 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.259643 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8cce0a3-8ffd-465e-8b77-d386fba907b5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:50:02.259858 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.259712 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e8cce0a3-8ffd-465e-8b77-d386fba907b5-metrics-server-audit-profiles\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:50:02.274363 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.274333 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Nov 04 05:50:02.279192 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.277254 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Nov 04 05:50:02.279192 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.277620 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Nov 04 05:50:02.279192 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.277778 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tlhk\" (UniqueName: \"kubernetes.io/projected/5dadf5f9-5bb9-4652-9d12-c4f17d327528-kube-api-access-5tlhk\") pod \"node-resolver-7cdk6\" (UID: \"5dadf5f9-5bb9-4652-9d12-c4f17d327528\") " pod="openshift-dns/node-resolver-7cdk6" Nov 04 05:50:02.279192 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.277787 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxkfl\" (UniqueName: \"kubernetes.io/projected/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-kube-api-access-dxkfl\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:50:02.279192 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.277911 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44hld\" (UniqueName: \"kubernetes.io/projected/7f227a09-ac46-4ab4-85db-cf57670ae3c1-kube-api-access-44hld\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.279192 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.278025 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg7t8\" (UniqueName: \"kubernetes.io/projected/a965dd43-4908-4a6a-9b2a-f3dc0590020e-kube-api-access-dg7t8\") pod \"downloads-6dd789c8b7-d8dqj\" (UID: \"a965dd43-4908-4a6a-9b2a-f3dc0590020e\") " pod="openshift-console/downloads-6dd789c8b7-d8dqj" Nov 04 05:50:02.279192 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.278102 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48twm\" (UniqueName: \"kubernetes.io/projected/6bde7db4-687a-4dcb-b490-2f88e2e4ea71-kube-api-access-48twm\") pod \"network-check-target-zc9wk\" (UID: \"6bde7db4-687a-4dcb-b490-2f88e2e4ea71\") " pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:50:02.279192 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.278155 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpvdq\" (UniqueName: \"kubernetes.io/projected/807edbb8-055e-4796-b4dd-b254a93313f6-kube-api-access-xpvdq\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:50:02.279192 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.278405 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrpdw\" (UniqueName: \"kubernetes.io/projected/f678b061-520c-474f-b4ab-7e5e6949100e-kube-api-access-wrpdw\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.279192 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.278457 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkggn\" (UniqueName: \"kubernetes.io/projected/a9525137-701e-46b7-8582-322cd59aaf48-kube-api-access-nkggn\") pod \"monitoring-plugin-77f4f76594-hpqtm\" (UID: \"a9525137-701e-46b7-8582-322cd59aaf48\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-hpqtm" Nov 04 05:50:02.279192 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.278464 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wx9c\" (UniqueName: \"kubernetes.io/projected/2bc8ee82-0a82-4157-99b0-53360f1cd919-kube-api-access-5wx9c\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:50:02.279192 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.278624 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjfjp\" (UniqueName: \"kubernetes.io/projected/a956a93b-8cf1-45ad-bcbf-409e331a02d1-kube-api-access-fjfjp\") pod \"dns-default-dxkjf\" (UID: \"a956a93b-8cf1-45ad-bcbf-409e331a02d1\") " pod="openshift-dns/dns-default-dxkjf" Nov 04 05:50:02.279192 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.278637 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6jqz\" (UniqueName: \"kubernetes.io/projected/83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f-kube-api-access-n6jqz\") pod \"network-metrics-daemon-ssngm\" (UID: \"83e1cac7-f70a-4ddc-91d7-a6e9e8fd065f\") " pod="openshift-multus/network-metrics-daemon-ssngm" Nov 04 05:50:02.279192 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.278628 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w44fz\" (UniqueName: \"kubernetes.io/projected/bcf9e13b-7029-4567-85b8-4d53bca32fef-kube-api-access-w44fz\") pod \"iptables-alerter-pc5sk\" (UID: \"bcf9e13b-7029-4567-85b8-4d53bca32fef\") " pod="openshift-network-operator/iptables-alerter-pc5sk" Nov 04 05:50:02.279192 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.279045 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbrdw\" (UniqueName: \"kubernetes.io/projected/237e2f40-006a-4b40-aa3e-6d0d05295e6d-kube-api-access-kbrdw\") pod \"node-ca-xzkmv\" (UID: \"237e2f40-006a-4b40-aa3e-6d0d05295e6d\") " pod="openshift-image-registry/node-ca-xzkmv" Nov 04 05:50:02.280277 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.279381 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmxjw\" (UniqueName: \"kubernetes.io/projected/ccf93b8e-80a1-4ae6-9d4e-643760607116-kube-api-access-lmxjw\") pod \"prometheus-operator-9cd89b74c-d4p9r\" (UID: \"ccf93b8e-80a1-4ae6-9d4e-643760607116\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-d4p9r" Nov 04 05:50:02.280277 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.279396 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nst9j\" (UniqueName: \"kubernetes.io/projected/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-kube-api-access-nst9j\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.280277 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.279821 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfhg5\" (UniqueName: \"kubernetes.io/projected/3b41e530-bd50-4905-8887-32286cfdedbf-kube-api-access-nfhg5\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:50:02.280277 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.280030 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtt5b\" (UniqueName: \"kubernetes.io/projected/124a28d1-9d05-42d1-99d4-721942b23062-kube-api-access-mtt5b\") pod \"openshift-state-metrics-7bd7489957-dmklg\" (UID: \"124a28d1-9d05-42d1-99d4-721942b23062\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-dmklg" Nov 04 05:50:02.280277 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.280113 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljlvq\" (UniqueName: \"kubernetes.io/projected/63258d2f-36fe-483c-9d98-fefeffd43533-kube-api-access-ljlvq\") pod \"ingress-canary-vtpdd\" (UID: \"63258d2f-36fe-483c-9d98-fefeffd43533\") " pod="openshift-ingress-canary/ingress-canary-vtpdd" Nov 04 05:50:02.280418 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.280330 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fldv\" (UniqueName: \"kubernetes.io/projected/118d5d6d-e2b1-483f-a184-504325584502-kube-api-access-4fldv\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.280716 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.280694 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcqrv\" (UniqueName: \"kubernetes.io/projected/206b2e75-0735-49df-a53c-bdd17aab8ae6-kube-api-access-hcqrv\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.280802 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.280749 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8fdz\" (UniqueName: \"kubernetes.io/projected/0742c411-7597-48ae-a35d-82a7d69fafdb-kube-api-access-z8fdz\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:50:02.280947 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.280929 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rh8m\" (UniqueName: \"kubernetes.io/projected/e8cce0a3-8ffd-465e-8b77-d386fba907b5-kube-api-access-4rh8m\") pod \"metrics-server-f6b6d94bc-bxlj7\" (UID: \"e8cce0a3-8ffd-465e-8b77-d386fba907b5\") " pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:50:02.281961 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.281939 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Nov 04 05:50:02.282760 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.282739 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.282912 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.282895 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/807edbb8-055e-4796-b4dd-b254a93313f6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-fffzx\" (UID: \"807edbb8-055e-4796-b4dd-b254a93313f6\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-fffzx" Nov 04 05:50:02.286479 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.286459 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/118d5d6d-e2b1-483f-a184-504325584502-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:02.287793 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.287775 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:02.298571 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298543 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-etc-openvswitch\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.298674 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298580 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-etc-kubernetes\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.298674 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298600 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-host\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.298674 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298625 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5dadf5f9-5bb9-4652-9d12-c4f17d327528-hosts-file\") pod \"node-resolver-7cdk6\" (UID: \"5dadf5f9-5bb9-4652-9d12-c4f17d327528\") " pod="openshift-dns/node-resolver-7cdk6" Nov 04 05:50:02.298674 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298644 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-etc-openvswitch\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.298674 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298655 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-etc-kubernetes\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.298874 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298649 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-modprobe-d\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.298874 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298681 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-host\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.298874 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298701 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-modprobe-d\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.298874 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298703 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5dadf5f9-5bb9-4652-9d12-c4f17d327528-hosts-file\") pod \"node-resolver-7cdk6\" (UID: \"5dadf5f9-5bb9-4652-9d12-c4f17d327528\") " pod="openshift-dns/node-resolver-7cdk6" Nov 04 05:50:02.298874 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298729 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-run-k8s-cni-cncf-io\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.298874 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298747 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-var-lib-kubelet\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.298874 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298785 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-run-systemd\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.298874 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298790 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-run-k8s-cni-cncf-io\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.298874 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298797 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-var-lib-kubelet\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.298874 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298813 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:50:02.298874 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298822 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-run-systemd\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.298874 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298838 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-socket-dir-parent\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.298874 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298862 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:50:02.298874 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298867 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-sysconfig\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.298874 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298883 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-lib-modules\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298898 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/635418a3-d2fd-4dcc-8893-8488f45988c0-dbus\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298900 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-socket-dir-parent\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298922 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298934 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-sysconfig\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298948 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/635418a3-d2fd-4dcc-8893-8488f45988c0-dbus\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298953 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-run-ovn-kubernetes\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298973 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298982 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-run-ovn-kubernetes\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.298988 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-log-socket\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299008 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-log-socket\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299014 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-cni-dir\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299026 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-lib-modules\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299037 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-cnibin\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299081 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-run\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299097 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-cnibin\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299107 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-socket-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299122 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-cni-dir\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299133 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-systemd-units\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299140 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-run\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299167 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-systemd-units\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299168 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-run-ovn\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299173 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-socket-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299194 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-wtmp\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299201 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-run-ovn\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299209 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-sys\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299235 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-sys\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299235 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/635418a3-d2fd-4dcc-8893-8488f45988c0-kubelet-config\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299262 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-run-openvswitch\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299275 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/635418a3-d2fd-4dcc-8893-8488f45988c0-kubelet-config\") pod \"global-pull-secret-syncer-9vrcj\" (UID: \"635418a3-d2fd-4dcc-8893-8488f45988c0\") " pod="kube-system/global-pull-secret-syncer-9vrcj" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299265 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b41e530-bd50-4905-8887-32286cfdedbf-node-exporter-wtmp\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299292 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-var-lib-kubelet\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299303 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-run-openvswitch\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299318 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-registration-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299338 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-var-lib-kubelet\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299344 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bcf9e13b-7029-4567-85b8-4d53bca32fef-host-slash\") pod \"iptables-alerter-pc5sk\" (UID: \"bcf9e13b-7029-4567-85b8-4d53bca32fef\") " pod="openshift-network-operator/iptables-alerter-pc5sk" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299374 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-registration-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299376 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-run-multus-certs\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299399 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bcf9e13b-7029-4567-85b8-4d53bca32fef-host-slash\") pod \"iptables-alerter-pc5sk\" (UID: \"bcf9e13b-7029-4567-85b8-4d53bca32fef\") " pod="openshift-network-operator/iptables-alerter-pc5sk" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299400 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-sysctl-d\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299421 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-run-multus-certs\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299428 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-sysctl-conf\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299453 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-run-netns\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299481 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-var-lib-openvswitch\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299509 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-sysctl-d\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299512 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-system-cni-dir\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299533 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-run-netns\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.299513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299538 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-sys-fs\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299559 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-var-lib-openvswitch\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299564 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-sysctl-conf\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299580 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-hostroot\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299594 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-system-cni-dir\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299604 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-conf-dir\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299627 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-kubernetes\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299626 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-hostroot\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299641 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-sys-fs\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299650 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-device-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299661 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-multus-conf-dir\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299677 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-kubernetes\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299679 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-cni-bin\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299702 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2bc8ee82-0a82-4157-99b0-53360f1cd919-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299714 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-device-dir\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299725 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-cni-netd\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299737 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-cni-bin\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299748 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-systemd\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299764 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2bc8ee82-0a82-4157-99b0-53360f1cd919-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299767 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-cni-netd\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299783 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2bc8ee82-0a82-4157-99b0-53360f1cd919-cnibin\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299799 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f678b061-520c-474f-b4ab-7e5e6949100e-etc-systemd\") pod \"tuned-848sz\" (UID: \"f678b061-520c-474f-b4ab-7e5e6949100e\") " pod="openshift-cluster-node-tuning-operator/tuned-848sz" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299810 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-run-netns\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299826 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/237e2f40-006a-4b40-aa3e-6d0d05295e6d-host\") pod \"node-ca-xzkmv\" (UID: \"237e2f40-006a-4b40-aa3e-6d0d05295e6d\") " pod="openshift-image-registry/node-ca-xzkmv" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299840 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-kubelet\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299860 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-var-lib-cni-multus\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299884 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-node-log\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299890 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/237e2f40-006a-4b40-aa3e-6d0d05295e6d-host\") pod \"node-ca-xzkmv\" (UID: \"237e2f40-006a-4b40-aa3e-6d0d05295e6d\") " pod="openshift-image-registry/node-ca-xzkmv" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299900 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-run-netns\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299910 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-kubelet\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299904 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-var-lib-cni-bin\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299929 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-node-log\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299942 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-var-lib-cni-multus\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299929 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2bc8ee82-0a82-4157-99b0-53360f1cd919-cnibin\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299932 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f227a09-ac46-4ab4-85db-cf57670ae3c1-host-var-lib-cni-bin\") pod \"multus-5jn26\" (UID: \"7f227a09-ac46-4ab4-85db-cf57670ae3c1\") " pod="openshift-multus/multus-5jn26" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.299973 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b41e530-bd50-4905-8887-32286cfdedbf-sys\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.300009 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b41e530-bd50-4905-8887-32286cfdedbf-sys\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.300014 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2bc8ee82-0a82-4157-99b0-53360f1cd919-system-cni-dir\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.300034 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-slash\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.300054 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0742c411-7597-48ae-a35d-82a7d69fafdb-crio-socket\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.300105 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/206b2e75-0735-49df-a53c-bdd17aab8ae6-host-slash\") pod \"ovnkube-node-qvgv2\" (UID: \"206b2e75-0735-49df-a53c-bdd17aab8ae6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.300104 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b41e530-bd50-4905-8887-32286cfdedbf-root\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.300135 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-etc-selinux\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.300135 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b41e530-bd50-4905-8887-32286cfdedbf-root\") pod \"node-exporter-lzjh2\" (UID: \"3b41e530-bd50-4905-8887-32286cfdedbf\") " pod="openshift-monitoring/node-exporter-lzjh2" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.300278 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2bc8ee82-0a82-4157-99b0-53360f1cd919-system-cni-dir\") pod \"multus-additional-cni-plugins-tqz8r\" (UID: \"2bc8ee82-0a82-4157-99b0-53360f1cd919\") " pod="openshift-multus/multus-additional-cni-plugins-tqz8r" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.300336 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8d1e5946-91d6-4ab7-a2da-1fafe37ceffc-etc-selinux\") pod \"aws-ebs-csi-driver-node-9trj4\" (UID: \"8d1e5946-91d6-4ab7-a2da-1fafe37ceffc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9trj4" Nov 04 05:50:02.301310 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.300383 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0742c411-7597-48ae-a35d-82a7d69fafdb-crio-socket\") pod \"insights-runtime-extractor-flcbl\" (UID: \"0742c411-7597-48ae-a35d-82a7d69fafdb\") " pod="openshift-insights/insights-runtime-extractor-flcbl" Nov 04 05:50:02.401713 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:02.401690 5784 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 05:50:03.384774 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:03.384740 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:03.550696 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:03.550621 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-sj64z" Nov 04 05:50:03.767375 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:03.767347 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dxkjf" Nov 04 05:50:04.090895 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:04.090850 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fd3b4e2-6b29-4162-924a-4a36bf4bf647","Type":"ContainerStarted","Data":"090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a"} Nov 04 05:50:04.091057 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:04.090971 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fd3b4e2-6b29-4162-924a-4a36bf4bf647","Type":"ContainerStarted","Data":"e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c"} Nov 04 05:50:05.641960 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:05.641930 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:05.642414 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:05.642175 5784 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 05:50:05.668598 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:05.668573 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:50:06.109046 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:06.109018 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fd3b4e2-6b29-4162-924a-4a36bf4bf647","Type":"ContainerStarted","Data":"ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0"} Nov 04 05:50:06.109195 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:06.109109 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fd3b4e2-6b29-4162-924a-4a36bf4bf647","Type":"ContainerStarted","Data":"23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c"} Nov 04 05:50:06.995421 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:06.995386 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvgv2" Nov 04 05:50:07.120550 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:07.120514 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fd3b4e2-6b29-4162-924a-4a36bf4bf647","Type":"ContainerStarted","Data":"1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc"} Nov 04 05:50:07.120726 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:07.120625 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fd3b4e2-6b29-4162-924a-4a36bf4bf647","Type":"ContainerStarted","Data":"e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f"} Nov 04 05:50:07.456542 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:07.456503 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:10.312663 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:10.312571 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-hpqtm" Nov 04 05:50:10.318413 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:10.318346 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-hpqtm" Nov 04 05:50:11.432510 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:11.432479 5784 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-45.us-west-1.compute.internal" event="NodeReady" Nov 04 05:50:15.420005 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:15.419965 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 05:50:17.862576 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:17.862535 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:50:20.180303 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:20.180263 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-d8dqj" event={"ID":"a965dd43-4908-4a6a-9b2a-f3dc0590020e","Type":"ContainerStarted","Data":"db064cee1889b090d8b0547dbfc9191ad1b80100a44637dd7e5fc8e272a59228"} Nov 04 05:50:20.180779 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:20.180597 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-d8dqj" Nov 04 05:50:20.194811 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:20.194777 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-d8dqj" Nov 04 05:50:20.362668 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:20.362631 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:50:30.414032 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:30.413995 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:30.458283 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:30.458251 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:30.824020 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:30.823992 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-plf2w" Nov 04 05:50:31.245093 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:31.245018 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:35.671106 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:35.671041 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zc9wk" Nov 04 05:50:37.868311 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:37.868274 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:50:37.871977 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:37.871948 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-f6b6d94bc-bxlj7" Nov 04 05:50:41.743947 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:41.743908 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 04 05:50:41.744485 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:41.744359 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="kube-rbac-proxy-metric" containerID="cri-o://733888de895e7bc07d7eac07d68bbc821f0d7a1070da009efd6e9103e39f4761" gracePeriod=120 Nov 04 05:50:41.744485 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:41.744358 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="alertmanager" containerID="cri-o://dd87b816343b5b53c132b5874a69d21f73d144d6db265d92f1ee383c06070888" gracePeriod=120 Nov 04 05:50:41.744485 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:41.744402 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="kube-rbac-proxy-web" containerID="cri-o://5b7e16676510edaa758231bf5676dcaee38d5722b3060b27776c4430aea9723f" gracePeriod=120 Nov 04 05:50:41.744485 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:41.744402 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="config-reloader" containerID="cri-o://40869f32d4c952722524c5d727fdb5703d4c5aa030982407070a96159efac35a" gracePeriod=120 Nov 04 05:50:41.744485 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:41.744441 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="kube-rbac-proxy" containerID="cri-o://8e0a6319d95fbb34adce7b3d2d4bbcd1b5b6d154f5f19db2a7e38206e0c56f53" gracePeriod=120 Nov 04 05:50:41.744754 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:41.744457 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="prom-label-proxy" containerID="cri-o://5ee88ab8ae9756eb80c09ae413c689af693455bbd339d9dd0f3b23c51301162b" gracePeriod=120 Nov 04 05:50:42.269581 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:42.269549 5784 generic.go:356] "Generic (PLEG): container finished" podID="118d5d6d-e2b1-483f-a184-504325584502" containerID="5ee88ab8ae9756eb80c09ae413c689af693455bbd339d9dd0f3b23c51301162b" exitCode=0 Nov 04 05:50:42.269581 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:42.269574 5784 generic.go:356] "Generic (PLEG): container finished" podID="118d5d6d-e2b1-483f-a184-504325584502" containerID="8e0a6319d95fbb34adce7b3d2d4bbcd1b5b6d154f5f19db2a7e38206e0c56f53" exitCode=0 Nov 04 05:50:42.269581 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:42.269580 5784 generic.go:356] "Generic (PLEG): container finished" podID="118d5d6d-e2b1-483f-a184-504325584502" containerID="40869f32d4c952722524c5d727fdb5703d4c5aa030982407070a96159efac35a" exitCode=0 Nov 04 05:50:42.269581 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:42.269586 5784 generic.go:356] "Generic (PLEG): container finished" podID="118d5d6d-e2b1-483f-a184-504325584502" containerID="dd87b816343b5b53c132b5874a69d21f73d144d6db265d92f1ee383c06070888" exitCode=0 Nov 04 05:50:42.269855 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:42.269621 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"118d5d6d-e2b1-483f-a184-504325584502","Type":"ContainerDied","Data":"5ee88ab8ae9756eb80c09ae413c689af693455bbd339d9dd0f3b23c51301162b"} Nov 04 05:50:42.269855 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:42.269681 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"118d5d6d-e2b1-483f-a184-504325584502","Type":"ContainerDied","Data":"8e0a6319d95fbb34adce7b3d2d4bbcd1b5b6d154f5f19db2a7e38206e0c56f53"} Nov 04 05:50:42.269855 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:42.269709 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"118d5d6d-e2b1-483f-a184-504325584502","Type":"ContainerDied","Data":"40869f32d4c952722524c5d727fdb5703d4c5aa030982407070a96159efac35a"} Nov 04 05:50:42.269855 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:42.269734 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"118d5d6d-e2b1-483f-a184-504325584502","Type":"ContainerDied","Data":"dd87b816343b5b53c132b5874a69d21f73d144d6db265d92f1ee383c06070888"} Nov 04 05:50:43.043192 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.043162 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.165345 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.165316 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/118d5d6d-e2b1-483f-a184-504325584502-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/118d5d6d-e2b1-483f-a184-504325584502-alertmanager-trusted-ca-bundle\") pod \"118d5d6d-e2b1-483f-a184-504325584502\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " Nov 04 05:50:43.165518 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.165358 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy\") pod \"118d5d6d-e2b1-483f-a184-504325584502\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " Nov 04 05:50:43.165518 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.165390 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/118d5d6d-e2b1-483f-a184-504325584502-tls-assets\" (UniqueName: \"kubernetes.io/projected/118d5d6d-e2b1-483f-a184-504325584502-tls-assets\") pod \"118d5d6d-e2b1-483f-a184-504325584502\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " Nov 04 05:50:43.165518 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.165420 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-config-volume\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-config-volume\") pod \"118d5d6d-e2b1-483f-a184-504325584502\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " Nov 04 05:50:43.165518 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.165453 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/118d5d6d-e2b1-483f-a184-504325584502-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/118d5d6d-e2b1-483f-a184-504325584502-metrics-client-ca\") pod \"118d5d6d-e2b1-483f-a184-504325584502\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " Nov 04 05:50:43.165518 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.165483 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/118d5d6d-e2b1-483f-a184-504325584502-config-out\" (UniqueName: \"kubernetes.io/empty-dir/118d5d6d-e2b1-483f-a184-504325584502-config-out\") pod \"118d5d6d-e2b1-483f-a184-504325584502\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " Nov 04 05:50:43.165518 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.165517 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-main-tls\") pod \"118d5d6d-e2b1-483f-a184-504325584502\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " Nov 04 05:50:43.165831 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.165544 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy-metric\") pod \"118d5d6d-e2b1-483f-a184-504325584502\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " Nov 04 05:50:43.165831 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.165573 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/118d5d6d-e2b1-483f-a184-504325584502-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/118d5d6d-e2b1-483f-a184-504325584502-alertmanager-main-db\") pod \"118d5d6d-e2b1-483f-a184-504325584502\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " Nov 04 05:50:43.165831 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.165617 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/118d5d6d-e2b1-483f-a184-504325584502-kube-api-access-4fldv\" (UniqueName: \"kubernetes.io/projected/118d5d6d-e2b1-483f-a184-504325584502-kube-api-access-4fldv\") pod \"118d5d6d-e2b1-483f-a184-504325584502\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " Nov 04 05:50:43.165831 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.165648 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy-web\") pod \"118d5d6d-e2b1-483f-a184-504325584502\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " Nov 04 05:50:43.165831 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.165690 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-web-config\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-web-config\") pod \"118d5d6d-e2b1-483f-a184-504325584502\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " Nov 04 05:50:43.165831 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.165721 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-cluster-tls-config\") pod \"118d5d6d-e2b1-483f-a184-504325584502\" (UID: \"118d5d6d-e2b1-483f-a184-504325584502\") " Nov 04 05:50:43.165831 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.165796 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/118d5d6d-e2b1-483f-a184-504325584502-alertmanager-trusted-ca-bundle" pod "118d5d6d-e2b1-483f-a184-504325584502" (UID: "118d5d6d-e2b1-483f-a184-504325584502"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:50:43.166248 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.165904 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/118d5d6d-e2b1-483f-a184-504325584502-metrics-client-ca" pod "118d5d6d-e2b1-483f-a184-504325584502" (UID: "118d5d6d-e2b1-483f-a184-504325584502"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:50:43.166248 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.166011 5784 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/118d5d6d-e2b1-483f-a184-504325584502-metrics-client-ca\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:43.166248 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.166033 5784 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/118d5d6d-e2b1-483f-a184-504325584502-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:43.166736 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.166708 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/118d5d6d-e2b1-483f-a184-504325584502-alertmanager-main-db" pod "118d5d6d-e2b1-483f-a184-504325584502" (UID: "118d5d6d-e2b1-483f-a184-504325584502"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:50:43.169431 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.169375 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy" pod "118d5d6d-e2b1-483f-a184-504325584502" (UID: "118d5d6d-e2b1-483f-a184-504325584502"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:50:43.169431 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.169420 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/118d5d6d-e2b1-483f-a184-504325584502-config-out" pod "118d5d6d-e2b1-483f-a184-504325584502" (UID: "118d5d6d-e2b1-483f-a184-504325584502"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:50:43.169599 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.169441 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/118d5d6d-e2b1-483f-a184-504325584502-tls-assets" pod "118d5d6d-e2b1-483f-a184-504325584502" (UID: "118d5d6d-e2b1-483f-a184-504325584502"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:50:43.169599 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.169538 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-main-tls" pod "118d5d6d-e2b1-483f-a184-504325584502" (UID: "118d5d6d-e2b1-483f-a184-504325584502"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:50:43.169731 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.169687 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy-metric" pod "118d5d6d-e2b1-483f-a184-504325584502" (UID: "118d5d6d-e2b1-483f-a184-504325584502"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:50:43.169793 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.169761 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-config-volume" pod "118d5d6d-e2b1-483f-a184-504325584502" (UID: "118d5d6d-e2b1-483f-a184-504325584502"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:50:43.169914 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.169892 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/118d5d6d-e2b1-483f-a184-504325584502-kube-api-access-4fldv" pod "118d5d6d-e2b1-483f-a184-504325584502" (UID: "118d5d6d-e2b1-483f-a184-504325584502"). InnerVolumeSpecName "kube-api-access-4fldv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:50:43.170337 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.170318 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy-web" pod "118d5d6d-e2b1-483f-a184-504325584502" (UID: "118d5d6d-e2b1-483f-a184-504325584502"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:50:43.172905 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.172882 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-cluster-tls-config" pod "118d5d6d-e2b1-483f-a184-504325584502" (UID: "118d5d6d-e2b1-483f-a184-504325584502"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:50:43.180200 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.180173 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-web-config" pod "118d5d6d-e2b1-483f-a184-504325584502" (UID: "118d5d6d-e2b1-483f-a184-504325584502"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:50:43.267136 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.267104 5784 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-config-volume\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:43.267136 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.267129 5784 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/118d5d6d-e2b1-483f-a184-504325584502-config-out\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:43.267136 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.267140 5784 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-main-tls\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:43.267348 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.267150 5784 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:43.267348 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.267162 5784 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/118d5d6d-e2b1-483f-a184-504325584502-alertmanager-main-db\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:43.267348 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.267171 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fldv\" (UniqueName: \"kubernetes.io/projected/118d5d6d-e2b1-483f-a184-504325584502-kube-api-access-4fldv\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:43.267348 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.267179 5784 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:43.267348 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.267208 5784 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-web-config\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:43.267348 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.267217 5784 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-cluster-tls-config\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:43.267348 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.267229 5784 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/118d5d6d-e2b1-483f-a184-504325584502-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:43.267348 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.267239 5784 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/118d5d6d-e2b1-483f-a184-504325584502-tls-assets\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:43.276467 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.276436 5784 generic.go:356] "Generic (PLEG): container finished" podID="118d5d6d-e2b1-483f-a184-504325584502" containerID="733888de895e7bc07d7eac07d68bbc821f0d7a1070da009efd6e9103e39f4761" exitCode=0 Nov 04 05:50:43.276467 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.276466 5784 generic.go:356] "Generic (PLEG): container finished" podID="118d5d6d-e2b1-483f-a184-504325584502" containerID="5b7e16676510edaa758231bf5676dcaee38d5722b3060b27776c4430aea9723f" exitCode=0 Nov 04 05:50:43.276673 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.276514 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"118d5d6d-e2b1-483f-a184-504325584502","Type":"ContainerDied","Data":"733888de895e7bc07d7eac07d68bbc821f0d7a1070da009efd6e9103e39f4761"} Nov 04 05:50:43.276673 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.276531 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.276673 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.276627 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"118d5d6d-e2b1-483f-a184-504325584502","Type":"ContainerDied","Data":"5b7e16676510edaa758231bf5676dcaee38d5722b3060b27776c4430aea9723f"} Nov 04 05:50:43.277250 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.277143 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"118d5d6d-e2b1-483f-a184-504325584502","Type":"ContainerDied","Data":"c6d5d696cce085b262640af2bcdf3f34ea286ed770e40988c5dbee5ae7c7d22d"} Nov 04 05:50:43.277407 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.277379 5784 scope.go:122] "RemoveContainer" containerID="5ee88ab8ae9756eb80c09ae413c689af693455bbd339d9dd0f3b23c51301162b" Nov 04 05:50:43.286700 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.286679 5784 scope.go:122] "RemoveContainer" containerID="733888de895e7bc07d7eac07d68bbc821f0d7a1070da009efd6e9103e39f4761" Nov 04 05:50:43.293835 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.293742 5784 scope.go:122] "RemoveContainer" containerID="8e0a6319d95fbb34adce7b3d2d4bbcd1b5b6d154f5f19db2a7e38206e0c56f53" Nov 04 05:50:43.303491 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.303465 5784 scope.go:122] "RemoveContainer" containerID="5b7e16676510edaa758231bf5676dcaee38d5722b3060b27776c4430aea9723f" Nov 04 05:50:43.311460 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.311443 5784 scope.go:122] "RemoveContainer" containerID="40869f32d4c952722524c5d727fdb5703d4c5aa030982407070a96159efac35a" Nov 04 05:50:43.318361 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.318329 5784 scope.go:122] "RemoveContainer" containerID="dd87b816343b5b53c132b5874a69d21f73d144d6db265d92f1ee383c06070888" Nov 04 05:50:43.325838 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.325822 5784 scope.go:122] "RemoveContainer" containerID="6b2276a8819cb9615329740c4650032907a9938d58e7f017f007cf028b173db9" Nov 04 05:50:43.332938 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.332916 5784 scope.go:122] "RemoveContainer" containerID="5ee88ab8ae9756eb80c09ae413c689af693455bbd339d9dd0f3b23c51301162b" Nov 04 05:50:43.333230 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:43.333210 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ee88ab8ae9756eb80c09ae413c689af693455bbd339d9dd0f3b23c51301162b\": container with ID starting with 5ee88ab8ae9756eb80c09ae413c689af693455bbd339d9dd0f3b23c51301162b not found: ID does not exist" containerID="5ee88ab8ae9756eb80c09ae413c689af693455bbd339d9dd0f3b23c51301162b" Nov 04 05:50:43.333293 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.333241 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ee88ab8ae9756eb80c09ae413c689af693455bbd339d9dd0f3b23c51301162b"} err="failed to get container status \"5ee88ab8ae9756eb80c09ae413c689af693455bbd339d9dd0f3b23c51301162b\": rpc error: code = NotFound desc = could not find container \"5ee88ab8ae9756eb80c09ae413c689af693455bbd339d9dd0f3b23c51301162b\": container with ID starting with 5ee88ab8ae9756eb80c09ae413c689af693455bbd339d9dd0f3b23c51301162b not found: ID does not exist" Nov 04 05:50:43.333293 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.333275 5784 scope.go:122] "RemoveContainer" containerID="733888de895e7bc07d7eac07d68bbc821f0d7a1070da009efd6e9103e39f4761" Nov 04 05:50:43.333555 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:43.333525 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"733888de895e7bc07d7eac07d68bbc821f0d7a1070da009efd6e9103e39f4761\": container with ID starting with 733888de895e7bc07d7eac07d68bbc821f0d7a1070da009efd6e9103e39f4761 not found: ID does not exist" containerID="733888de895e7bc07d7eac07d68bbc821f0d7a1070da009efd6e9103e39f4761" Nov 04 05:50:43.333609 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.333562 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"733888de895e7bc07d7eac07d68bbc821f0d7a1070da009efd6e9103e39f4761"} err="failed to get container status \"733888de895e7bc07d7eac07d68bbc821f0d7a1070da009efd6e9103e39f4761\": rpc error: code = NotFound desc = could not find container \"733888de895e7bc07d7eac07d68bbc821f0d7a1070da009efd6e9103e39f4761\": container with ID starting with 733888de895e7bc07d7eac07d68bbc821f0d7a1070da009efd6e9103e39f4761 not found: ID does not exist" Nov 04 05:50:43.333609 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.333579 5784 scope.go:122] "RemoveContainer" containerID="8e0a6319d95fbb34adce7b3d2d4bbcd1b5b6d154f5f19db2a7e38206e0c56f53" Nov 04 05:50:43.333804 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:43.333785 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e0a6319d95fbb34adce7b3d2d4bbcd1b5b6d154f5f19db2a7e38206e0c56f53\": container with ID starting with 8e0a6319d95fbb34adce7b3d2d4bbcd1b5b6d154f5f19db2a7e38206e0c56f53 not found: ID does not exist" containerID="8e0a6319d95fbb34adce7b3d2d4bbcd1b5b6d154f5f19db2a7e38206e0c56f53" Nov 04 05:50:43.333895 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.333807 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e0a6319d95fbb34adce7b3d2d4bbcd1b5b6d154f5f19db2a7e38206e0c56f53"} err="failed to get container status \"8e0a6319d95fbb34adce7b3d2d4bbcd1b5b6d154f5f19db2a7e38206e0c56f53\": rpc error: code = NotFound desc = could not find container \"8e0a6319d95fbb34adce7b3d2d4bbcd1b5b6d154f5f19db2a7e38206e0c56f53\": container with ID starting with 8e0a6319d95fbb34adce7b3d2d4bbcd1b5b6d154f5f19db2a7e38206e0c56f53 not found: ID does not exist" Nov 04 05:50:43.333895 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.333827 5784 scope.go:122] "RemoveContainer" containerID="5b7e16676510edaa758231bf5676dcaee38d5722b3060b27776c4430aea9723f" Nov 04 05:50:43.334116 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:43.334097 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b7e16676510edaa758231bf5676dcaee38d5722b3060b27776c4430aea9723f\": container with ID starting with 5b7e16676510edaa758231bf5676dcaee38d5722b3060b27776c4430aea9723f not found: ID does not exist" containerID="5b7e16676510edaa758231bf5676dcaee38d5722b3060b27776c4430aea9723f" Nov 04 05:50:43.334224 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.334121 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b7e16676510edaa758231bf5676dcaee38d5722b3060b27776c4430aea9723f"} err="failed to get container status \"5b7e16676510edaa758231bf5676dcaee38d5722b3060b27776c4430aea9723f\": rpc error: code = NotFound desc = could not find container \"5b7e16676510edaa758231bf5676dcaee38d5722b3060b27776c4430aea9723f\": container with ID starting with 5b7e16676510edaa758231bf5676dcaee38d5722b3060b27776c4430aea9723f not found: ID does not exist" Nov 04 05:50:43.334224 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.334140 5784 scope.go:122] "RemoveContainer" containerID="40869f32d4c952722524c5d727fdb5703d4c5aa030982407070a96159efac35a" Nov 04 05:50:43.334394 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:43.334373 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40869f32d4c952722524c5d727fdb5703d4c5aa030982407070a96159efac35a\": container with ID starting with 40869f32d4c952722524c5d727fdb5703d4c5aa030982407070a96159efac35a not found: ID does not exist" containerID="40869f32d4c952722524c5d727fdb5703d4c5aa030982407070a96159efac35a" Nov 04 05:50:43.334433 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.334401 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40869f32d4c952722524c5d727fdb5703d4c5aa030982407070a96159efac35a"} err="failed to get container status \"40869f32d4c952722524c5d727fdb5703d4c5aa030982407070a96159efac35a\": rpc error: code = NotFound desc = could not find container \"40869f32d4c952722524c5d727fdb5703d4c5aa030982407070a96159efac35a\": container with ID starting with 40869f32d4c952722524c5d727fdb5703d4c5aa030982407070a96159efac35a not found: ID does not exist" Nov 04 05:50:43.334433 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.334416 5784 scope.go:122] "RemoveContainer" containerID="dd87b816343b5b53c132b5874a69d21f73d144d6db265d92f1ee383c06070888" Nov 04 05:50:43.334666 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:43.334646 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd87b816343b5b53c132b5874a69d21f73d144d6db265d92f1ee383c06070888\": container with ID starting with dd87b816343b5b53c132b5874a69d21f73d144d6db265d92f1ee383c06070888 not found: ID does not exist" containerID="dd87b816343b5b53c132b5874a69d21f73d144d6db265d92f1ee383c06070888" Nov 04 05:50:43.334744 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.334679 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd87b816343b5b53c132b5874a69d21f73d144d6db265d92f1ee383c06070888"} err="failed to get container status \"dd87b816343b5b53c132b5874a69d21f73d144d6db265d92f1ee383c06070888\": rpc error: code = NotFound desc = could not find container \"dd87b816343b5b53c132b5874a69d21f73d144d6db265d92f1ee383c06070888\": container with ID starting with dd87b816343b5b53c132b5874a69d21f73d144d6db265d92f1ee383c06070888 not found: ID does not exist" Nov 04 05:50:43.334744 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.334694 5784 scope.go:122] "RemoveContainer" containerID="6b2276a8819cb9615329740c4650032907a9938d58e7f017f007cf028b173db9" Nov 04 05:50:43.334944 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:43.334928 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b2276a8819cb9615329740c4650032907a9938d58e7f017f007cf028b173db9\": container with ID starting with 6b2276a8819cb9615329740c4650032907a9938d58e7f017f007cf028b173db9 not found: ID does not exist" containerID="6b2276a8819cb9615329740c4650032907a9938d58e7f017f007cf028b173db9" Nov 04 05:50:43.335008 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.334949 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b2276a8819cb9615329740c4650032907a9938d58e7f017f007cf028b173db9"} err="failed to get container status \"6b2276a8819cb9615329740c4650032907a9938d58e7f017f007cf028b173db9\": rpc error: code = NotFound desc = could not find container \"6b2276a8819cb9615329740c4650032907a9938d58e7f017f007cf028b173db9\": container with ID starting with 6b2276a8819cb9615329740c4650032907a9938d58e7f017f007cf028b173db9 not found: ID does not exist" Nov 04 05:50:43.335008 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.334962 5784 scope.go:122] "RemoveContainer" containerID="5ee88ab8ae9756eb80c09ae413c689af693455bbd339d9dd0f3b23c51301162b" Nov 04 05:50:43.335305 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.335280 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ee88ab8ae9756eb80c09ae413c689af693455bbd339d9dd0f3b23c51301162b"} err="failed to get container status \"5ee88ab8ae9756eb80c09ae413c689af693455bbd339d9dd0f3b23c51301162b\": rpc error: code = NotFound desc = could not find container \"5ee88ab8ae9756eb80c09ae413c689af693455bbd339d9dd0f3b23c51301162b\": container with ID starting with 5ee88ab8ae9756eb80c09ae413c689af693455bbd339d9dd0f3b23c51301162b not found: ID does not exist" Nov 04 05:50:43.335439 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.335306 5784 scope.go:122] "RemoveContainer" containerID="733888de895e7bc07d7eac07d68bbc821f0d7a1070da009efd6e9103e39f4761" Nov 04 05:50:43.335559 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.335535 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"733888de895e7bc07d7eac07d68bbc821f0d7a1070da009efd6e9103e39f4761"} err="failed to get container status \"733888de895e7bc07d7eac07d68bbc821f0d7a1070da009efd6e9103e39f4761\": rpc error: code = NotFound desc = could not find container \"733888de895e7bc07d7eac07d68bbc821f0d7a1070da009efd6e9103e39f4761\": container with ID starting with 733888de895e7bc07d7eac07d68bbc821f0d7a1070da009efd6e9103e39f4761 not found: ID does not exist" Nov 04 05:50:43.335628 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.335561 5784 scope.go:122] "RemoveContainer" containerID="8e0a6319d95fbb34adce7b3d2d4bbcd1b5b6d154f5f19db2a7e38206e0c56f53" Nov 04 05:50:43.336576 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.336555 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e0a6319d95fbb34adce7b3d2d4bbcd1b5b6d154f5f19db2a7e38206e0c56f53"} err="failed to get container status \"8e0a6319d95fbb34adce7b3d2d4bbcd1b5b6d154f5f19db2a7e38206e0c56f53\": rpc error: code = NotFound desc = could not find container \"8e0a6319d95fbb34adce7b3d2d4bbcd1b5b6d154f5f19db2a7e38206e0c56f53\": container with ID starting with 8e0a6319d95fbb34adce7b3d2d4bbcd1b5b6d154f5f19db2a7e38206e0c56f53 not found: ID does not exist" Nov 04 05:50:43.336576 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.336575 5784 scope.go:122] "RemoveContainer" containerID="5b7e16676510edaa758231bf5676dcaee38d5722b3060b27776c4430aea9723f" Nov 04 05:50:43.336820 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.336801 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b7e16676510edaa758231bf5676dcaee38d5722b3060b27776c4430aea9723f"} err="failed to get container status \"5b7e16676510edaa758231bf5676dcaee38d5722b3060b27776c4430aea9723f\": rpc error: code = NotFound desc = could not find container \"5b7e16676510edaa758231bf5676dcaee38d5722b3060b27776c4430aea9723f\": container with ID starting with 5b7e16676510edaa758231bf5676dcaee38d5722b3060b27776c4430aea9723f not found: ID does not exist" Nov 04 05:50:43.336873 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.336821 5784 scope.go:122] "RemoveContainer" containerID="40869f32d4c952722524c5d727fdb5703d4c5aa030982407070a96159efac35a" Nov 04 05:50:43.337034 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.337019 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40869f32d4c952722524c5d727fdb5703d4c5aa030982407070a96159efac35a"} err="failed to get container status \"40869f32d4c952722524c5d727fdb5703d4c5aa030982407070a96159efac35a\": rpc error: code = NotFound desc = could not find container \"40869f32d4c952722524c5d727fdb5703d4c5aa030982407070a96159efac35a\": container with ID starting with 40869f32d4c952722524c5d727fdb5703d4c5aa030982407070a96159efac35a not found: ID does not exist" Nov 04 05:50:43.337105 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.337041 5784 scope.go:122] "RemoveContainer" containerID="dd87b816343b5b53c132b5874a69d21f73d144d6db265d92f1ee383c06070888" Nov 04 05:50:43.337376 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.337352 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd87b816343b5b53c132b5874a69d21f73d144d6db265d92f1ee383c06070888"} err="failed to get container status \"dd87b816343b5b53c132b5874a69d21f73d144d6db265d92f1ee383c06070888\": rpc error: code = NotFound desc = could not find container \"dd87b816343b5b53c132b5874a69d21f73d144d6db265d92f1ee383c06070888\": container with ID starting with dd87b816343b5b53c132b5874a69d21f73d144d6db265d92f1ee383c06070888 not found: ID does not exist" Nov 04 05:50:43.337376 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.337374 5784 scope.go:122] "RemoveContainer" containerID="6b2276a8819cb9615329740c4650032907a9938d58e7f017f007cf028b173db9" Nov 04 05:50:43.337623 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.337604 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b2276a8819cb9615329740c4650032907a9938d58e7f017f007cf028b173db9"} err="failed to get container status \"6b2276a8819cb9615329740c4650032907a9938d58e7f017f007cf028b173db9\": rpc error: code = NotFound desc = could not find container \"6b2276a8819cb9615329740c4650032907a9938d58e7f017f007cf028b173db9\": container with ID starting with 6b2276a8819cb9615329740c4650032907a9938d58e7f017f007cf028b173db9 not found: ID does not exist" Nov 04 05:50:43.461753 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.461677 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 04 05:50:43.466413 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.466390 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 04 05:50:43.517583 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.517551 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 04 05:50:43.517909 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.517891 5784 cpu_manager.go:414] "containerMap: removing container" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="kube-rbac-proxy" Nov 04 05:50:43.517909 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.517909 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="kube-rbac-proxy" Nov 04 05:50:43.518024 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.517923 5784 cpu_manager.go:414] "containerMap: removing container" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="config-reloader" Nov 04 05:50:43.518024 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.517929 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="config-reloader" Nov 04 05:50:43.518024 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.517936 5784 cpu_manager.go:414] "containerMap: removing container" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="kube-rbac-proxy-metric" Nov 04 05:50:43.518024 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.517941 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="kube-rbac-proxy-metric" Nov 04 05:50:43.518024 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.517958 5784 cpu_manager.go:414] "containerMap: removing container" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="alertmanager" Nov 04 05:50:43.518024 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.517966 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="alertmanager" Nov 04 05:50:43.518024 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.517973 5784 cpu_manager.go:414] "containerMap: removing container" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="init-config-reloader" Nov 04 05:50:43.518024 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.517977 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="init-config-reloader" Nov 04 05:50:43.518024 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.517983 5784 cpu_manager.go:414] "containerMap: removing container" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="prom-label-proxy" Nov 04 05:50:43.518024 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.517988 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="prom-label-proxy" Nov 04 05:50:43.518024 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.517998 5784 cpu_manager.go:414] "containerMap: removing container" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="kube-rbac-proxy-web" Nov 04 05:50:43.518024 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.518002 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="kube-rbac-proxy-web" Nov 04 05:50:43.518510 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.518100 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="config-reloader" Nov 04 05:50:43.518510 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.518111 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="kube-rbac-proxy-metric" Nov 04 05:50:43.518510 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.518119 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="alertmanager" Nov 04 05:50:43.518510 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.518124 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="init-config-reloader" Nov 04 05:50:43.518510 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.518133 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="prom-label-proxy" Nov 04 05:50:43.518510 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.518142 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="kube-rbac-proxy-web" Nov 04 05:50:43.518510 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.518152 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="118d5d6d-e2b1-483f-a184-504325584502" containerName="kube-rbac-proxy" Nov 04 05:50:43.556358 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.556330 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.587738 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.587707 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 04 05:50:43.615707 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.615679 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Nov 04 05:50:43.615707 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.615702 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Nov 04 05:50:43.615893 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.615706 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Nov 04 05:50:43.615893 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.615702 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Nov 04 05:50:43.615964 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.615915 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Nov 04 05:50:43.615964 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.615917 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Nov 04 05:50:43.615964 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.615915 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Nov 04 05:50:43.615964 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.615916 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Nov 04 05:50:43.616165 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.616089 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cxbnx\"" Nov 04 05:50:43.642904 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.642883 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Nov 04 05:50:43.670137 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.670116 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.670223 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.670143 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.670223 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.670164 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.670308 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.670231 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-web-config\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.670308 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.670288 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.670391 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.670347 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-config-volume\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.670446 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.670426 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.670500 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.670457 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.670567 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.670494 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.670624 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.670565 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-config-out\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.670624 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.670607 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.670726 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.670700 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.670795 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.670780 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5hl5\" (UniqueName: \"kubernetes.io/projected/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-kube-api-access-f5hl5\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.772226 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.772151 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.772226 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.772198 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-web-config\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.772226 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.772216 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.772486 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.772234 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-config-volume\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.772486 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.772338 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.772486 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.772372 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.772486 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.772397 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.772486 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.772439 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-config-out\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.772486 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.772463 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.772762 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.772491 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.772762 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.772538 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5hl5\" (UniqueName: \"kubernetes.io/projected/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-kube-api-access-f5hl5\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.772762 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.772573 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.772762 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.772567 5784 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 04 05:50:43.772950 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.772600 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.773463 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.773390 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.773463 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.773410 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.773980 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.773896 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.775354 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.775329 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-config-out\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.775484 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.775458 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.775597 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.775498 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.775722 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.775696 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.775829 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.775758 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.776256 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.776233 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-config-volume\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.776574 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.776554 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.776738 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.776716 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.776891 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.776877 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-web-config\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.839552 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.839525 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5hl5\" (UniqueName: \"kubernetes.io/projected/ec709b2f-fdd8-4370-b3ab-a53fc2f9902c-kube-api-access-f5hl5\") pod \"alertmanager-main-0\" (UID: \"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c\") " pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:43.963439 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:43.963409 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 04 05:50:44.432513 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:44.432494 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 04 05:50:44.434967 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:44.434940 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec709b2f_fdd8_4370_b3ab_a53fc2f9902c.slice/crio-c13ab4f90232e73c237bcd1f6467b0d886d1fcbc0328d32493c2a0d800ed317c WatchSource:0}: Error finding container c13ab4f90232e73c237bcd1f6467b0d886d1fcbc0328d32493c2a0d800ed317c: Status 404 returned error can't find the container with id c13ab4f90232e73c237bcd1f6467b0d886d1fcbc0328d32493c2a0d800ed317c Nov 04 05:50:45.013476 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.013444 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="118d5d6d-e2b1-483f-a184-504325584502" path="/var/lib/kubelet/pods/118d5d6d-e2b1-483f-a184-504325584502/volumes" Nov 04 05:50:45.285807 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.285714 5784 generic.go:356] "Generic (PLEG): container finished" podID="ec709b2f-fdd8-4370-b3ab-a53fc2f9902c" containerID="51b7fd419aedca236029f443aecc9be94020259d9243c016eb8f1b7a1d4244e9" exitCode=0 Nov 04 05:50:45.285968 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.285804 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c","Type":"ContainerDied","Data":"51b7fd419aedca236029f443aecc9be94020259d9243c016eb8f1b7a1d4244e9"} Nov 04 05:50:45.285968 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.285871 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c","Type":"ContainerStarted","Data":"c13ab4f90232e73c237bcd1f6467b0d886d1fcbc0328d32493c2a0d800ed317c"} Nov 04 05:50:45.369298 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.369262 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-669d89855b-2q25b"] Nov 04 05:50:45.393281 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.393258 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.421858 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:45.421833 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 05:50:45.458427 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.458394 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Nov 04 05:50:45.458427 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.458406 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Nov 04 05:50:45.458958 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.458443 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Nov 04 05:50:45.458958 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.458460 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Nov 04 05:50:45.458958 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.458487 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Nov 04 05:50:45.458958 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.458585 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-k2pkp\"" Nov 04 05:50:45.487037 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.487011 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afa6738b-bf5a-4935-872a-beeb48a57617-serving-certs-ca-bundle\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.487188 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.487078 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/afa6738b-bf5a-4935-872a-beeb48a57617-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.487188 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.487171 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/afa6738b-bf5a-4935-872a-beeb48a57617-telemeter-client-tls\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.487319 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.487214 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afa6738b-bf5a-4935-872a-beeb48a57617-metrics-client-ca\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.487319 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.487274 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/afa6738b-bf5a-4935-872a-beeb48a57617-federate-client-tls\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.487319 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.487303 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afa6738b-bf5a-4935-872a-beeb48a57617-telemeter-trusted-ca-bundle\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.487593 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.487409 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct5bv\" (UniqueName: \"kubernetes.io/projected/afa6738b-bf5a-4935-872a-beeb48a57617-kube-api-access-ct5bv\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.487593 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.487474 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/afa6738b-bf5a-4935-872a-beeb48a57617-secret-telemeter-client\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.514586 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.514564 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\"" Nov 04 05:50:45.537291 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.537225 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-669d89855b-2q25b"] Nov 04 05:50:45.588412 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.588382 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/afa6738b-bf5a-4935-872a-beeb48a57617-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.588559 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.588439 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/afa6738b-bf5a-4935-872a-beeb48a57617-telemeter-client-tls\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.588559 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.588466 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afa6738b-bf5a-4935-872a-beeb48a57617-metrics-client-ca\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.588559 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.588499 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/afa6738b-bf5a-4935-872a-beeb48a57617-federate-client-tls\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.588559 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.588535 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afa6738b-bf5a-4935-872a-beeb48a57617-telemeter-trusted-ca-bundle\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.588762 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.588566 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct5bv\" (UniqueName: \"kubernetes.io/projected/afa6738b-bf5a-4935-872a-beeb48a57617-kube-api-access-ct5bv\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.588762 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.588600 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/afa6738b-bf5a-4935-872a-beeb48a57617-secret-telemeter-client\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.588762 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.588641 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afa6738b-bf5a-4935-872a-beeb48a57617-serving-certs-ca-bundle\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.589284 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.589261 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afa6738b-bf5a-4935-872a-beeb48a57617-serving-certs-ca-bundle\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.589463 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.589429 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afa6738b-bf5a-4935-872a-beeb48a57617-telemeter-trusted-ca-bundle\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.589911 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.589887 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afa6738b-bf5a-4935-872a-beeb48a57617-metrics-client-ca\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.591104 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.591052 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/afa6738b-bf5a-4935-872a-beeb48a57617-federate-client-tls\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.591314 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.591295 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/afa6738b-bf5a-4935-872a-beeb48a57617-telemeter-client-tls\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.591356 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.591301 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/afa6738b-bf5a-4935-872a-beeb48a57617-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.591788 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.591765 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/afa6738b-bf5a-4935-872a-beeb48a57617-secret-telemeter-client\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.655964 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.655943 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct5bv\" (UniqueName: \"kubernetes.io/projected/afa6738b-bf5a-4935-872a-beeb48a57617-kube-api-access-ct5bv\") pod \"telemeter-client-669d89855b-2q25b\" (UID: \"afa6738b-bf5a-4935-872a-beeb48a57617\") " pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:45.758121 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:45.758098 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" Nov 04 05:50:46.234428 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:46.234394 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-669d89855b-2q25b"] Nov 04 05:50:46.237265 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:46.237232 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafa6738b_bf5a_4935_872a_beeb48a57617.slice/crio-10af792986e3fa815cc25163ef0982ba6e498aad6db030185b6d5d152684baba WatchSource:0}: Error finding container 10af792986e3fa815cc25163ef0982ba6e498aad6db030185b6d5d152684baba: Status 404 returned error can't find the container with id 10af792986e3fa815cc25163ef0982ba6e498aad6db030185b6d5d152684baba Nov 04 05:50:46.293226 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:46.293189 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c","Type":"ContainerStarted","Data":"a9e368bbe0e8e0c7669977656b40b6c7f29aa14b34edcac5009b4de088e24b89"} Nov 04 05:50:46.293383 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:46.293257 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c","Type":"ContainerStarted","Data":"80f9f8db0aa3df467124a370a7794a89d5d07e8fc653d003132d70ef234a057b"} Nov 04 05:50:46.293383 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:46.293296 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c","Type":"ContainerStarted","Data":"d241a743eb6f9faa7e899ec890b29a2720630d0fcbfa2a5cde229768cc19e06a"} Nov 04 05:50:46.293383 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:46.293327 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c","Type":"ContainerStarted","Data":"a736d7280f32acb948b82393090e3427e3de7a62867b0e5a9c1936c9f7a193c1"} Nov 04 05:50:46.293383 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:46.293354 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c","Type":"ContainerStarted","Data":"8a69642f48263b984b69f7713fa5f629671284f99b2859d0f3c4fab587d83997"} Nov 04 05:50:46.293383 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:46.293381 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec709b2f-fdd8-4370-b3ab-a53fc2f9902c","Type":"ContainerStarted","Data":"708dff7b96f08e5da52047a824854f3b0b482472fe14dea2db04d9c146329413"} Nov 04 05:50:46.294372 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:46.294348 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" event={"ID":"afa6738b-bf5a-4935-872a-beeb48a57617","Type":"ContainerStarted","Data":"10af792986e3fa815cc25163ef0982ba6e498aad6db030185b6d5d152684baba"} Nov 04 05:50:46.438592 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:46.438545 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.425089335 podStartE2EDuration="3.438532243s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.442908ms" isStatefulPod=false podCreationTimestamp="2026-11-04 05:50:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:50:46.437809769 +0000 UTC m=+45.574506169" watchObservedRunningTime="2026-11-04 05:50:46.438532243 +0000 UTC m=+45.575228642" Nov 04 05:50:47.682742 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:47.682706 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 04 05:50:47.683541 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:47.682982 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="prometheus" containerID="cri-o://e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c" gracePeriod=600 Nov 04 05:50:47.683541 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:47.683156 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc" gracePeriod=600 Nov 04 05:50:47.683541 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:47.683228 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="config-reloader" containerID="cri-o://090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a" gracePeriod=600 Nov 04 05:50:47.683541 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:47.683246 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="thanos-sidecar" containerID="cri-o://23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c" gracePeriod=600 Nov 04 05:50:47.683541 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:47.683304 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="kube-rbac-proxy" containerID="cri-o://e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f" gracePeriod=600 Nov 04 05:50:47.683541 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:47.683376 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="kube-rbac-proxy-web" containerID="cri-o://ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0" gracePeriod=600 Nov 04 05:50:47.952931 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:47.952639 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.006721 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.006691 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-tls\") pod \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " Nov 04 05:50:48.006902 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.006728 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " Nov 04 05:50:48.006902 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.006765 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-metrics-client-certs\") pod \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " Nov 04 05:50:48.006902 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.006794 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " Nov 04 05:50:48.006902 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.006829 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-trusted-ca-bundle\") pod \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " Nov 04 05:50:48.006902 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.006869 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-db\") pod \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " Nov 04 05:50:48.007209 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.006911 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-web-config\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-web-config\") pod \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " Nov 04 05:50:48.007209 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.006954 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-0\") pod \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " Nov 04 05:50:48.007209 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.006984 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-config-out\" (UniqueName: \"kubernetes.io/empty-dir/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-config-out\") pod \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " Nov 04 05:50:48.007209 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.007022 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-kube-api-access-nst9j\" (UniqueName: \"kubernetes.io/projected/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-kube-api-access-nst9j\") pod \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " Nov 04 05:50:48.007209 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.007050 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-config\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-config\") pod \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " Nov 04 05:50:48.007209 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.007104 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-1\") pod \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " Nov 04 05:50:48.007209 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.007138 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-metrics-client-ca\") pod \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " Nov 04 05:50:48.007209 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.007165 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-grpc-tls\") pod \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " Nov 04 05:50:48.007524 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.007221 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-serving-certs-ca-bundle\") pod \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " Nov 04 05:50:48.007524 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.007244 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-thanos-prometheus-http-client-file\") pod \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " Nov 04 05:50:48.007524 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.007263 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-kubelet-serving-ca-bundle\") pod \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " Nov 04 05:50:48.007524 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.007290 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-tls-assets\" (UniqueName: \"kubernetes.io/projected/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-tls-assets\") pod \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " Nov 04 05:50:48.007524 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.007334 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-2\") pod \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " Nov 04 05:50:48.007524 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.007365 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-kube-rbac-proxy\") pod \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\" (UID: \"6fd3b4e2-6b29-4162-924a-4a36bf4bf647\") " Nov 04 05:50:48.008316 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.008288 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-metrics-client-ca" pod "6fd3b4e2-6b29-4162-924a-4a36bf4bf647" (UID: "6fd3b4e2-6b29-4162-924a-4a36bf4bf647"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:50:48.010415 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.008602 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-1" pod "6fd3b4e2-6b29-4162-924a-4a36bf4bf647" (UID: "6fd3b4e2-6b29-4162-924a-4a36bf4bf647"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:50:48.010415 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.009566 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-metrics-client-certs" pod "6fd3b4e2-6b29-4162-924a-4a36bf4bf647" (UID: "6fd3b4e2-6b29-4162-924a-4a36bf4bf647"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:50:48.010415 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.009828 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-0" pod "6fd3b4e2-6b29-4162-924a-4a36bf4bf647" (UID: "6fd3b4e2-6b29-4162-924a-4a36bf4bf647"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:50:48.010415 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.009932 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-kube-rbac-proxy" pod "6fd3b4e2-6b29-4162-924a-4a36bf4bf647" (UID: "6fd3b4e2-6b29-4162-924a-4a36bf4bf647"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:50:48.010415 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.010100 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-tls" pod "6fd3b4e2-6b29-4162-924a-4a36bf4bf647" (UID: "6fd3b4e2-6b29-4162-924a-4a36bf4bf647"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:50:48.010415 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.010409 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-kubelet-serving-ca-bundle" pod "6fd3b4e2-6b29-4162-924a-4a36bf4bf647" (UID: "6fd3b4e2-6b29-4162-924a-4a36bf4bf647"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:50:48.011203 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.010765 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-serving-certs-ca-bundle" pod "6fd3b4e2-6b29-4162-924a-4a36bf4bf647" (UID: "6fd3b4e2-6b29-4162-924a-4a36bf4bf647"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:50:48.011203 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.010927 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-trusted-ca-bundle" pod "6fd3b4e2-6b29-4162-924a-4a36bf4bf647" (UID: "6fd3b4e2-6b29-4162-924a-4a36bf4bf647"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:50:48.011718 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.011691 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-config-out" pod "6fd3b4e2-6b29-4162-924a-4a36bf4bf647" (UID: "6fd3b4e2-6b29-4162-924a-4a36bf4bf647"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:50:48.012411 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.012381 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-kube-rbac-proxy-web" pod "6fd3b4e2-6b29-4162-924a-4a36bf4bf647" (UID: "6fd3b4e2-6b29-4162-924a-4a36bf4bf647"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:50:48.012598 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.012574 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-kube-api-access-nst9j" pod "6fd3b4e2-6b29-4162-924a-4a36bf4bf647" (UID: "6fd3b4e2-6b29-4162-924a-4a36bf4bf647"). InnerVolumeSpecName "kube-api-access-nst9j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:50:48.012900 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.012873 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-db" pod "6fd3b4e2-6b29-4162-924a-4a36bf4bf647" (UID: "6fd3b4e2-6b29-4162-924a-4a36bf4bf647"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:50:48.013389 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.013258 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-2" pod "6fd3b4e2-6b29-4162-924a-4a36bf4bf647" (UID: "6fd3b4e2-6b29-4162-924a-4a36bf4bf647"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:50:48.013389 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.013350 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-grpc-tls" pod "6fd3b4e2-6b29-4162-924a-4a36bf4bf647" (UID: "6fd3b4e2-6b29-4162-924a-4a36bf4bf647"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:50:48.013609 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.013580 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-thanos-sidecar-tls" pod "6fd3b4e2-6b29-4162-924a-4a36bf4bf647" (UID: "6fd3b4e2-6b29-4162-924a-4a36bf4bf647"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:50:48.014404 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.014375 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-thanos-prometheus-http-client-file" pod "6fd3b4e2-6b29-4162-924a-4a36bf4bf647" (UID: "6fd3b4e2-6b29-4162-924a-4a36bf4bf647"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:50:48.015316 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.015295 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-tls-assets" pod "6fd3b4e2-6b29-4162-924a-4a36bf4bf647" (UID: "6fd3b4e2-6b29-4162-924a-4a36bf4bf647"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:50:48.015529 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.015509 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-config" pod "6fd3b4e2-6b29-4162-924a-4a36bf4bf647" (UID: "6fd3b4e2-6b29-4162-924a-4a36bf4bf647"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:50:48.023541 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.023492 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-web-config" pod "6fd3b4e2-6b29-4162-924a-4a36bf4bf647" (UID: "6fd3b4e2-6b29-4162-924a-4a36bf4bf647"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:50:48.108725 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.108697 5784 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-tls-assets\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:48.108725 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.108727 5784 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:48.108999 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.108742 5784 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-kube-rbac-proxy\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:48.108999 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.108756 5784 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:48.108999 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.108771 5784 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:48.108999 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.108785 5784 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-metrics-client-certs\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:48.108999 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.108798 5784 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:48.108999 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.108812 5784 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:48.108999 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.108826 5784 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-db\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:48.108999 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.108839 5784 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-web-config\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:48.108999 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.108853 5784 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:48.108999 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.108867 5784 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-config-out\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:48.108999 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.108880 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nst9j\" (UniqueName: \"kubernetes.io/projected/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-kube-api-access-nst9j\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:48.108999 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.108893 5784 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-config\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:48.108999 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.108906 5784 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:48.108999 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.108918 5784 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-metrics-client-ca\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:48.108999 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.108931 5784 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-secret-grpc-tls\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:48.108999 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.108943 5784 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:48.108999 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.108957 5784 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:48.108999 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.108974 5784 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd3b4e2-6b29-4162-924a-4a36bf4bf647-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:50:48.307355 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.307270 5784 generic.go:356] "Generic (PLEG): container finished" podID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerID="1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc" exitCode=0 Nov 04 05:50:48.307355 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.307300 5784 generic.go:356] "Generic (PLEG): container finished" podID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerID="e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f" exitCode=0 Nov 04 05:50:48.307355 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.307313 5784 generic.go:356] "Generic (PLEG): container finished" podID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerID="ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0" exitCode=0 Nov 04 05:50:48.307355 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.307321 5784 generic.go:356] "Generic (PLEG): container finished" podID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerID="23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c" exitCode=0 Nov 04 05:50:48.307355 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.307330 5784 generic.go:356] "Generic (PLEG): container finished" podID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerID="090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a" exitCode=0 Nov 04 05:50:48.307355 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.307337 5784 generic.go:356] "Generic (PLEG): container finished" podID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerID="e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c" exitCode=0 Nov 04 05:50:48.307782 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.307356 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fd3b4e2-6b29-4162-924a-4a36bf4bf647","Type":"ContainerDied","Data":"1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc"} Nov 04 05:50:48.307782 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.307370 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.307782 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.307448 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fd3b4e2-6b29-4162-924a-4a36bf4bf647","Type":"ContainerDied","Data":"e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f"} Nov 04 05:50:48.307782 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.307479 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fd3b4e2-6b29-4162-924a-4a36bf4bf647","Type":"ContainerDied","Data":"ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0"} Nov 04 05:50:48.307782 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.307516 5784 scope.go:122] "RemoveContainer" containerID="1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc" Nov 04 05:50:48.307782 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.307517 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fd3b4e2-6b29-4162-924a-4a36bf4bf647","Type":"ContainerDied","Data":"23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c"} Nov 04 05:50:48.307782 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.307646 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fd3b4e2-6b29-4162-924a-4a36bf4bf647","Type":"ContainerDied","Data":"090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a"} Nov 04 05:50:48.307782 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.307689 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fd3b4e2-6b29-4162-924a-4a36bf4bf647","Type":"ContainerDied","Data":"e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c"} Nov 04 05:50:48.307782 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.307727 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6fd3b4e2-6b29-4162-924a-4a36bf4bf647","Type":"ContainerDied","Data":"4027b35de7271b28780d267b8e7996d75c315673757540daf62148a80743a6da"} Nov 04 05:50:48.322054 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.322034 5784 scope.go:122] "RemoveContainer" containerID="e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f" Nov 04 05:50:48.330931 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.330910 5784 scope.go:122] "RemoveContainer" containerID="ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0" Nov 04 05:50:48.338131 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.338114 5784 scope.go:122] "RemoveContainer" containerID="23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c" Nov 04 05:50:48.344770 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.344745 5784 scope.go:122] "RemoveContainer" containerID="090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a" Nov 04 05:50:48.351274 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.351260 5784 scope.go:122] "RemoveContainer" containerID="e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c" Nov 04 05:50:48.357960 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.357942 5784 scope.go:122] "RemoveContainer" containerID="2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b" Nov 04 05:50:48.364198 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.364181 5784 scope.go:122] "RemoveContainer" containerID="1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc" Nov 04 05:50:48.364451 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:48.364431 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc\": container with ID starting with 1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc not found: ID does not exist" containerID="1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc" Nov 04 05:50:48.364509 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.364461 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc"} err="failed to get container status \"1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc\": rpc error: code = NotFound desc = could not find container \"1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc\": container with ID starting with 1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc not found: ID does not exist" Nov 04 05:50:48.364509 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.364480 5784 scope.go:122] "RemoveContainer" containerID="e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f" Nov 04 05:50:48.364731 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:48.364717 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f\": container with ID starting with e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f not found: ID does not exist" containerID="e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f" Nov 04 05:50:48.364774 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.364735 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f"} err="failed to get container status \"e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f\": rpc error: code = NotFound desc = could not find container \"e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f\": container with ID starting with e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f not found: ID does not exist" Nov 04 05:50:48.364774 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.364747 5784 scope.go:122] "RemoveContainer" containerID="ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0" Nov 04 05:50:48.364942 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:48.364927 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0\": container with ID starting with ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0 not found: ID does not exist" containerID="ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0" Nov 04 05:50:48.364981 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.364948 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0"} err="failed to get container status \"ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0\": rpc error: code = NotFound desc = could not find container \"ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0\": container with ID starting with ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0 not found: ID does not exist" Nov 04 05:50:48.364981 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.364961 5784 scope.go:122] "RemoveContainer" containerID="23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c" Nov 04 05:50:48.365159 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:48.365144 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c\": container with ID starting with 23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c not found: ID does not exist" containerID="23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c" Nov 04 05:50:48.365206 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.365162 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c"} err="failed to get container status \"23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c\": rpc error: code = NotFound desc = could not find container \"23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c\": container with ID starting with 23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c not found: ID does not exist" Nov 04 05:50:48.365206 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.365175 5784 scope.go:122] "RemoveContainer" containerID="090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a" Nov 04 05:50:48.365441 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:48.365423 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a\": container with ID starting with 090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a not found: ID does not exist" containerID="090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a" Nov 04 05:50:48.365480 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.365448 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a"} err="failed to get container status \"090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a\": rpc error: code = NotFound desc = could not find container \"090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a\": container with ID starting with 090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a not found: ID does not exist" Nov 04 05:50:48.365480 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.365464 5784 scope.go:122] "RemoveContainer" containerID="e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c" Nov 04 05:50:48.365713 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:48.365697 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c\": container with ID starting with e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c not found: ID does not exist" containerID="e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c" Nov 04 05:50:48.365752 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.365719 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c"} err="failed to get container status \"e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c\": rpc error: code = NotFound desc = could not find container \"e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c\": container with ID starting with e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c not found: ID does not exist" Nov 04 05:50:48.365752 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.365733 5784 scope.go:122] "RemoveContainer" containerID="2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b" Nov 04 05:50:48.365951 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:50:48.365935 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b\": container with ID starting with 2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b not found: ID does not exist" containerID="2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b" Nov 04 05:50:48.365992 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.365955 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b"} err="failed to get container status \"2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b\": rpc error: code = NotFound desc = could not find container \"2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b\": container with ID starting with 2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b not found: ID does not exist" Nov 04 05:50:48.365992 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.365967 5784 scope.go:122] "RemoveContainer" containerID="1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc" Nov 04 05:50:48.366408 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.366387 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc"} err="failed to get container status \"1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc\": rpc error: code = NotFound desc = could not find container \"1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc\": container with ID starting with 1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc not found: ID does not exist" Nov 04 05:50:48.366447 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.366409 5784 scope.go:122] "RemoveContainer" containerID="e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f" Nov 04 05:50:48.366639 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.366620 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f"} err="failed to get container status \"e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f\": rpc error: code = NotFound desc = could not find container \"e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f\": container with ID starting with e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f not found: ID does not exist" Nov 04 05:50:48.366701 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.366640 5784 scope.go:122] "RemoveContainer" containerID="ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0" Nov 04 05:50:48.366925 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.366905 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0"} err="failed to get container status \"ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0\": rpc error: code = NotFound desc = could not find container \"ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0\": container with ID starting with ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0 not found: ID does not exist" Nov 04 05:50:48.366971 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.366925 5784 scope.go:122] "RemoveContainer" containerID="23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c" Nov 04 05:50:48.367143 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.367125 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c"} err="failed to get container status \"23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c\": rpc error: code = NotFound desc = could not find container \"23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c\": container with ID starting with 23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c not found: ID does not exist" Nov 04 05:50:48.367199 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.367144 5784 scope.go:122] "RemoveContainer" containerID="090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a" Nov 04 05:50:48.367383 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.367363 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a"} err="failed to get container status \"090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a\": rpc error: code = NotFound desc = could not find container \"090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a\": container with ID starting with 090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a not found: ID does not exist" Nov 04 05:50:48.367444 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.367383 5784 scope.go:122] "RemoveContainer" containerID="e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c" Nov 04 05:50:48.367615 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.367599 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c"} err="failed to get container status \"e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c\": rpc error: code = NotFound desc = could not find container \"e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c\": container with ID starting with e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c not found: ID does not exist" Nov 04 05:50:48.367656 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.367615 5784 scope.go:122] "RemoveContainer" containerID="2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b" Nov 04 05:50:48.367829 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.367807 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b"} err="failed to get container status \"2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b\": rpc error: code = NotFound desc = could not find container \"2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b\": container with ID starting with 2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b not found: ID does not exist" Nov 04 05:50:48.367905 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.367830 5784 scope.go:122] "RemoveContainer" containerID="1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc" Nov 04 05:50:48.368091 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.368057 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc"} err="failed to get container status \"1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc\": rpc error: code = NotFound desc = could not find container \"1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc\": container with ID starting with 1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc not found: ID does not exist" Nov 04 05:50:48.368172 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.368092 5784 scope.go:122] "RemoveContainer" containerID="e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f" Nov 04 05:50:48.368338 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.368320 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f"} err="failed to get container status \"e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f\": rpc error: code = NotFound desc = could not find container \"e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f\": container with ID starting with e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f not found: ID does not exist" Nov 04 05:50:48.368385 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.368339 5784 scope.go:122] "RemoveContainer" containerID="ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0" Nov 04 05:50:48.368555 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.368537 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0"} err="failed to get container status \"ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0\": rpc error: code = NotFound desc = could not find container \"ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0\": container with ID starting with ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0 not found: ID does not exist" Nov 04 05:50:48.368597 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.368556 5784 scope.go:122] "RemoveContainer" containerID="23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c" Nov 04 05:50:48.368766 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.368749 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c"} err="failed to get container status \"23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c\": rpc error: code = NotFound desc = could not find container \"23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c\": container with ID starting with 23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c not found: ID does not exist" Nov 04 05:50:48.368833 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.368767 5784 scope.go:122] "RemoveContainer" containerID="090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a" Nov 04 05:50:48.368970 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.368954 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a"} err="failed to get container status \"090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a\": rpc error: code = NotFound desc = could not find container \"090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a\": container with ID starting with 090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a not found: ID does not exist" Nov 04 05:50:48.369017 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.368970 5784 scope.go:122] "RemoveContainer" containerID="e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c" Nov 04 05:50:48.369187 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.369170 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c"} err="failed to get container status \"e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c\": rpc error: code = NotFound desc = could not find container \"e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c\": container with ID starting with e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c not found: ID does not exist" Nov 04 05:50:48.369258 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.369188 5784 scope.go:122] "RemoveContainer" containerID="2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b" Nov 04 05:50:48.369403 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.369386 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b"} err="failed to get container status \"2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b\": rpc error: code = NotFound desc = could not find container \"2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b\": container with ID starting with 2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b not found: ID does not exist" Nov 04 05:50:48.369450 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.369403 5784 scope.go:122] "RemoveContainer" containerID="1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc" Nov 04 05:50:48.369598 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.369579 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc"} err="failed to get container status \"1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc\": rpc error: code = NotFound desc = could not find container \"1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc\": container with ID starting with 1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc not found: ID does not exist" Nov 04 05:50:48.369638 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.369599 5784 scope.go:122] "RemoveContainer" containerID="e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f" Nov 04 05:50:48.369793 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.369777 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f"} err="failed to get container status \"e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f\": rpc error: code = NotFound desc = could not find container \"e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f\": container with ID starting with e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f not found: ID does not exist" Nov 04 05:50:48.369858 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.369794 5784 scope.go:122] "RemoveContainer" containerID="ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0" Nov 04 05:50:48.370000 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.369983 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0"} err="failed to get container status \"ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0\": rpc error: code = NotFound desc = could not find container \"ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0\": container with ID starting with ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0 not found: ID does not exist" Nov 04 05:50:48.370039 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.370000 5784 scope.go:122] "RemoveContainer" containerID="23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c" Nov 04 05:50:48.370183 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.370169 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c"} err="failed to get container status \"23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c\": rpc error: code = NotFound desc = could not find container \"23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c\": container with ID starting with 23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c not found: ID does not exist" Nov 04 05:50:48.370225 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.370184 5784 scope.go:122] "RemoveContainer" containerID="090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a" Nov 04 05:50:48.370360 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.370346 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a"} err="failed to get container status \"090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a\": rpc error: code = NotFound desc = could not find container \"090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a\": container with ID starting with 090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a not found: ID does not exist" Nov 04 05:50:48.370408 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.370359 5784 scope.go:122] "RemoveContainer" containerID="e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c" Nov 04 05:50:48.370586 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.370567 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c"} err="failed to get container status \"e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c\": rpc error: code = NotFound desc = could not find container \"e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c\": container with ID starting with e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c not found: ID does not exist" Nov 04 05:50:48.370653 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.370586 5784 scope.go:122] "RemoveContainer" containerID="2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b" Nov 04 05:50:48.370803 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.370786 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b"} err="failed to get container status \"2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b\": rpc error: code = NotFound desc = could not find container \"2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b\": container with ID starting with 2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b not found: ID does not exist" Nov 04 05:50:48.370856 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.370802 5784 scope.go:122] "RemoveContainer" containerID="1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc" Nov 04 05:50:48.370976 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.370962 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc"} err="failed to get container status \"1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc\": rpc error: code = NotFound desc = could not find container \"1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc\": container with ID starting with 1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc not found: ID does not exist" Nov 04 05:50:48.370976 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.370975 5784 scope.go:122] "RemoveContainer" containerID="e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f" Nov 04 05:50:48.371194 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.371175 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f"} err="failed to get container status \"e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f\": rpc error: code = NotFound desc = could not find container \"e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f\": container with ID starting with e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f not found: ID does not exist" Nov 04 05:50:48.371240 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.371194 5784 scope.go:122] "RemoveContainer" containerID="ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0" Nov 04 05:50:48.371379 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.371362 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0"} err="failed to get container status \"ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0\": rpc error: code = NotFound desc = could not find container \"ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0\": container with ID starting with ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0 not found: ID does not exist" Nov 04 05:50:48.371424 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.371379 5784 scope.go:122] "RemoveContainer" containerID="23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c" Nov 04 05:50:48.371537 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.371523 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c"} err="failed to get container status \"23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c\": rpc error: code = NotFound desc = could not find container \"23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c\": container with ID starting with 23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c not found: ID does not exist" Nov 04 05:50:48.371581 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.371539 5784 scope.go:122] "RemoveContainer" containerID="090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a" Nov 04 05:50:48.371714 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.371695 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a"} err="failed to get container status \"090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a\": rpc error: code = NotFound desc = could not find container \"090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a\": container with ID starting with 090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a not found: ID does not exist" Nov 04 05:50:48.371714 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.371713 5784 scope.go:122] "RemoveContainer" containerID="e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c" Nov 04 05:50:48.371887 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.371865 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c"} err="failed to get container status \"e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c\": rpc error: code = NotFound desc = could not find container \"e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c\": container with ID starting with e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c not found: ID does not exist" Nov 04 05:50:48.371929 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.371887 5784 scope.go:122] "RemoveContainer" containerID="2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b" Nov 04 05:50:48.372050 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.372034 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b"} err="failed to get container status \"2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b\": rpc error: code = NotFound desc = could not find container \"2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b\": container with ID starting with 2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b not found: ID does not exist" Nov 04 05:50:48.372050 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.372049 5784 scope.go:122] "RemoveContainer" containerID="1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc" Nov 04 05:50:48.372298 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.372282 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc"} err="failed to get container status \"1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc\": rpc error: code = NotFound desc = could not find container \"1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc\": container with ID starting with 1789bb4eae30c2760829dd7f64eddb58311d66c75786a2be1212395181fd55dc not found: ID does not exist" Nov 04 05:50:48.372298 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.372296 5784 scope.go:122] "RemoveContainer" containerID="e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f" Nov 04 05:50:48.372506 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.372488 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f"} err="failed to get container status \"e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f\": rpc error: code = NotFound desc = could not find container \"e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f\": container with ID starting with e19d43f319539e898c0ab933389f6a3d997c13ad58283c48ec73b303ca95610f not found: ID does not exist" Nov 04 05:50:48.372544 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.372505 5784 scope.go:122] "RemoveContainer" containerID="ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0" Nov 04 05:50:48.372739 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.372723 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0"} err="failed to get container status \"ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0\": rpc error: code = NotFound desc = could not find container \"ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0\": container with ID starting with ca4d5030f83b7287b71c23200708cb36b7b05e78f3193e56a44bbcd611469cb0 not found: ID does not exist" Nov 04 05:50:48.372781 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.372739 5784 scope.go:122] "RemoveContainer" containerID="23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c" Nov 04 05:50:48.372972 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.372953 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c"} err="failed to get container status \"23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c\": rpc error: code = NotFound desc = could not find container \"23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c\": container with ID starting with 23df31489afed8d8526ae1e137bb3c2367937ea2664bda2266bb8c65b640660c not found: ID does not exist" Nov 04 05:50:48.373032 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.372973 5784 scope.go:122] "RemoveContainer" containerID="090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a" Nov 04 05:50:48.373215 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.373199 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a"} err="failed to get container status \"090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a\": rpc error: code = NotFound desc = could not find container \"090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a\": container with ID starting with 090de01a4ebbadedb219e4284c46dde0d7c2cb2920350fb763fb1db76c35339a not found: ID does not exist" Nov 04 05:50:48.373215 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.373214 5784 scope.go:122] "RemoveContainer" containerID="e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c" Nov 04 05:50:48.373438 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.373416 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c"} err="failed to get container status \"e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c\": rpc error: code = NotFound desc = could not find container \"e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c\": container with ID starting with e6d2032fc0ca9f54f1969effedd858615d2c267d8ce2fbf138f7bd361723604c not found: ID does not exist" Nov 04 05:50:48.373438 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.373437 5784 scope.go:122] "RemoveContainer" containerID="2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b" Nov 04 05:50:48.373640 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.373621 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b"} err="failed to get container status \"2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b\": rpc error: code = NotFound desc = could not find container \"2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b\": container with ID starting with 2c19eb09e58dc1130f141c3d2ad415933eab0bb268ee54e85c7a35412e5bf62b not found: ID does not exist" Nov 04 05:50:48.493162 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.493126 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 04 05:50:48.549005 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.548974 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 04 05:50:48.549430 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.549410 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 04 05:50:48.549747 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.549734 5784 cpu_manager.go:414] "containerMap: removing container" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="prometheus" Nov 04 05:50:48.549780 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.549749 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="prometheus" Nov 04 05:50:48.549780 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.549765 5784 cpu_manager.go:414] "containerMap: removing container" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="kube-rbac-proxy-web" Nov 04 05:50:48.549780 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.549770 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="kube-rbac-proxy-web" Nov 04 05:50:48.549780 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.549778 5784 cpu_manager.go:414] "containerMap: removing container" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="init-config-reloader" Nov 04 05:50:48.549904 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.549783 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="init-config-reloader" Nov 04 05:50:48.549904 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.549796 5784 cpu_manager.go:414] "containerMap: removing container" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="thanos-sidecar" Nov 04 05:50:48.549904 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.549801 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="thanos-sidecar" Nov 04 05:50:48.549904 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.549813 5784 cpu_manager.go:414] "containerMap: removing container" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="kube-rbac-proxy" Nov 04 05:50:48.549904 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.549818 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="kube-rbac-proxy" Nov 04 05:50:48.549904 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.549824 5784 cpu_manager.go:414] "containerMap: removing container" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="kube-rbac-proxy-thanos" Nov 04 05:50:48.549904 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.549828 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="kube-rbac-proxy-thanos" Nov 04 05:50:48.549904 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.549839 5784 cpu_manager.go:414] "containerMap: removing container" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="config-reloader" Nov 04 05:50:48.549904 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.549843 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="config-reloader" Nov 04 05:50:48.549904 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.549894 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="kube-rbac-proxy-web" Nov 04 05:50:48.549904 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.549902 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="thanos-sidecar" Nov 04 05:50:48.550233 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.549911 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="kube-rbac-proxy" Nov 04 05:50:48.550233 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.549916 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="kube-rbac-proxy-thanos" Nov 04 05:50:48.550233 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.549921 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="config-reloader" Nov 04 05:50:48.550233 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.549927 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" containerName="prometheus" Nov 04 05:50:48.569836 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.569812 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.616581 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.616546 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb9d5\" (UniqueName: \"kubernetes.io/projected/7487de69-9b55-4363-a985-8c80366c2ae0-kube-api-access-tb9d5\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.616754 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.616588 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.616754 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.616609 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7487de69-9b55-4363-a985-8c80366c2ae0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.616754 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.616679 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7487de69-9b55-4363-a985-8c80366c2ae0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.616754 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.616719 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7487de69-9b55-4363-a985-8c80366c2ae0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.616911 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.616778 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-config\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.616911 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.616805 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.616911 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.616825 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7487de69-9b55-4363-a985-8c80366c2ae0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.616911 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.616849 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.617120 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.616921 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-web-config\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.617120 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.617008 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7487de69-9b55-4363-a985-8c80366c2ae0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.617120 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.617036 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7487de69-9b55-4363-a985-8c80366c2ae0-config-out\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.617120 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.617081 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7487de69-9b55-4363-a985-8c80366c2ae0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.617120 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.617118 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7487de69-9b55-4363-a985-8c80366c2ae0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.617292 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.617136 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7487de69-9b55-4363-a985-8c80366c2ae0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.617292 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.617163 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.617292 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.617206 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.617292 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.617243 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.617432 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.617301 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.617432 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.617323 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7487de69-9b55-4363-a985-8c80366c2ae0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.628852 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.628823 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Nov 04 05:50:48.628958 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.628871 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Nov 04 05:50:48.628958 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.628877 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Nov 04 05:50:48.628958 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.628880 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Nov 04 05:50:48.629147 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.629023 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Nov 04 05:50:48.629147 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.629121 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Nov 04 05:50:48.629147 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.629131 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Nov 04 05:50:48.629339 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.629320 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Nov 04 05:50:48.629339 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.629319 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h5w5l\"" Nov 04 05:50:48.629599 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.629363 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Nov 04 05:50:48.629599 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.629370 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Nov 04 05:50:48.629599 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.629405 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Nov 04 05:50:48.629599 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.629418 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cq7vabkalqm0d\"" Nov 04 05:50:48.629599 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.629421 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Nov 04 05:50:48.685677 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.685646 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Nov 04 05:50:48.686034 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.685713 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Nov 04 05:50:48.686363 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.686344 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 04 05:50:48.718270 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.718243 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7487de69-9b55-4363-a985-8c80366c2ae0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.718404 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.718276 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7487de69-9b55-4363-a985-8c80366c2ae0-config-out\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.718404 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.718300 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7487de69-9b55-4363-a985-8c80366c2ae0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.718404 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.718332 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7487de69-9b55-4363-a985-8c80366c2ae0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.718404 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.718358 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7487de69-9b55-4363-a985-8c80366c2ae0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.718404 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.718385 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.718659 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.718415 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.718659 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.718442 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.718659 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.718472 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.718659 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.718505 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7487de69-9b55-4363-a985-8c80366c2ae0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.718659 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.718548 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb9d5\" (UniqueName: \"kubernetes.io/projected/7487de69-9b55-4363-a985-8c80366c2ae0-kube-api-access-tb9d5\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.718659 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.718577 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.718659 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.718605 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7487de69-9b55-4363-a985-8c80366c2ae0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.718659 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.718630 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7487de69-9b55-4363-a985-8c80366c2ae0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.718659 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.718659 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7487de69-9b55-4363-a985-8c80366c2ae0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.719537 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.718690 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-config\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.719537 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.718714 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.719537 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.718741 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7487de69-9b55-4363-a985-8c80366c2ae0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.719537 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.718780 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.719537 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.718822 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-web-config\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.719537 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.719328 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7487de69-9b55-4363-a985-8c80366c2ae0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.719843 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.719542 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7487de69-9b55-4363-a985-8c80366c2ae0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.719843 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.719775 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7487de69-9b55-4363-a985-8c80366c2ae0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.719843 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.719809 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7487de69-9b55-4363-a985-8c80366c2ae0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.721527 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.721499 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7487de69-9b55-4363-a985-8c80366c2ae0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.722088 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.722039 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7487de69-9b55-4363-a985-8c80366c2ae0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.722199 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.722179 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7487de69-9b55-4363-a985-8c80366c2ae0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.722510 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.722475 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7487de69-9b55-4363-a985-8c80366c2ae0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.722609 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.722510 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.722698 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.722678 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7487de69-9b55-4363-a985-8c80366c2ae0-config-out\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.722764 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.722750 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-web-config\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.722889 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.722835 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.723016 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.722978 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.723532 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.723442 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.723532 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.723489 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.724457 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.724428 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.724762 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.724741 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-config\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.724984 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.724967 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7487de69-9b55-4363-a985-8c80366c2ae0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.726705 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.726681 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7487de69-9b55-4363-a985-8c80366c2ae0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:48.790266 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:48.790239 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb9d5\" (UniqueName: \"kubernetes.io/projected/7487de69-9b55-4363-a985-8c80366c2ae0-kube-api-access-tb9d5\") pod \"prometheus-k8s-0\" (UID: \"7487de69-9b55-4363-a985-8c80366c2ae0\") " pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:49.013944 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:49.013917 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6fd3b4e2-6b29-4162-924a-4a36bf4bf647" path="/var/lib/kubelet/pods/6fd3b4e2-6b29-4162-924a-4a36bf4bf647/volumes" Nov 04 05:50:49.021598 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:49.021580 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:50:49.313227 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:49.313192 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" event={"ID":"afa6738b-bf5a-4935-872a-beeb48a57617","Type":"ContainerStarted","Data":"7bdbd649e1c6e00393c304e0668bfe347b5a5c40efd3304911efa79b5d65b9a2"} Nov 04 05:50:49.313387 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:49.313276 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" event={"ID":"afa6738b-bf5a-4935-872a-beeb48a57617","Type":"ContainerStarted","Data":"cb6d78cd5156a015803fad14b48e50a351ffd1032ca6d7a5f3875306e4f34d73"} Nov 04 05:50:49.313387 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:49.313299 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" event={"ID":"afa6738b-bf5a-4935-872a-beeb48a57617","Type":"ContainerStarted","Data":"ea7567b7c53e69ec55b83589089a9dd7f03123aeff5559e797d239b418a98385"} Nov 04 05:50:49.447416 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:49.447318 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-669d89855b-2q25b" podStartSLOduration=1.823028689 podStartE2EDuration="4.447305599s" totalImagesPullingTime="2.62427691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:50:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:50:49.446190202 +0000 UTC m=+48.582886601" watchObservedRunningTime="2026-11-04 05:50:49.447305599 +0000 UTC m=+48.584001995" Nov 04 05:50:49.538462 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:49.538430 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Nov 04 05:50:49.541330 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:50:49.541305 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7487de69_9b55_4363_a985_8c80366c2ae0.slice/crio-0cfce0d312b9603b343de93ed801f45f42fea14809f144cf3a75df22c456e8c9 WatchSource:0}: Error finding container 0cfce0d312b9603b343de93ed801f45f42fea14809f144cf3a75df22c456e8c9: Status 404 returned error can't find the container with id 0cfce0d312b9603b343de93ed801f45f42fea14809f144cf3a75df22c456e8c9 Nov 04 05:50:50.319419 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:50.319387 5784 generic.go:356] "Generic (PLEG): container finished" podID="7487de69-9b55-4363-a985-8c80366c2ae0" containerID="cc9a361060d881b4141125e54dd6402158130729714eeefb17fcfc11d3dc6e4b" exitCode=0 Nov 04 05:50:50.319804 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:50.319481 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7487de69-9b55-4363-a985-8c80366c2ae0","Type":"ContainerDied","Data":"cc9a361060d881b4141125e54dd6402158130729714eeefb17fcfc11d3dc6e4b"} Nov 04 05:50:50.319804 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:50.319571 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7487de69-9b55-4363-a985-8c80366c2ae0","Type":"ContainerStarted","Data":"0cfce0d312b9603b343de93ed801f45f42fea14809f144cf3a75df22c456e8c9"} Nov 04 05:50:51.325768 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:51.325728 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7487de69-9b55-4363-a985-8c80366c2ae0","Type":"ContainerStarted","Data":"e24e47d0076afac6da81136122a0eee59cff53dc3549977a11d46e26eacda364"} Nov 04 05:50:51.326222 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:51.325824 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7487de69-9b55-4363-a985-8c80366c2ae0","Type":"ContainerStarted","Data":"6174fdcefe3d83d79f3cab7012b51e9d9ba555d4a8c8eaad2e6295d24ce9eeaf"} Nov 04 05:50:51.326222 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:51.325853 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7487de69-9b55-4363-a985-8c80366c2ae0","Type":"ContainerStarted","Data":"d59b39f8851ea27e5a4af6d964febf5bd89d535e2ba72e541679de4cf9ddc749"} Nov 04 05:50:51.326222 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:51.325881 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7487de69-9b55-4363-a985-8c80366c2ae0","Type":"ContainerStarted","Data":"2e6fcaf4972a02f11c0b59ab7eea24386f1fb7f3d808c8a1320d10b0a102d356"} Nov 04 05:50:51.326222 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:51.325905 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7487de69-9b55-4363-a985-8c80366c2ae0","Type":"ContainerStarted","Data":"eeb85fd6c9e939b693cef59ee02a2234450af88056ef8afb4b9cb3e85005c94c"} Nov 04 05:50:51.326222 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:51.325926 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7487de69-9b55-4363-a985-8c80366c2ae0","Type":"ContainerStarted","Data":"c1dbdb2a3ecfc86182015c5a46e49ee5b11dc42ffeea90a00339d2cfbac4692b"} Nov 04 05:50:51.469046 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:51.468992 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.438665378 podStartE2EDuration="3.468981s" totalImagesPullingTime="0s" totalInitContainerRuntime="30.315622ms" isStatefulPod=false podCreationTimestamp="2026-11-04 05:50:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:50:51.467991825 +0000 UTC m=+50.604688225" watchObservedRunningTime="2026-11-04 05:50:51.468981 +0000 UTC m=+50.605677377" Nov 04 05:50:54.022040 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:50:54.022001 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:51:15.416673 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:51:15.416634 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 05:51:45.417378 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:51:45.417297 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 05:51:47.431336 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:51:47.431297 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:51:47.446955 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:51:47.446926 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:51:47.543930 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:51:47.543903 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Nov 04 05:52:15.417916 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:52:15.417874 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 05:52:45.417303 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:52:45.417263 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 05:53:15.417110 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:53:15.417011 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 05:53:45.416535 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:53:45.416500 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 05:54:15.417433 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:54:15.417394 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 05:54:45.417222 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:54:45.417181 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 05:55:01.033139 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:01.033111 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvgv2_206b2e75-0735-49df-a53c-bdd17aab8ae6/ovn-acl-logging/0.log" Nov 04 05:55:01.034106 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:01.034085 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvgv2_206b2e75-0735-49df-a53c-bdd17aab8ae6/ovn-acl-logging/0.log" Nov 04 05:55:15.416227 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:55:15.416194 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 05:55:16.671772 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:16.671736 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-fqchk"] Nov 04 05:55:16.674740 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:16.674718 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-fqchk" Nov 04 05:55:16.742165 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:16.742130 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af1b509b-fc1e-476e-b439-ecde69ef46b9-tmp\") pod \"jobset-operator-674cd59dc5-fqchk\" (UID: \"af1b509b-fc1e-476e-b439-ecde69ef46b9\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-fqchk" Nov 04 05:55:16.742332 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:16.742184 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xxkw\" (UniqueName: \"kubernetes.io/projected/af1b509b-fc1e-476e-b439-ecde69ef46b9-kube-api-access-4xxkw\") pod \"jobset-operator-674cd59dc5-fqchk\" (UID: \"af1b509b-fc1e-476e-b439-ecde69ef46b9\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-fqchk" Nov 04 05:55:16.791612 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:16.791568 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-lr9l8\"" Nov 04 05:55:16.791612 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:16.791566 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Nov 04 05:55:16.791757 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:16.791580 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Nov 04 05:55:16.792102 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:16.792085 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-fqchk"] Nov 04 05:55:16.843591 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:16.843562 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af1b509b-fc1e-476e-b439-ecde69ef46b9-tmp\") pod \"jobset-operator-674cd59dc5-fqchk\" (UID: \"af1b509b-fc1e-476e-b439-ecde69ef46b9\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-fqchk" Nov 04 05:55:16.843744 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:16.843617 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xxkw\" (UniqueName: \"kubernetes.io/projected/af1b509b-fc1e-476e-b439-ecde69ef46b9-kube-api-access-4xxkw\") pod \"jobset-operator-674cd59dc5-fqchk\" (UID: \"af1b509b-fc1e-476e-b439-ecde69ef46b9\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-fqchk" Nov 04 05:55:16.843992 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:16.843976 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af1b509b-fc1e-476e-b439-ecde69ef46b9-tmp\") pod \"jobset-operator-674cd59dc5-fqchk\" (UID: \"af1b509b-fc1e-476e-b439-ecde69ef46b9\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-fqchk" Nov 04 05:55:16.910777 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:16.910746 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xxkw\" (UniqueName: \"kubernetes.io/projected/af1b509b-fc1e-476e-b439-ecde69ef46b9-kube-api-access-4xxkw\") pod \"jobset-operator-674cd59dc5-fqchk\" (UID: \"af1b509b-fc1e-476e-b439-ecde69ef46b9\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-fqchk" Nov 04 05:55:16.997712 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:16.997644 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-fqchk" Nov 04 05:55:17.375558 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:17.375531 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-fqchk"] Nov 04 05:55:17.378148 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:55:17.378121 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf1b509b_fc1e_476e_b439_ecde69ef46b9.slice/crio-dc72fa200645b23fdf02bd0e3ebf2f42d29e5bfe9dcf4ff622c8b6334a1525ff WatchSource:0}: Error finding container dc72fa200645b23fdf02bd0e3ebf2f42d29e5bfe9dcf4ff622c8b6334a1525ff: Status 404 returned error can't find the container with id dc72fa200645b23fdf02bd0e3ebf2f42d29e5bfe9dcf4ff622c8b6334a1525ff Nov 04 05:55:17.379645 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:17.379629 5784 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 05:55:18.277046 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:18.277011 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-fqchk" event={"ID":"af1b509b-fc1e-476e-b439-ecde69ef46b9","Type":"ContainerStarted","Data":"dc72fa200645b23fdf02bd0e3ebf2f42d29e5bfe9dcf4ff622c8b6334a1525ff"} Nov 04 05:55:21.290629 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:21.290593 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-fqchk" event={"ID":"af1b509b-fc1e-476e-b439-ecde69ef46b9","Type":"ContainerStarted","Data":"00fbbd61bcece5d091578e999c8112b56ad63a924efd0c0bf6cfbb79615a3516"} Nov 04 05:55:21.429537 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:21.429415 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-fqchk" podStartSLOduration=1.6895765379999999 podStartE2EDuration="5.429395473s" totalImagesPullingTime="3.739818935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:55:21.429251007 +0000 UTC m=+320.565947405" watchObservedRunningTime="2026-11-04 05:55:21.429395473 +0000 UTC m=+320.566091872" Nov 04 05:55:27.318539 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.318510 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz"] Nov 04 05:55:27.322142 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.322127 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" Nov 04 05:55:27.439434 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.439390 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec89d529-3bc3-4f0f-9240-5957636531c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-gc9mz\" (UID: \"ec89d529-3bc3-4f0f-9240-5957636531c5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" Nov 04 05:55:27.439622 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.439519 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ec89d529-3bc3-4f0f-9240-5957636531c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-gc9mz\" (UID: \"ec89d529-3bc3-4f0f-9240-5957636531c5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" Nov 04 05:55:27.439672 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.439626 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n94qj\" (UniqueName: \"kubernetes.io/projected/ec89d529-3bc3-4f0f-9240-5957636531c5-kube-api-access-n94qj\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-gc9mz\" (UID: \"ec89d529-3bc3-4f0f-9240-5957636531c5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" Nov 04 05:55:27.439672 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.439654 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ec89d529-3bc3-4f0f-9240-5957636531c5-manifests\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-gc9mz\" (UID: \"ec89d529-3bc3-4f0f-9240-5957636531c5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" Nov 04 05:55:27.439742 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.439670 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec89d529-3bc3-4f0f-9240-5957636531c5-tmp\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-gc9mz\" (UID: \"ec89d529-3bc3-4f0f-9240-5957636531c5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" Nov 04 05:55:27.439776 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.439740 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec89d529-3bc3-4f0f-9240-5957636531c5-metrics-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-gc9mz\" (UID: \"ec89d529-3bc3-4f0f-9240-5957636531c5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" Nov 04 05:55:27.459381 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.459354 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Nov 04 05:55:27.459606 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.459360 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Nov 04 05:55:27.459708 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.459378 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-8fcjx\"" Nov 04 05:55:27.459708 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.459406 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Nov 04 05:55:27.459708 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.459439 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Nov 04 05:55:27.459708 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.459490 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Nov 04 05:55:27.494222 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.494190 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz"] Nov 04 05:55:27.540473 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.540447 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec89d529-3bc3-4f0f-9240-5957636531c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-gc9mz\" (UID: \"ec89d529-3bc3-4f0f-9240-5957636531c5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" Nov 04 05:55:27.540643 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.540489 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ec89d529-3bc3-4f0f-9240-5957636531c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-gc9mz\" (UID: \"ec89d529-3bc3-4f0f-9240-5957636531c5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" Nov 04 05:55:27.540643 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.540537 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n94qj\" (UniqueName: \"kubernetes.io/projected/ec89d529-3bc3-4f0f-9240-5957636531c5-kube-api-access-n94qj\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-gc9mz\" (UID: \"ec89d529-3bc3-4f0f-9240-5957636531c5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" Nov 04 05:55:27.540643 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.540555 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ec89d529-3bc3-4f0f-9240-5957636531c5-manifests\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-gc9mz\" (UID: \"ec89d529-3bc3-4f0f-9240-5957636531c5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" Nov 04 05:55:27.540643 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.540569 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec89d529-3bc3-4f0f-9240-5957636531c5-tmp\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-gc9mz\" (UID: \"ec89d529-3bc3-4f0f-9240-5957636531c5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" Nov 04 05:55:27.540861 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.540638 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec89d529-3bc3-4f0f-9240-5957636531c5-metrics-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-gc9mz\" (UID: \"ec89d529-3bc3-4f0f-9240-5957636531c5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" Nov 04 05:55:27.541043 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.541017 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ec89d529-3bc3-4f0f-9240-5957636531c5-manifests\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-gc9mz\" (UID: \"ec89d529-3bc3-4f0f-9240-5957636531c5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" Nov 04 05:55:27.543185 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.543138 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec89d529-3bc3-4f0f-9240-5957636531c5-tmp\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-gc9mz\" (UID: \"ec89d529-3bc3-4f0f-9240-5957636531c5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" Nov 04 05:55:27.543482 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.543456 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec89d529-3bc3-4f0f-9240-5957636531c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-gc9mz\" (UID: \"ec89d529-3bc3-4f0f-9240-5957636531c5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" Nov 04 05:55:27.543482 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.543472 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ec89d529-3bc3-4f0f-9240-5957636531c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-gc9mz\" (UID: \"ec89d529-3bc3-4f0f-9240-5957636531c5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" Nov 04 05:55:27.543630 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.543577 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec89d529-3bc3-4f0f-9240-5957636531c5-metrics-cert\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-gc9mz\" (UID: \"ec89d529-3bc3-4f0f-9240-5957636531c5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" Nov 04 05:55:27.608044 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.608014 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n94qj\" (UniqueName: \"kubernetes.io/projected/ec89d529-3bc3-4f0f-9240-5957636531c5-kube-api-access-n94qj\") pod \"opendatahub-operator-controller-manager-77fd5fdf4-gc9mz\" (UID: \"ec89d529-3bc3-4f0f-9240-5957636531c5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" Nov 04 05:55:27.639726 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:27.639704 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" Nov 04 05:55:28.140648 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:28.140624 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz"] Nov 04 05:55:28.142480 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:55:28.142452 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec89d529_3bc3_4f0f_9240_5957636531c5.slice/crio-6d4b9ed7fb52c76033f062a7e7feb7293150eb6bb058a6f7b42c3741078f5902 WatchSource:0}: Error finding container 6d4b9ed7fb52c76033f062a7e7feb7293150eb6bb058a6f7b42c3741078f5902: Status 404 returned error can't find the container with id 6d4b9ed7fb52c76033f062a7e7feb7293150eb6bb058a6f7b42c3741078f5902 Nov 04 05:55:28.322353 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:28.322319 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" event={"ID":"ec89d529-3bc3-4f0f-9240-5957636531c5","Type":"ContainerStarted","Data":"6d4b9ed7fb52c76033f062a7e7feb7293150eb6bb058a6f7b42c3741078f5902"} Nov 04 05:55:32.345726 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:32.345689 5784 generic.go:356] "Generic (PLEG): container finished" podID="ec89d529-3bc3-4f0f-9240-5957636531c5" containerID="8aa9ca8403884a8c69548f02d55a20e608c14ad825237f6b581396354048258f" exitCode=0 Nov 04 05:55:32.346265 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:32.345745 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" event={"ID":"ec89d529-3bc3-4f0f-9240-5957636531c5","Type":"ContainerDied","Data":"8aa9ca8403884a8c69548f02d55a20e608c14ad825237f6b581396354048258f"} Nov 04 05:55:33.351693 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:33.351657 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" event={"ID":"ec89d529-3bc3-4f0f-9240-5957636531c5","Type":"ContainerStarted","Data":"51f628f270b2730d839e1300f78d4a0e29341d01773d5294f34643e377276ac9"} Nov 04 05:55:33.352097 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:33.351802 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" Nov 04 05:55:33.618034 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:33.617977 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" podStartSLOduration=1.95191597 podStartE2EDuration="6.617964263s" totalImagesPullingTime="4.236773051s" totalInitContainerRuntime="429.275242ms" isStatefulPod=false podCreationTimestamp="2026-11-04 05:55:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:55:33.562277268 +0000 UTC m=+332.698973666" watchObservedRunningTime="2026-11-04 05:55:33.617964263 +0000 UTC m=+332.754660655" Nov 04 05:55:41.880072 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:41.880037 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-gh6pq"] Nov 04 05:55:41.883219 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:41.883196 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-gh6pq" Nov 04 05:55:41.939559 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:41.939532 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-gh6pq"] Nov 04 05:55:41.994386 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:41.994359 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Nov 04 05:55:41.994495 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:41.994421 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Nov 04 05:55:41.994588 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:41.994573 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Nov 04 05:55:41.994686 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:41.994655 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-82ml9\"" Nov 04 05:55:41.997171 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:41.997156 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Nov 04 05:55:42.070040 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:42.070008 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/83cd6675-926e-41ef-b6d0-fb0f0cc89df9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-gh6pq\" (UID: \"83cd6675-926e-41ef-b6d0-fb0f0cc89df9\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-gh6pq" Nov 04 05:55:42.070040 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:42.070044 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/83cd6675-926e-41ef-b6d0-fb0f0cc89df9-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-gh6pq\" (UID: \"83cd6675-926e-41ef-b6d0-fb0f0cc89df9\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-gh6pq" Nov 04 05:55:42.070258 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:42.070140 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d75qg\" (UniqueName: \"kubernetes.io/projected/83cd6675-926e-41ef-b6d0-fb0f0cc89df9-kube-api-access-d75qg\") pod \"kuadrant-console-plugin-66c4fb575d-gh6pq\" (UID: \"83cd6675-926e-41ef-b6d0-fb0f0cc89df9\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-gh6pq" Nov 04 05:55:42.171476 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:42.171409 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/83cd6675-926e-41ef-b6d0-fb0f0cc89df9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-gh6pq\" (UID: \"83cd6675-926e-41ef-b6d0-fb0f0cc89df9\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-gh6pq" Nov 04 05:55:42.171476 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:42.171446 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/83cd6675-926e-41ef-b6d0-fb0f0cc89df9-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-gh6pq\" (UID: \"83cd6675-926e-41ef-b6d0-fb0f0cc89df9\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-gh6pq" Nov 04 05:55:42.171476 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:42.171469 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d75qg\" (UniqueName: \"kubernetes.io/projected/83cd6675-926e-41ef-b6d0-fb0f0cc89df9-kube-api-access-d75qg\") pod \"kuadrant-console-plugin-66c4fb575d-gh6pq\" (UID: \"83cd6675-926e-41ef-b6d0-fb0f0cc89df9\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-gh6pq" Nov 04 05:55:42.172165 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:42.172146 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/83cd6675-926e-41ef-b6d0-fb0f0cc89df9-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-gh6pq\" (UID: \"83cd6675-926e-41ef-b6d0-fb0f0cc89df9\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-gh6pq" Nov 04 05:55:42.173831 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:42.173810 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/83cd6675-926e-41ef-b6d0-fb0f0cc89df9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-gh6pq\" (UID: \"83cd6675-926e-41ef-b6d0-fb0f0cc89df9\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-gh6pq" Nov 04 05:55:42.238260 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:42.238230 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d75qg\" (UniqueName: \"kubernetes.io/projected/83cd6675-926e-41ef-b6d0-fb0f0cc89df9-kube-api-access-d75qg\") pod \"kuadrant-console-plugin-66c4fb575d-gh6pq\" (UID: \"83cd6675-926e-41ef-b6d0-fb0f0cc89df9\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-gh6pq" Nov 04 05:55:42.495305 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:42.495204 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-gh6pq" Nov 04 05:55:42.877466 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:42.877324 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-gh6pq"] Nov 04 05:55:42.880245 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:55:42.880217 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83cd6675_926e_41ef_b6d0_fb0f0cc89df9.slice/crio-7a60d4c229f452e5ad7de245db9d90371a5a516df3143ea34ac8a0b382bde9c5 WatchSource:0}: Error finding container 7a60d4c229f452e5ad7de245db9d90371a5a516df3143ea34ac8a0b382bde9c5: Status 404 returned error can't find the container with id 7a60d4c229f452e5ad7de245db9d90371a5a516df3143ea34ac8a0b382bde9c5 Nov 04 05:55:43.395047 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:43.395011 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-gh6pq" event={"ID":"83cd6675-926e-41ef-b6d0-fb0f0cc89df9","Type":"ContainerStarted","Data":"7a60d4c229f452e5ad7de245db9d90371a5a516df3143ea34ac8a0b382bde9c5"} Nov 04 05:55:44.358279 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:44.358252 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-77fd5fdf4-gc9mz" Nov 04 05:55:45.434322 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:55:45.434245 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 05:55:46.083401 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:46.083369 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-6s5b2"] Nov 04 05:55:46.086150 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:46.086130 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6s5b2" Nov 04 05:55:46.109967 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:46.109936 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a148022d-9375-4f94-babf-30fe39eb882a-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-6s5b2\" (UID: \"a148022d-9375-4f94-babf-30fe39eb882a\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6s5b2" Nov 04 05:55:46.110283 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:46.110201 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z97nd\" (UniqueName: \"kubernetes.io/projected/a148022d-9375-4f94-babf-30fe39eb882a-kube-api-access-z97nd\") pod \"cert-manager-webhook-5dbbbf75cc-6s5b2\" (UID: \"a148022d-9375-4f94-babf-30fe39eb882a\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6s5b2" Nov 04 05:55:46.146853 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:46.146812 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Nov 04 05:55:46.162723 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:46.162698 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Nov 04 05:55:46.163638 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:46.163618 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-6s5b2"] Nov 04 05:55:46.202713 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:46.202691 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-hhqrm\"" Nov 04 05:55:46.211085 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:46.211039 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z97nd\" (UniqueName: \"kubernetes.io/projected/a148022d-9375-4f94-babf-30fe39eb882a-kube-api-access-z97nd\") pod \"cert-manager-webhook-5dbbbf75cc-6s5b2\" (UID: \"a148022d-9375-4f94-babf-30fe39eb882a\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6s5b2" Nov 04 05:55:46.211222 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:46.211097 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a148022d-9375-4f94-babf-30fe39eb882a-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-6s5b2\" (UID: \"a148022d-9375-4f94-babf-30fe39eb882a\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6s5b2" Nov 04 05:55:46.280581 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:46.280551 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a148022d-9375-4f94-babf-30fe39eb882a-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-6s5b2\" (UID: \"a148022d-9375-4f94-babf-30fe39eb882a\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6s5b2" Nov 04 05:55:46.280749 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:46.280704 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z97nd\" (UniqueName: \"kubernetes.io/projected/a148022d-9375-4f94-babf-30fe39eb882a-kube-api-access-z97nd\") pod \"cert-manager-webhook-5dbbbf75cc-6s5b2\" (UID: \"a148022d-9375-4f94-babf-30fe39eb882a\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6s5b2" Nov 04 05:55:46.398729 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:46.398638 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6s5b2" Nov 04 05:55:46.798959 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:46.798907 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-6s5b2"] Nov 04 05:55:46.801498 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:55:46.801472 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda148022d_9375_4f94_babf_30fe39eb882a.slice/crio-f0357298a10f4a13f4406813c988e597780365f3065f35c0891e49280f34acb2 WatchSource:0}: Error finding container f0357298a10f4a13f4406813c988e597780365f3065f35c0891e49280f34acb2: Status 404 returned error can't find the container with id f0357298a10f4a13f4406813c988e597780365f3065f35c0891e49280f34acb2 Nov 04 05:55:47.418250 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:47.418207 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6s5b2" event={"ID":"a148022d-9375-4f94-babf-30fe39eb882a","Type":"ContainerStarted","Data":"f0357298a10f4a13f4406813c988e597780365f3065f35c0891e49280f34acb2"} Nov 04 05:55:47.757400 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:47.757315 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-kzbds"] Nov 04 05:55:47.760751 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:47.760730 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-kzbds" Nov 04 05:55:47.825056 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:47.825023 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-kzbds"] Nov 04 05:55:47.827801 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:47.827773 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgl8h\" (UniqueName: \"kubernetes.io/projected/2fa7892b-34c2-49fd-8e99-825ef4d9a07b-kube-api-access-qgl8h\") pod \"cert-manager-cainjector-5c57bbd4fc-kzbds\" (UID: \"2fa7892b-34c2-49fd-8e99-825ef4d9a07b\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-kzbds" Nov 04 05:55:47.827942 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:47.827883 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fa7892b-34c2-49fd-8e99-825ef4d9a07b-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-kzbds\" (UID: \"2fa7892b-34c2-49fd-8e99-825ef4d9a07b\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-kzbds" Nov 04 05:55:47.879117 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:47.879089 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-klm8b\"" Nov 04 05:55:47.929271 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:47.929229 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fa7892b-34c2-49fd-8e99-825ef4d9a07b-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-kzbds\" (UID: \"2fa7892b-34c2-49fd-8e99-825ef4d9a07b\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-kzbds" Nov 04 05:55:47.929442 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:47.929401 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgl8h\" (UniqueName: \"kubernetes.io/projected/2fa7892b-34c2-49fd-8e99-825ef4d9a07b-kube-api-access-qgl8h\") pod \"cert-manager-cainjector-5c57bbd4fc-kzbds\" (UID: \"2fa7892b-34c2-49fd-8e99-825ef4d9a07b\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-kzbds" Nov 04 05:55:47.997222 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:47.997197 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgl8h\" (UniqueName: \"kubernetes.io/projected/2fa7892b-34c2-49fd-8e99-825ef4d9a07b-kube-api-access-qgl8h\") pod \"cert-manager-cainjector-5c57bbd4fc-kzbds\" (UID: \"2fa7892b-34c2-49fd-8e99-825ef4d9a07b\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-kzbds" Nov 04 05:55:48.002646 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:48.002614 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fa7892b-34c2-49fd-8e99-825ef4d9a07b-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-kzbds\" (UID: \"2fa7892b-34c2-49fd-8e99-825ef4d9a07b\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-kzbds" Nov 04 05:55:48.072984 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:48.072953 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-kzbds" Nov 04 05:55:48.459676 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:48.459608 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-kzbds"] Nov 04 05:55:48.462775 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:55:48.462741 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fa7892b_34c2_49fd_8e99_825ef4d9a07b.slice/crio-259169689dc7623154a5571b31bb175c28720c62b4b2f41528d6e2c733a0699f WatchSource:0}: Error finding container 259169689dc7623154a5571b31bb175c28720c62b4b2f41528d6e2c733a0699f: Status 404 returned error can't find the container with id 259169689dc7623154a5571b31bb175c28720c62b4b2f41528d6e2c733a0699f Nov 04 05:55:49.431564 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:49.431526 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-gh6pq" event={"ID":"83cd6675-926e-41ef-b6d0-fb0f0cc89df9","Type":"ContainerStarted","Data":"fc448233dd36190ac6ed01fc593a485b928714efcc9b25552245fa17d2b11e84"} Nov 04 05:55:49.433462 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:49.433431 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-kzbds" event={"ID":"2fa7892b-34c2-49fd-8e99-825ef4d9a07b","Type":"ContainerStarted","Data":"259169689dc7623154a5571b31bb175c28720c62b4b2f41528d6e2c733a0699f"} Nov 04 05:55:49.560951 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:49.560887 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-gh6pq" podStartSLOduration=2.8085464350000002 podStartE2EDuration="8.560869781s" totalImagesPullingTime="5.752323346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:55:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:55:49.560100462 +0000 UTC m=+348.696796861" watchObservedRunningTime="2026-11-04 05:55:49.560869781 +0000 UTC m=+348.697566179" Nov 04 05:55:52.451011 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:52.450915 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-kzbds" event={"ID":"2fa7892b-34c2-49fd-8e99-825ef4d9a07b","Type":"ContainerStarted","Data":"4d471b8b33fe0ca70a8e64d09cc37c887403b42a57779e5e4211a9d225c91b9f"} Nov 04 05:55:52.452560 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:52.452536 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6s5b2" event={"ID":"a148022d-9375-4f94-babf-30fe39eb882a","Type":"ContainerStarted","Data":"bbcbeb588f73411b606fb53cbe8eb2cc0c04b893663559b7cbaebdae0e434c9a"} Nov 04 05:55:52.452677 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:52.452581 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6s5b2" Nov 04 05:55:52.578436 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:52.578386 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-kzbds" podStartSLOduration=1.8475963210000002 podStartE2EDuration="5.57837318s" totalImagesPullingTime="3.730776859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:55:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:55:52.577785219 +0000 UTC m=+351.714481618" watchObservedRunningTime="2026-11-04 05:55:52.57837318 +0000 UTC m=+351.715069574" Nov 04 05:55:52.740758 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:52.740665 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6s5b2" podStartSLOduration=2.119918749 podStartE2EDuration="6.7406547s" totalImagesPullingTime="4.620735951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:55:52.739788861 +0000 UTC m=+351.876485260" watchObservedRunningTime="2026-11-04 05:55:52.7406547 +0000 UTC m=+351.877351094" Nov 04 05:55:56.457057 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:56.457019 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-597b95cb84-k7n99"] Nov 04 05:55:56.460714 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:56.460691 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-k7n99" Nov 04 05:55:56.510715 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:56.510681 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/495c0e6e-16df-4bc8-9e93-2180e8178c2f-bound-sa-token\") pod \"cert-manager-597b95cb84-k7n99\" (UID: \"495c0e6e-16df-4bc8-9e93-2180e8178c2f\") " pod="cert-manager/cert-manager-597b95cb84-k7n99" Nov 04 05:55:56.510836 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:56.510817 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgq6c\" (UniqueName: \"kubernetes.io/projected/495c0e6e-16df-4bc8-9e93-2180e8178c2f-kube-api-access-hgq6c\") pod \"cert-manager-597b95cb84-k7n99\" (UID: \"495c0e6e-16df-4bc8-9e93-2180e8178c2f\") " pod="cert-manager/cert-manager-597b95cb84-k7n99" Nov 04 05:55:56.574973 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:56.574943 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-q2tgs\"" Nov 04 05:55:56.576018 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:56.575991 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-k7n99"] Nov 04 05:55:56.611262 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:56.611237 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgq6c\" (UniqueName: \"kubernetes.io/projected/495c0e6e-16df-4bc8-9e93-2180e8178c2f-kube-api-access-hgq6c\") pod \"cert-manager-597b95cb84-k7n99\" (UID: \"495c0e6e-16df-4bc8-9e93-2180e8178c2f\") " pod="cert-manager/cert-manager-597b95cb84-k7n99" Nov 04 05:55:56.611387 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:56.611280 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/495c0e6e-16df-4bc8-9e93-2180e8178c2f-bound-sa-token\") pod \"cert-manager-597b95cb84-k7n99\" (UID: \"495c0e6e-16df-4bc8-9e93-2180e8178c2f\") " pod="cert-manager/cert-manager-597b95cb84-k7n99" Nov 04 05:55:56.678019 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:56.677992 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/495c0e6e-16df-4bc8-9e93-2180e8178c2f-bound-sa-token\") pod \"cert-manager-597b95cb84-k7n99\" (UID: \"495c0e6e-16df-4bc8-9e93-2180e8178c2f\") " pod="cert-manager/cert-manager-597b95cb84-k7n99" Nov 04 05:55:56.678301 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:56.678278 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgq6c\" (UniqueName: \"kubernetes.io/projected/495c0e6e-16df-4bc8-9e93-2180e8178c2f-kube-api-access-hgq6c\") pod \"cert-manager-597b95cb84-k7n99\" (UID: \"495c0e6e-16df-4bc8-9e93-2180e8178c2f\") " pod="cert-manager/cert-manager-597b95cb84-k7n99" Nov 04 05:55:56.773303 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:56.773237 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-k7n99" Nov 04 05:55:57.149213 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:57.149189 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-k7n99"] Nov 04 05:55:57.151021 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:55:57.150986 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod495c0e6e_16df_4bc8_9e93_2180e8178c2f.slice/crio-9c868ad8bb3decfaf0a6b9565339d33382bc0a6177a23da1b8318a80785634d7 WatchSource:0}: Error finding container 9c868ad8bb3decfaf0a6b9565339d33382bc0a6177a23da1b8318a80785634d7: Status 404 returned error can't find the container with id 9c868ad8bb3decfaf0a6b9565339d33382bc0a6177a23da1b8318a80785634d7 Nov 04 05:55:57.474439 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:57.474348 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-k7n99" event={"ID":"495c0e6e-16df-4bc8-9e93-2180e8178c2f","Type":"ContainerStarted","Data":"36970bdf4d245ea9153fd93ecd13e7a107f336bd906507831710e09a908e473c"} Nov 04 05:55:57.474439 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:57.474392 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-k7n99" event={"ID":"495c0e6e-16df-4bc8-9e93-2180e8178c2f","Type":"ContainerStarted","Data":"9c868ad8bb3decfaf0a6b9565339d33382bc0a6177a23da1b8318a80785634d7"} Nov 04 05:55:57.601887 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:57.601828 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-597b95cb84-k7n99" podStartSLOduration=1.60181548 podStartE2EDuration="1.60181548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:55:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:55:57.600656096 +0000 UTC m=+356.737352499" watchObservedRunningTime="2026-11-04 05:55:57.60181548 +0000 UTC m=+356.738511877" Nov 04 05:55:58.458725 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:55:58.458693 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-6s5b2" Nov 04 05:56:03.997567 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:03.997533 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5c8546cb5f-2lpkm"] Nov 04 05:56:04.002217 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:04.002197 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-2lpkm" Nov 04 05:56:04.061093 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:04.061034 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Nov 04 05:56:04.079551 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:04.079521 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ca38de8-70a7-4e51-8f3e-e7dabd425d24-tmp\") pod \"kube-auth-proxy-5c8546cb5f-2lpkm\" (UID: \"8ca38de8-70a7-4e51-8f3e-e7dabd425d24\") " pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-2lpkm" Nov 04 05:56:04.079551 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:04.079555 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ca38de8-70a7-4e51-8f3e-e7dabd425d24-tls-certs\") pod \"kube-auth-proxy-5c8546cb5f-2lpkm\" (UID: \"8ca38de8-70a7-4e51-8f3e-e7dabd425d24\") " pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-2lpkm" Nov 04 05:56:04.079727 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:04.079650 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k86pt\" (UniqueName: \"kubernetes.io/projected/8ca38de8-70a7-4e51-8f3e-e7dabd425d24-kube-api-access-k86pt\") pod \"kube-auth-proxy-5c8546cb5f-2lpkm\" (UID: \"8ca38de8-70a7-4e51-8f3e-e7dabd425d24\") " pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-2lpkm" Nov 04 05:56:04.116656 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:04.116633 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Nov 04 05:56:04.116927 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:04.116915 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Nov 04 05:56:04.117001 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:04.116990 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Nov 04 05:56:04.117038 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:04.117030 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9tz6q\"" Nov 04 05:56:04.118189 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:04.118170 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c8546cb5f-2lpkm"] Nov 04 05:56:04.180730 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:04.180702 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k86pt\" (UniqueName: \"kubernetes.io/projected/8ca38de8-70a7-4e51-8f3e-e7dabd425d24-kube-api-access-k86pt\") pod \"kube-auth-proxy-5c8546cb5f-2lpkm\" (UID: \"8ca38de8-70a7-4e51-8f3e-e7dabd425d24\") " pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-2lpkm" Nov 04 05:56:04.180861 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:04.180759 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ca38de8-70a7-4e51-8f3e-e7dabd425d24-tmp\") pod \"kube-auth-proxy-5c8546cb5f-2lpkm\" (UID: \"8ca38de8-70a7-4e51-8f3e-e7dabd425d24\") " pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-2lpkm" Nov 04 05:56:04.180861 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:04.180789 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ca38de8-70a7-4e51-8f3e-e7dabd425d24-tls-certs\") pod \"kube-auth-proxy-5c8546cb5f-2lpkm\" (UID: \"8ca38de8-70a7-4e51-8f3e-e7dabd425d24\") " pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-2lpkm" Nov 04 05:56:04.183630 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:04.183605 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ca38de8-70a7-4e51-8f3e-e7dabd425d24-tmp\") pod \"kube-auth-proxy-5c8546cb5f-2lpkm\" (UID: \"8ca38de8-70a7-4e51-8f3e-e7dabd425d24\") " pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-2lpkm" Nov 04 05:56:04.183748 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:04.183729 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ca38de8-70a7-4e51-8f3e-e7dabd425d24-tls-certs\") pod \"kube-auth-proxy-5c8546cb5f-2lpkm\" (UID: \"8ca38de8-70a7-4e51-8f3e-e7dabd425d24\") " pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-2lpkm" Nov 04 05:56:04.247273 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:04.247248 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k86pt\" (UniqueName: \"kubernetes.io/projected/8ca38de8-70a7-4e51-8f3e-e7dabd425d24-kube-api-access-k86pt\") pod \"kube-auth-proxy-5c8546cb5f-2lpkm\" (UID: \"8ca38de8-70a7-4e51-8f3e-e7dabd425d24\") " pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-2lpkm" Nov 04 05:56:04.314454 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:04.314393 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-2lpkm" Nov 04 05:56:04.699450 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:04.699417 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c8546cb5f-2lpkm"] Nov 04 05:56:04.702437 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:56:04.702408 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ca38de8_70a7_4e51_8f3e_e7dabd425d24.slice/crio-c8ed5b77a9e0547f0d674e40d6149078bd06d9a6a95ea70d9ff2b0e77cb14dfc WatchSource:0}: Error finding container c8ed5b77a9e0547f0d674e40d6149078bd06d9a6a95ea70d9ff2b0e77cb14dfc: Status 404 returned error can't find the container with id c8ed5b77a9e0547f0d674e40d6149078bd06d9a6a95ea70d9ff2b0e77cb14dfc Nov 04 05:56:05.512419 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:05.512372 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-2lpkm" event={"ID":"8ca38de8-70a7-4e51-8f3e-e7dabd425d24","Type":"ContainerStarted","Data":"c8ed5b77a9e0547f0d674e40d6149078bd06d9a6a95ea70d9ff2b0e77cb14dfc"} Nov 04 05:56:08.527585 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:08.527538 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-2lpkm" event={"ID":"8ca38de8-70a7-4e51-8f3e-e7dabd425d24","Type":"ContainerStarted","Data":"5d684b06f6e409f6914753d7e7409146be9b9b3cdaf49942c31669943506f478"} Nov 04 05:56:08.656073 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:08.656021 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5c8546cb5f-2lpkm" podStartSLOduration=2.754316965 podStartE2EDuration="5.656008318s" totalImagesPullingTime="2.901691353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:56:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:56:08.655363498 +0000 UTC m=+367.792059897" watchObservedRunningTime="2026-11-04 05:56:08.656008318 +0000 UTC m=+367.792704763" Nov 04 05:56:15.417502 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:56:15.417424 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 05:56:18.995730 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:18.995695 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-xx7tk"] Nov 04 05:56:19.000325 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:19.000301 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-xx7tk" Nov 04 05:56:19.017809 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:19.017781 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d-config-file\") pod \"limitador-limitador-74dfcfb894-xx7tk\" (UID: \"77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-xx7tk" Nov 04 05:56:19.017913 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:19.017847 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpj2l\" (UniqueName: \"kubernetes.io/projected/77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d-kube-api-access-vpj2l\") pod \"limitador-limitador-74dfcfb894-xx7tk\" (UID: \"77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-xx7tk" Nov 04 05:56:19.058831 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:19.058798 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-xx7tk"] Nov 04 05:56:19.113432 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:19.113413 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Nov 04 05:56:19.118888 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:19.118865 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d-config-file\") pod \"limitador-limitador-74dfcfb894-xx7tk\" (UID: \"77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-xx7tk" Nov 04 05:56:19.118984 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:19.118895 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpj2l\" (UniqueName: \"kubernetes.io/projected/77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d-kube-api-access-vpj2l\") pod \"limitador-limitador-74dfcfb894-xx7tk\" (UID: \"77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-xx7tk" Nov 04 05:56:19.119506 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:19.119488 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d-config-file\") pod \"limitador-limitador-74dfcfb894-xx7tk\" (UID: \"77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-xx7tk" Nov 04 05:56:19.188161 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:19.188140 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpj2l\" (UniqueName: \"kubernetes.io/projected/77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d-kube-api-access-vpj2l\") pod \"limitador-limitador-74dfcfb894-xx7tk\" (UID: \"77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-xx7tk" Nov 04 05:56:19.256276 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:19.256221 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-xx7tk"] Nov 04 05:56:19.313678 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:19.313649 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-xx7tk" Nov 04 05:56:19.691900 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:19.691858 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-xx7tk"] Nov 04 05:56:19.694457 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:56:19.694426 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77e5c8f6_1c1b_4e9f_b63f_9a6bff24154d.slice/crio-5aa23ec06810e989bcb57a322c724a124c47f466e290f0056329f2cf823f4454 WatchSource:0}: Error finding container 5aa23ec06810e989bcb57a322c724a124c47f466e290f0056329f2cf823f4454: Status 404 returned error can't find the container with id 5aa23ec06810e989bcb57a322c724a124c47f466e290f0056329f2cf823f4454 Nov 04 05:56:20.579223 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:20.579190 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-xx7tk" event={"ID":"77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d","Type":"ContainerStarted","Data":"5aa23ec06810e989bcb57a322c724a124c47f466e290f0056329f2cf823f4454"} Nov 04 05:56:23.969232 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:23.969203 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 05:56:24.022545 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:24.022506 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-bnt6v" Nov 04 05:56:24.055160 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:24.055130 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/17c10873-db3c-4006-a13c-88ccf9f70604-config-file\") pod \"limitador-limitador-7c9b87d574-bnt6v\" (UID: \"17c10873-db3c-4006-a13c-88ccf9f70604\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-bnt6v" Nov 04 05:56:24.055305 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:24.055265 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp4r4\" (UniqueName: \"kubernetes.io/projected/17c10873-db3c-4006-a13c-88ccf9f70604-kube-api-access-hp4r4\") pod \"limitador-limitador-7c9b87d574-bnt6v\" (UID: \"17c10873-db3c-4006-a13c-88ccf9f70604\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-bnt6v" Nov 04 05:56:24.080120 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:24.080090 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 05:56:24.156354 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:24.156316 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp4r4\" (UniqueName: \"kubernetes.io/projected/17c10873-db3c-4006-a13c-88ccf9f70604-kube-api-access-hp4r4\") pod \"limitador-limitador-7c9b87d574-bnt6v\" (UID: \"17c10873-db3c-4006-a13c-88ccf9f70604\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-bnt6v" Nov 04 05:56:24.156548 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:24.156429 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/17c10873-db3c-4006-a13c-88ccf9f70604-config-file\") pod \"limitador-limitador-7c9b87d574-bnt6v\" (UID: \"17c10873-db3c-4006-a13c-88ccf9f70604\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-bnt6v" Nov 04 05:56:24.157082 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:24.157029 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/17c10873-db3c-4006-a13c-88ccf9f70604-config-file\") pod \"limitador-limitador-7c9b87d574-bnt6v\" (UID: \"17c10873-db3c-4006-a13c-88ccf9f70604\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-bnt6v" Nov 04 05:56:24.223736 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:24.223657 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp4r4\" (UniqueName: \"kubernetes.io/projected/17c10873-db3c-4006-a13c-88ccf9f70604-kube-api-access-hp4r4\") pod \"limitador-limitador-7c9b87d574-bnt6v\" (UID: \"17c10873-db3c-4006-a13c-88ccf9f70604\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-bnt6v" Nov 04 05:56:24.330328 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:24.330256 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 05:56:24.355514 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:24.355491 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-bnt6v" Nov 04 05:56:24.753195 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:24.753144 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 05:56:24.755991 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:56:24.755952 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c10873_db3c_4006_a13c_88ccf9f70604.slice/crio-2c3d658bb658d83d25c8162e6fb3f5ccba88bc75d026747ee11c74b77dd7cc15 WatchSource:0}: Error finding container 2c3d658bb658d83d25c8162e6fb3f5ccba88bc75d026747ee11c74b77dd7cc15: Status 404 returned error can't find the container with id 2c3d658bb658d83d25c8162e6fb3f5ccba88bc75d026747ee11c74b77dd7cc15 Nov 04 05:56:25.603438 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:25.603401 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-xx7tk" event={"ID":"77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d","Type":"ContainerStarted","Data":"808e8ab3168133336d4e4aca375c10aa843fe573856d00f27c5c9cc30e22f0ed"} Nov 04 05:56:25.603933 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:25.603492 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-xx7tk" Nov 04 05:56:25.604738 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:25.604716 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-bnt6v" event={"ID":"17c10873-db3c-4006-a13c-88ccf9f70604","Type":"ContainerStarted","Data":"2c3d658bb658d83d25c8162e6fb3f5ccba88bc75d026747ee11c74b77dd7cc15"} Nov 04 05:56:25.731587 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:25.731535 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-xx7tk" podStartSLOduration=2.659206888 podStartE2EDuration="7.731519519s" totalImagesPullingTime="5.072312631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:56:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:56:25.730409369 +0000 UTC m=+384.867105766" watchObservedRunningTime="2026-11-04 05:56:25.731519519 +0000 UTC m=+384.868215926" Nov 04 05:56:26.611003 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:26.610965 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-bnt6v" event={"ID":"17c10873-db3c-4006-a13c-88ccf9f70604","Type":"ContainerStarted","Data":"da7a131547217a2ae1ecb7ec273a0b8ad8c81f2095c97f6d6097e25d1ea45d1c"} Nov 04 05:56:26.611574 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:26.611174 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-bnt6v" Nov 04 05:56:26.738380 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:26.738325 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7c9b87d574-bnt6v" podStartSLOduration=2.332977377 podStartE2EDuration="3.738313507s" totalImagesPullingTime="1.40533613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:56:26.73822978 +0000 UTC m=+385.874926178" watchObservedRunningTime="2026-11-04 05:56:26.738313507 +0000 UTC m=+385.875009904" Nov 04 05:56:36.611883 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:36.611849 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-xx7tk" Nov 04 05:56:37.616403 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:37.616376 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-bnt6v" Nov 04 05:56:37.801323 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:37.801290 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-xx7tk"] Nov 04 05:56:37.801506 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:37.801466 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-xx7tk" podUID="77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d" containerName="limitador" containerID="cri-o://808e8ab3168133336d4e4aca375c10aa843fe573856d00f27c5c9cc30e22f0ed" gracePeriod=30 Nov 04 05:56:38.330304 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:38.330278 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-xx7tk" Nov 04 05:56:38.381747 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:38.381690 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d-kube-api-access-vpj2l\" (UniqueName: \"kubernetes.io/projected/77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d-kube-api-access-vpj2l\") pod \"77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d\" (UID: \"77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d\") " Nov 04 05:56:38.381747 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:38.381735 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d-config-file\" (UniqueName: \"kubernetes.io/configmap/77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d-config-file\") pod \"77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d\" (UID: \"77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d\") " Nov 04 05:56:38.382084 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:38.382042 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d-config-file" pod "77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d" (UID: "77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:56:38.384415 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:38.384386 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d-kube-api-access-vpj2l" pod "77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d" (UID: "77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d"). InnerVolumeSpecName "kube-api-access-vpj2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:56:38.482518 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:38.482486 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpj2l\" (UniqueName: \"kubernetes.io/projected/77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d-kube-api-access-vpj2l\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:56:38.482518 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:38.482516 5784 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d-config-file\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:56:38.661787 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:38.661704 5784 generic.go:356] "Generic (PLEG): container finished" podID="77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d" containerID="808e8ab3168133336d4e4aca375c10aa843fe573856d00f27c5c9cc30e22f0ed" exitCode=0 Nov 04 05:56:38.661787 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:38.661751 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-xx7tk" Nov 04 05:56:38.662338 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:38.661752 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-xx7tk" event={"ID":"77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d","Type":"ContainerDied","Data":"808e8ab3168133336d4e4aca375c10aa843fe573856d00f27c5c9cc30e22f0ed"} Nov 04 05:56:38.662338 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:38.661883 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-xx7tk" event={"ID":"77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d","Type":"ContainerDied","Data":"5aa23ec06810e989bcb57a322c724a124c47f466e290f0056329f2cf823f4454"} Nov 04 05:56:38.662338 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:38.661918 5784 scope.go:122] "RemoveContainer" containerID="808e8ab3168133336d4e4aca375c10aa843fe573856d00f27c5c9cc30e22f0ed" Nov 04 05:56:38.670626 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:38.670608 5784 scope.go:122] "RemoveContainer" containerID="808e8ab3168133336d4e4aca375c10aa843fe573856d00f27c5c9cc30e22f0ed" Nov 04 05:56:38.670906 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:56:38.670886 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"808e8ab3168133336d4e4aca375c10aa843fe573856d00f27c5c9cc30e22f0ed\": container with ID starting with 808e8ab3168133336d4e4aca375c10aa843fe573856d00f27c5c9cc30e22f0ed not found: ID does not exist" containerID="808e8ab3168133336d4e4aca375c10aa843fe573856d00f27c5c9cc30e22f0ed" Nov 04 05:56:38.670954 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:38.670916 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"808e8ab3168133336d4e4aca375c10aa843fe573856d00f27c5c9cc30e22f0ed"} err="failed to get container status \"808e8ab3168133336d4e4aca375c10aa843fe573856d00f27c5c9cc30e22f0ed\": rpc error: code = NotFound desc = could not find container \"808e8ab3168133336d4e4aca375c10aa843fe573856d00f27c5c9cc30e22f0ed\": container with ID starting with 808e8ab3168133336d4e4aca375c10aa843fe573856d00f27c5c9cc30e22f0ed not found: ID does not exist" Nov 04 05:56:38.841325 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:38.841293 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-xx7tk"] Nov 04 05:56:38.847777 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:38.847747 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-xx7tk"] Nov 04 05:56:39.014676 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:56:39.014598 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d" path="/var/lib/kubelet/pods/77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d/volumes" Nov 04 05:56:45.420542 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:56:45.420496 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 05:57:07.501436 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:07.501402 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8b95c9c66-vm7gw"] Nov 04 05:57:07.501838 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:07.501747 5784 cpu_manager.go:414] "containerMap: removing container" podUID="77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d" containerName="limitador" Nov 04 05:57:07.501838 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:07.501758 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d" containerName="limitador" Nov 04 05:57:07.501906 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:07.501849 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="77e5c8f6-1c1b-4e9f-b63f-9a6bff24154d" containerName="limitador" Nov 04 05:57:07.508814 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:07.508791 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8b95c9c66-vm7gw" Nov 04 05:57:07.567198 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:07.567167 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Nov 04 05:57:07.567368 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:07.567273 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Nov 04 05:57:07.609750 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:07.609717 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8rdxg\"" Nov 04 05:57:07.609889 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:07.609835 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Nov 04 05:57:07.621703 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:07.621678 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e2e682c-9ede-493e-9f73-1e15621270e6-webhook-cert\") pod \"maas-controller-8b95c9c66-vm7gw\" (UID: \"5e2e682c-9ede-493e-9f73-1e15621270e6\") " pod="opendatahub/maas-controller-8b95c9c66-vm7gw" Nov 04 05:57:07.621826 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:07.621737 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e2e682c-9ede-493e-9f73-1e15621270e6-metrics-certs\") pod \"maas-controller-8b95c9c66-vm7gw\" (UID: \"5e2e682c-9ede-493e-9f73-1e15621270e6\") " pod="opendatahub/maas-controller-8b95c9c66-vm7gw" Nov 04 05:57:07.621866 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:07.621834 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw7qp\" (UniqueName: \"kubernetes.io/projected/5e2e682c-9ede-493e-9f73-1e15621270e6-kube-api-access-kw7qp\") pod \"maas-controller-8b95c9c66-vm7gw\" (UID: \"5e2e682c-9ede-493e-9f73-1e15621270e6\") " pod="opendatahub/maas-controller-8b95c9c66-vm7gw" Nov 04 05:57:07.623086 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:07.623035 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Nov 04 05:57:07.623195 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:07.623152 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Nov 04 05:57:07.624542 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:07.624520 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8b95c9c66-vm7gw"] Nov 04 05:57:07.722954 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:07.722922 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw7qp\" (UniqueName: \"kubernetes.io/projected/5e2e682c-9ede-493e-9f73-1e15621270e6-kube-api-access-kw7qp\") pod \"maas-controller-8b95c9c66-vm7gw\" (UID: \"5e2e682c-9ede-493e-9f73-1e15621270e6\") " pod="opendatahub/maas-controller-8b95c9c66-vm7gw" Nov 04 05:57:07.723275 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:07.722984 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e2e682c-9ede-493e-9f73-1e15621270e6-webhook-cert\") pod \"maas-controller-8b95c9c66-vm7gw\" (UID: \"5e2e682c-9ede-493e-9f73-1e15621270e6\") " pod="opendatahub/maas-controller-8b95c9c66-vm7gw" Nov 04 05:57:07.723275 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:07.723045 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e2e682c-9ede-493e-9f73-1e15621270e6-metrics-certs\") pod \"maas-controller-8b95c9c66-vm7gw\" (UID: \"5e2e682c-9ede-493e-9f73-1e15621270e6\") " pod="opendatahub/maas-controller-8b95c9c66-vm7gw" Nov 04 05:57:07.723275 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:57:07.723126 5784 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Nov 04 05:57:07.723275 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:57:07.723207 5784 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e2e682c-9ede-493e-9f73-1e15621270e6-webhook-cert podName:5e2e682c-9ede-493e-9f73-1e15621270e6 nodeName:}" failed. No retries permitted until 2026-11-04 05:57:08.223189572 +0000 UTC m=+427.359885948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/5e2e682c-9ede-493e-9f73-1e15621270e6-webhook-cert") pod "maas-controller-8b95c9c66-vm7gw" (UID: "5e2e682c-9ede-493e-9f73-1e15621270e6") : secret "maas-controller-webhook-cert" not found Nov 04 05:57:07.725516 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:07.725492 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e2e682c-9ede-493e-9f73-1e15621270e6-metrics-certs\") pod \"maas-controller-8b95c9c66-vm7gw\" (UID: \"5e2e682c-9ede-493e-9f73-1e15621270e6\") " pod="opendatahub/maas-controller-8b95c9c66-vm7gw" Nov 04 05:57:07.790247 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:07.790177 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw7qp\" (UniqueName: \"kubernetes.io/projected/5e2e682c-9ede-493e-9f73-1e15621270e6-kube-api-access-kw7qp\") pod \"maas-controller-8b95c9c66-vm7gw\" (UID: \"5e2e682c-9ede-493e-9f73-1e15621270e6\") " pod="opendatahub/maas-controller-8b95c9c66-vm7gw" Nov 04 05:57:07.934324 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:07.934285 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6684d95577-2m9xk"] Nov 04 05:57:07.937722 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:07.937698 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6684d95577-2m9xk" Nov 04 05:57:07.999502 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:07.999480 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6684d95577-2m9xk"] Nov 04 05:57:08.025997 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:08.025966 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jfq5\" (UniqueName: \"kubernetes.io/projected/3a430fb7-e8ae-4f64-8f57-e5ea2b808725-kube-api-access-7jfq5\") pod \"maas-controller-6684d95577-2m9xk\" (UID: \"3a430fb7-e8ae-4f64-8f57-e5ea2b808725\") " pod="opendatahub/maas-controller-6684d95577-2m9xk" Nov 04 05:57:08.026148 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:08.026042 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a430fb7-e8ae-4f64-8f57-e5ea2b808725-webhook-cert\") pod \"maas-controller-6684d95577-2m9xk\" (UID: \"3a430fb7-e8ae-4f64-8f57-e5ea2b808725\") " pod="opendatahub/maas-controller-6684d95577-2m9xk" Nov 04 05:57:08.026148 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:08.026142 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a430fb7-e8ae-4f64-8f57-e5ea2b808725-metrics-certs\") pod \"maas-controller-6684d95577-2m9xk\" (UID: \"3a430fb7-e8ae-4f64-8f57-e5ea2b808725\") " pod="opendatahub/maas-controller-6684d95577-2m9xk" Nov 04 05:57:08.127354 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:08.127322 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a430fb7-e8ae-4f64-8f57-e5ea2b808725-metrics-certs\") pod \"maas-controller-6684d95577-2m9xk\" (UID: \"3a430fb7-e8ae-4f64-8f57-e5ea2b808725\") " pod="opendatahub/maas-controller-6684d95577-2m9xk" Nov 04 05:57:08.127511 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:08.127442 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jfq5\" (UniqueName: \"kubernetes.io/projected/3a430fb7-e8ae-4f64-8f57-e5ea2b808725-kube-api-access-7jfq5\") pod \"maas-controller-6684d95577-2m9xk\" (UID: \"3a430fb7-e8ae-4f64-8f57-e5ea2b808725\") " pod="opendatahub/maas-controller-6684d95577-2m9xk" Nov 04 05:57:08.127583 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:08.127517 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a430fb7-e8ae-4f64-8f57-e5ea2b808725-webhook-cert\") pod \"maas-controller-6684d95577-2m9xk\" (UID: \"3a430fb7-e8ae-4f64-8f57-e5ea2b808725\") " pod="opendatahub/maas-controller-6684d95577-2m9xk" Nov 04 05:57:08.129943 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:08.129917 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a430fb7-e8ae-4f64-8f57-e5ea2b808725-metrics-certs\") pod \"maas-controller-6684d95577-2m9xk\" (UID: \"3a430fb7-e8ae-4f64-8f57-e5ea2b808725\") " pod="opendatahub/maas-controller-6684d95577-2m9xk" Nov 04 05:57:08.130041 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:08.129963 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a430fb7-e8ae-4f64-8f57-e5ea2b808725-webhook-cert\") pod \"maas-controller-6684d95577-2m9xk\" (UID: \"3a430fb7-e8ae-4f64-8f57-e5ea2b808725\") " pod="opendatahub/maas-controller-6684d95577-2m9xk" Nov 04 05:57:08.194133 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:08.194108 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jfq5\" (UniqueName: \"kubernetes.io/projected/3a430fb7-e8ae-4f64-8f57-e5ea2b808725-kube-api-access-7jfq5\") pod \"maas-controller-6684d95577-2m9xk\" (UID: \"3a430fb7-e8ae-4f64-8f57-e5ea2b808725\") " pod="opendatahub/maas-controller-6684d95577-2m9xk" Nov 04 05:57:08.228386 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:08.228357 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e2e682c-9ede-493e-9f73-1e15621270e6-webhook-cert\") pod \"maas-controller-8b95c9c66-vm7gw\" (UID: \"5e2e682c-9ede-493e-9f73-1e15621270e6\") " pod="opendatahub/maas-controller-8b95c9c66-vm7gw" Nov 04 05:57:08.230606 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:08.230580 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e2e682c-9ede-493e-9f73-1e15621270e6-webhook-cert\") pod \"maas-controller-8b95c9c66-vm7gw\" (UID: \"5e2e682c-9ede-493e-9f73-1e15621270e6\") " pod="opendatahub/maas-controller-8b95c9c66-vm7gw" Nov 04 05:57:08.250505 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:08.250483 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6684d95577-2m9xk" Nov 04 05:57:08.421290 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:08.421202 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8b95c9c66-vm7gw" Nov 04 05:57:08.627633 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:08.627442 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6684d95577-2m9xk"] Nov 04 05:57:08.630037 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:57:08.630008 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a430fb7_e8ae_4f64_8f57_e5ea2b808725.slice/crio-093c80e4cfc957b2a41034c8a62efb97ecf81b9599e736923fdffb8153cac98d WatchSource:0}: Error finding container 093c80e4cfc957b2a41034c8a62efb97ecf81b9599e736923fdffb8153cac98d: Status 404 returned error can't find the container with id 093c80e4cfc957b2a41034c8a62efb97ecf81b9599e736923fdffb8153cac98d Nov 04 05:57:08.787115 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:08.787041 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6684d95577-2m9xk" event={"ID":"3a430fb7-e8ae-4f64-8f57-e5ea2b808725","Type":"ContainerStarted","Data":"093c80e4cfc957b2a41034c8a62efb97ecf81b9599e736923fdffb8153cac98d"} Nov 04 05:57:08.798247 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:08.798221 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8b95c9c66-vm7gw"] Nov 04 05:57:08.800370 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:57:08.800346 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e2e682c_9ede_493e_9f73_1e15621270e6.slice/crio-1e4b06347d4afea6ffc307519ca8c6270cadb4adb0b3419bc5af011c9ea295fd WatchSource:0}: Error finding container 1e4b06347d4afea6ffc307519ca8c6270cadb4adb0b3419bc5af011c9ea295fd: Status 404 returned error can't find the container with id 1e4b06347d4afea6ffc307519ca8c6270cadb4adb0b3419bc5af011c9ea295fd Nov 04 05:57:09.795173 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:09.795129 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8b95c9c66-vm7gw" event={"ID":"5e2e682c-9ede-493e-9f73-1e15621270e6","Type":"ContainerStarted","Data":"1e4b06347d4afea6ffc307519ca8c6270cadb4adb0b3419bc5af011c9ea295fd"} Nov 04 05:57:12.811870 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:12.811834 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8b95c9c66-vm7gw" event={"ID":"5e2e682c-9ede-493e-9f73-1e15621270e6","Type":"ContainerStarted","Data":"ec315c61662c7c908fa2944d1891024a0fc99992226075d2d37d2f29cb424f95"} Nov 04 05:57:12.812319 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:12.811957 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8b95c9c66-vm7gw" Nov 04 05:57:12.813399 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:12.813373 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6684d95577-2m9xk" event={"ID":"3a430fb7-e8ae-4f64-8f57-e5ea2b808725","Type":"ContainerStarted","Data":"c070aab727e08f06150b70400fba7b01f75a41e1005f58d5f465342d23274118"} Nov 04 05:57:12.813508 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:12.813422 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6684d95577-2m9xk" Nov 04 05:57:12.942285 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:12.942234 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-8b95c9c66-vm7gw" podStartSLOduration=2.769357936 podStartE2EDuration="5.942221434s" totalImagesPullingTime="3.172863498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:57:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:57:12.941591457 +0000 UTC m=+432.078287865" watchObservedRunningTime="2026-11-04 05:57:12.942221434 +0000 UTC m=+432.078917831" Nov 04 05:57:13.072324 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:13.072274 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-6684d95577-2m9xk" podStartSLOduration=2.687688134 podStartE2EDuration="6.072258208s" totalImagesPullingTime="3.384570074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:57:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:57:13.070653967 +0000 UTC m=+432.207350366" watchObservedRunningTime="2026-11-04 05:57:13.072258208 +0000 UTC m=+432.208954607" Nov 04 05:57:15.417199 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:57:15.417162 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 05:57:15.491300 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:15.491263 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh"] Nov 04 05:57:15.494925 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:15.494904 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh" Nov 04 05:57:15.557719 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:15.557689 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh"] Nov 04 05:57:15.593025 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:15.592994 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8bb2009e-1695-4992-b637-3fb00b7aa0b7-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-f9tvh\" (UID: \"8bb2009e-1695-4992-b637-3fb00b7aa0b7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh" Nov 04 05:57:15.593188 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:15.593103 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/8bb2009e-1695-4992-b637-3fb00b7aa0b7-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-f9tvh\" (UID: \"8bb2009e-1695-4992-b637-3fb00b7aa0b7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh" Nov 04 05:57:15.593188 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:15.593143 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bb2009e-1695-4992-b637-3fb00b7aa0b7-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-f9tvh\" (UID: \"8bb2009e-1695-4992-b637-3fb00b7aa0b7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh" Nov 04 05:57:15.593262 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:15.593229 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz7sr\" (UniqueName: \"kubernetes.io/projected/8bb2009e-1695-4992-b637-3fb00b7aa0b7-kube-api-access-bz7sr\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-f9tvh\" (UID: \"8bb2009e-1695-4992-b637-3fb00b7aa0b7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh" Nov 04 05:57:15.612012 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:15.611980 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\"" Nov 04 05:57:15.612181 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:15.612020 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\"" Nov 04 05:57:15.612181 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:15.612084 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\"" Nov 04 05:57:15.612181 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:15.612127 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-7zcqq\"" Nov 04 05:57:15.694643 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:15.694557 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bb2009e-1695-4992-b637-3fb00b7aa0b7-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-f9tvh\" (UID: \"8bb2009e-1695-4992-b637-3fb00b7aa0b7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh" Nov 04 05:57:15.694643 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:15.694629 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz7sr\" (UniqueName: \"kubernetes.io/projected/8bb2009e-1695-4992-b637-3fb00b7aa0b7-kube-api-access-bz7sr\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-f9tvh\" (UID: \"8bb2009e-1695-4992-b637-3fb00b7aa0b7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh" Nov 04 05:57:15.694886 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:15.694700 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8bb2009e-1695-4992-b637-3fb00b7aa0b7-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-f9tvh\" (UID: \"8bb2009e-1695-4992-b637-3fb00b7aa0b7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh" Nov 04 05:57:15.694886 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:15.694756 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/8bb2009e-1695-4992-b637-3fb00b7aa0b7-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-f9tvh\" (UID: \"8bb2009e-1695-4992-b637-3fb00b7aa0b7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh" Nov 04 05:57:15.694886 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:57:15.694838 5784 secret.go:189] Couldn't get secret opendatahub/usage-logs-tenancy-proxy-tls: secret "usage-logs-tenancy-proxy-tls" not found Nov 04 05:57:15.695097 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:57:15.694917 5784 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bb2009e-1695-4992-b637-3fb00b7aa0b7-tls-cert podName:8bb2009e-1695-4992-b637-3fb00b7aa0b7 nodeName:}" failed. No retries permitted until 2026-11-04 05:57:16.194896547 +0000 UTC m=+435.331592939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-cert" (UniqueName: "kubernetes.io/secret/8bb2009e-1695-4992-b637-3fb00b7aa0b7-tls-cert") pod "usage-logs-tenancy-proxy-9c5d49bcd-f9tvh" (UID: "8bb2009e-1695-4992-b637-3fb00b7aa0b7") : secret "usage-logs-tenancy-proxy-tls" not found Nov 04 05:57:15.695097 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:57:15.694837 5784 configmap.go:193] Couldn't get configMap opendatahub/usage-tenancy-proxy-source: configmap "usage-tenancy-proxy-source" not found Nov 04 05:57:15.695097 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:57:15.695013 5784 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8bb2009e-1695-4992-b637-3fb00b7aa0b7-proxy-source podName:8bb2009e-1695-4992-b637-3fb00b7aa0b7 nodeName:}" failed. No retries permitted until 2026-11-04 05:57:16.1949936 +0000 UTC m=+435.331689993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-source" (UniqueName: "kubernetes.io/configmap/8bb2009e-1695-4992-b637-3fb00b7aa0b7-proxy-source") pod "usage-logs-tenancy-proxy-9c5d49bcd-f9tvh" (UID: "8bb2009e-1695-4992-b637-3fb00b7aa0b7") : configmap "usage-tenancy-proxy-source" not found Nov 04 05:57:15.695215 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:15.695195 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bb2009e-1695-4992-b637-3fb00b7aa0b7-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-f9tvh\" (UID: \"8bb2009e-1695-4992-b637-3fb00b7aa0b7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh" Nov 04 05:57:15.761831 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:15.761800 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz7sr\" (UniqueName: \"kubernetes.io/projected/8bb2009e-1695-4992-b637-3fb00b7aa0b7-kube-api-access-bz7sr\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-f9tvh\" (UID: \"8bb2009e-1695-4992-b637-3fb00b7aa0b7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh" Nov 04 05:57:16.199649 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:16.199614 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8bb2009e-1695-4992-b637-3fb00b7aa0b7-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-f9tvh\" (UID: \"8bb2009e-1695-4992-b637-3fb00b7aa0b7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh" Nov 04 05:57:16.199842 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:16.199665 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/8bb2009e-1695-4992-b637-3fb00b7aa0b7-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-f9tvh\" (UID: \"8bb2009e-1695-4992-b637-3fb00b7aa0b7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh" Nov 04 05:57:16.200504 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:16.200479 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/8bb2009e-1695-4992-b637-3fb00b7aa0b7-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-f9tvh\" (UID: \"8bb2009e-1695-4992-b637-3fb00b7aa0b7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh" Nov 04 05:57:16.201983 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:16.201954 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8bb2009e-1695-4992-b637-3fb00b7aa0b7-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-f9tvh\" (UID: \"8bb2009e-1695-4992-b637-3fb00b7aa0b7\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh" Nov 04 05:57:16.407765 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:16.407736 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh" Nov 04 05:57:16.787433 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:16.787408 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh"] Nov 04 05:57:16.789630 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:57:16.789604 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bb2009e_1695_4992_b637_3fb00b7aa0b7.slice/crio-fbd02a1bba5487116e5102fcc565ff04ed96f540f747c6be5337f8b45f3bdf6d WatchSource:0}: Error finding container fbd02a1bba5487116e5102fcc565ff04ed96f540f747c6be5337f8b45f3bdf6d: Status 404 returned error can't find the container with id fbd02a1bba5487116e5102fcc565ff04ed96f540f747c6be5337f8b45f3bdf6d Nov 04 05:57:16.833539 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:16.833507 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh" event={"ID":"8bb2009e-1695-4992-b637-3fb00b7aa0b7","Type":"ContainerStarted","Data":"fbd02a1bba5487116e5102fcc565ff04ed96f540f747c6be5337f8b45f3bdf6d"} Nov 04 05:57:23.820917 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:23.820886 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6684d95577-2m9xk" Nov 04 05:57:23.821426 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:23.820970 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8b95c9c66-vm7gw" Nov 04 05:57:24.058547 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:24.058455 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8b95c9c66-vm7gw"] Nov 04 05:57:24.059314 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:24.059070 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-8b95c9c66-vm7gw" podUID="5e2e682c-9ede-493e-9f73-1e15621270e6" containerName="manager" containerID="cri-o://ec315c61662c7c908fa2944d1891024a0fc99992226075d2d37d2f29cb424f95" gracePeriod=30 Nov 04 05:57:24.465436 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:24.465409 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8b95c9c66-vm7gw" Nov 04 05:57:24.482365 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:24.482335 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5e2e682c-9ede-493e-9f73-1e15621270e6-webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e2e682c-9ede-493e-9f73-1e15621270e6-webhook-cert\") pod \"5e2e682c-9ede-493e-9f73-1e15621270e6\" (UID: \"5e2e682c-9ede-493e-9f73-1e15621270e6\") " Nov 04 05:57:24.482515 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:24.482415 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5e2e682c-9ede-493e-9f73-1e15621270e6-kube-api-access-kw7qp\" (UniqueName: \"kubernetes.io/projected/5e2e682c-9ede-493e-9f73-1e15621270e6-kube-api-access-kw7qp\") pod \"5e2e682c-9ede-493e-9f73-1e15621270e6\" (UID: \"5e2e682c-9ede-493e-9f73-1e15621270e6\") " Nov 04 05:57:24.482515 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:24.482475 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5e2e682c-9ede-493e-9f73-1e15621270e6-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e2e682c-9ede-493e-9f73-1e15621270e6-metrics-certs\") pod \"5e2e682c-9ede-493e-9f73-1e15621270e6\" (UID: \"5e2e682c-9ede-493e-9f73-1e15621270e6\") " Nov 04 05:57:24.486525 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:24.486497 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e2e682c-9ede-493e-9f73-1e15621270e6-metrics-certs" pod "5e2e682c-9ede-493e-9f73-1e15621270e6" (UID: "5e2e682c-9ede-493e-9f73-1e15621270e6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:57:24.487560 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:24.487529 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e2e682c-9ede-493e-9f73-1e15621270e6-kube-api-access-kw7qp" pod "5e2e682c-9ede-493e-9f73-1e15621270e6" (UID: "5e2e682c-9ede-493e-9f73-1e15621270e6"). InnerVolumeSpecName "kube-api-access-kw7qp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:57:24.504029 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:24.503980 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e2e682c-9ede-493e-9f73-1e15621270e6-webhook-cert" pod "5e2e682c-9ede-493e-9f73-1e15621270e6" (UID: "5e2e682c-9ede-493e-9f73-1e15621270e6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:57:24.583453 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:24.583402 5784 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e2e682c-9ede-493e-9f73-1e15621270e6-webhook-cert\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:57:24.583453 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:24.583432 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw7qp\" (UniqueName: \"kubernetes.io/projected/5e2e682c-9ede-493e-9f73-1e15621270e6-kube-api-access-kw7qp\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:57:24.583453 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:24.583451 5784 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e2e682c-9ede-493e-9f73-1e15621270e6-metrics-certs\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:57:24.876532 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:24.876502 5784 generic.go:356] "Generic (PLEG): container finished" podID="5e2e682c-9ede-493e-9f73-1e15621270e6" containerID="ec315c61662c7c908fa2944d1891024a0fc99992226075d2d37d2f29cb424f95" exitCode=0 Nov 04 05:57:24.876962 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:24.876558 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8b95c9c66-vm7gw" Nov 04 05:57:24.876962 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:24.876580 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8b95c9c66-vm7gw" event={"ID":"5e2e682c-9ede-493e-9f73-1e15621270e6","Type":"ContainerDied","Data":"ec315c61662c7c908fa2944d1891024a0fc99992226075d2d37d2f29cb424f95"} Nov 04 05:57:24.876962 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:24.876627 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8b95c9c66-vm7gw" event={"ID":"5e2e682c-9ede-493e-9f73-1e15621270e6","Type":"ContainerDied","Data":"1e4b06347d4afea6ffc307519ca8c6270cadb4adb0b3419bc5af011c9ea295fd"} Nov 04 05:57:24.876962 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:24.876656 5784 scope.go:122] "RemoveContainer" containerID="ec315c61662c7c908fa2944d1891024a0fc99992226075d2d37d2f29cb424f95" Nov 04 05:57:24.885909 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:24.885886 5784 scope.go:122] "RemoveContainer" containerID="ec315c61662c7c908fa2944d1891024a0fc99992226075d2d37d2f29cb424f95" Nov 04 05:57:24.886362 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:57:24.886332 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec315c61662c7c908fa2944d1891024a0fc99992226075d2d37d2f29cb424f95\": container with ID starting with ec315c61662c7c908fa2944d1891024a0fc99992226075d2d37d2f29cb424f95 not found: ID does not exist" containerID="ec315c61662c7c908fa2944d1891024a0fc99992226075d2d37d2f29cb424f95" Nov 04 05:57:24.886472 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:24.886373 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec315c61662c7c908fa2944d1891024a0fc99992226075d2d37d2f29cb424f95"} err="failed to get container status \"ec315c61662c7c908fa2944d1891024a0fc99992226075d2d37d2f29cb424f95\": rpc error: code = NotFound desc = could not find container \"ec315c61662c7c908fa2944d1891024a0fc99992226075d2d37d2f29cb424f95\": container with ID starting with ec315c61662c7c908fa2944d1891024a0fc99992226075d2d37d2f29cb424f95 not found: ID does not exist" Nov 04 05:57:25.058334 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:25.058302 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8b95c9c66-vm7gw"] Nov 04 05:57:25.114391 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:25.114361 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8b95c9c66-vm7gw"] Nov 04 05:57:27.016601 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:27.016572 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5e2e682c-9ede-493e-9f73-1e15621270e6" path="/var/lib/kubelet/pods/5e2e682c-9ede-493e-9f73-1e15621270e6/volumes" Nov 04 05:57:29.905494 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:29.905398 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh" event={"ID":"8bb2009e-1695-4992-b637-3fb00b7aa0b7","Type":"ContainerStarted","Data":"b5be79c75e83f2f2217a150e8b11ebb94a164f0d15353cd7cf897ac9fc62b75e"} Nov 04 05:57:29.905892 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:29.905530 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh" Nov 04 05:57:30.035023 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:30.034974 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh" podStartSLOduration=2.212034524 podStartE2EDuration="15.034962512s" totalImagesPullingTime="12.822927988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:57:30.033432851 +0000 UTC m=+449.170129249" watchObservedRunningTime="2026-11-04 05:57:30.034962512 +0000 UTC m=+449.171658911" Nov 04 05:57:40.161298 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.157269 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-5sp6z"] Nov 04 05:57:40.161298 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.158150 5784 cpu_manager.go:414] "containerMap: removing container" podUID="5e2e682c-9ede-493e-9f73-1e15621270e6" containerName="manager" Nov 04 05:57:40.161298 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.158170 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5e2e682c-9ede-493e-9f73-1e15621270e6" containerName="manager" Nov 04 05:57:40.161298 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.158393 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="5e2e682c-9ede-493e-9f73-1e15621270e6" containerName="manager" Nov 04 05:57:40.164234 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.164212 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-5sp6z" Nov 04 05:57:40.221096 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.221048 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-5sp6z"] Nov 04 05:57:40.243546 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.243504 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/070d92df-00ba-41ef-869f-574bbc71f8e3-cert\") pod \"kserve-controller-manager-776cc66d47-5sp6z\" (UID: \"070d92df-00ba-41ef-869f-574bbc71f8e3\") " pod="opendatahub/kserve-controller-manager-776cc66d47-5sp6z" Nov 04 05:57:40.243689 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.243568 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhdbv\" (UniqueName: \"kubernetes.io/projected/070d92df-00ba-41ef-869f-574bbc71f8e3-kube-api-access-xhdbv\") pod \"kserve-controller-manager-776cc66d47-5sp6z\" (UID: \"070d92df-00ba-41ef-869f-574bbc71f8e3\") " pod="opendatahub/kserve-controller-manager-776cc66d47-5sp6z" Nov 04 05:57:40.275646 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.275613 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Nov 04 05:57:40.278767 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.278749 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gdnnc\"" Nov 04 05:57:40.280183 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.280163 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n"] Nov 04 05:57:40.283788 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.283766 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n" Nov 04 05:57:40.339996 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.339971 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n"] Nov 04 05:57:40.342467 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.342432 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Nov 04 05:57:40.342574 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.342544 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-5tmcb\"" Nov 04 05:57:40.344255 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.344235 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhdbv\" (UniqueName: \"kubernetes.io/projected/070d92df-00ba-41ef-869f-574bbc71f8e3-kube-api-access-xhdbv\") pod \"kserve-controller-manager-776cc66d47-5sp6z\" (UID: \"070d92df-00ba-41ef-869f-574bbc71f8e3\") " pod="opendatahub/kserve-controller-manager-776cc66d47-5sp6z" Nov 04 05:57:40.344344 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.344290 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9b6985d-f9ca-4957-b01c-41fd724dacbd-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-cz48n\" (UID: \"e9b6985d-f9ca-4957-b01c-41fd724dacbd\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n" Nov 04 05:57:40.344344 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.344317 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zmzh\" (UniqueName: \"kubernetes.io/projected/e9b6985d-f9ca-4957-b01c-41fd724dacbd-kube-api-access-6zmzh\") pod \"llmisvc-controller-manager-869d5dcc5d-cz48n\" (UID: \"e9b6985d-f9ca-4957-b01c-41fd724dacbd\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n" Nov 04 05:57:40.344452 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.344361 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/070d92df-00ba-41ef-869f-574bbc71f8e3-cert\") pod \"kserve-controller-manager-776cc66d47-5sp6z\" (UID: \"070d92df-00ba-41ef-869f-574bbc71f8e3\") " pod="opendatahub/kserve-controller-manager-776cc66d47-5sp6z" Nov 04 05:57:40.346634 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.346611 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/070d92df-00ba-41ef-869f-574bbc71f8e3-cert\") pod \"kserve-controller-manager-776cc66d47-5sp6z\" (UID: \"070d92df-00ba-41ef-869f-574bbc71f8e3\") " pod="opendatahub/kserve-controller-manager-776cc66d47-5sp6z" Nov 04 05:57:40.405037 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.405004 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-jvh5s"] Nov 04 05:57:40.408801 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.408779 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-jvh5s" Nov 04 05:57:40.413753 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.413697 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhdbv\" (UniqueName: \"kubernetes.io/projected/070d92df-00ba-41ef-869f-574bbc71f8e3-kube-api-access-xhdbv\") pod \"kserve-controller-manager-776cc66d47-5sp6z\" (UID: \"070d92df-00ba-41ef-869f-574bbc71f8e3\") " pod="opendatahub/kserve-controller-manager-776cc66d47-5sp6z" Nov 04 05:57:40.445950 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.445924 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9b6985d-f9ca-4957-b01c-41fd724dacbd-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-cz48n\" (UID: \"e9b6985d-f9ca-4957-b01c-41fd724dacbd\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n" Nov 04 05:57:40.446085 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.445956 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zmzh\" (UniqueName: \"kubernetes.io/projected/e9b6985d-f9ca-4957-b01c-41fd724dacbd-kube-api-access-6zmzh\") pod \"llmisvc-controller-manager-869d5dcc5d-cz48n\" (UID: \"e9b6985d-f9ca-4957-b01c-41fd724dacbd\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n" Nov 04 05:57:40.448523 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.448497 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9b6985d-f9ca-4957-b01c-41fd724dacbd-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-cz48n\" (UID: \"e9b6985d-f9ca-4957-b01c-41fd724dacbd\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n" Nov 04 05:57:40.467641 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.467616 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-8js5q\"" Nov 04 05:57:40.469198 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.469177 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-jvh5s"] Nov 04 05:57:40.470320 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.470297 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Nov 04 05:57:40.476473 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.476451 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-5sp6z" Nov 04 05:57:40.514020 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.513997 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zmzh\" (UniqueName: \"kubernetes.io/projected/e9b6985d-f9ca-4957-b01c-41fd724dacbd-kube-api-access-6zmzh\") pod \"llmisvc-controller-manager-869d5dcc5d-cz48n\" (UID: \"e9b6985d-f9ca-4957-b01c-41fd724dacbd\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n" Nov 04 05:57:40.526983 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.526948 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-j2scg"] Nov 04 05:57:40.532417 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.532393 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-j2scg" Nov 04 05:57:40.546827 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.546796 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbqkl\" (UniqueName: \"kubernetes.io/projected/a7b48a8d-23bd-4e46-bfb5-27b2e2cf5098-kube-api-access-wbqkl\") pod \"model-serving-api-75bd89fdfc-jvh5s\" (UID: \"a7b48a8d-23bd-4e46-bfb5-27b2e2cf5098\") " pod="opendatahub/model-serving-api-75bd89fdfc-jvh5s" Nov 04 05:57:40.546963 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.546914 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7b48a8d-23bd-4e46-bfb5-27b2e2cf5098-tls-certs\") pod \"model-serving-api-75bd89fdfc-jvh5s\" (UID: \"a7b48a8d-23bd-4e46-bfb5-27b2e2cf5098\") " pod="opendatahub/model-serving-api-75bd89fdfc-jvh5s" Nov 04 05:57:40.590318 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.590294 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-j2scg"] Nov 04 05:57:40.591602 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.591562 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\"" Nov 04 05:57:40.591602 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.591582 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-cw2fw\"" Nov 04 05:57:40.591768 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.591625 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Nov 04 05:57:40.595709 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.595689 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n" Nov 04 05:57:40.648991 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.647744 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab61e4c5-9f11-4bf8-a885-bc10fdf4d3b1-metrics-certs\") pod \"odh-model-controller-769875db56-j2scg\" (UID: \"ab61e4c5-9f11-4bf8-a885-bc10fdf4d3b1\") " pod="opendatahub/odh-model-controller-769875db56-j2scg" Nov 04 05:57:40.648991 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.647811 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7b48a8d-23bd-4e46-bfb5-27b2e2cf5098-tls-certs\") pod \"model-serving-api-75bd89fdfc-jvh5s\" (UID: \"a7b48a8d-23bd-4e46-bfb5-27b2e2cf5098\") " pod="opendatahub/model-serving-api-75bd89fdfc-jvh5s" Nov 04 05:57:40.648991 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.647914 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab61e4c5-9f11-4bf8-a885-bc10fdf4d3b1-cert\") pod \"odh-model-controller-769875db56-j2scg\" (UID: \"ab61e4c5-9f11-4bf8-a885-bc10fdf4d3b1\") " pod="opendatahub/odh-model-controller-769875db56-j2scg" Nov 04 05:57:40.648991 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.647958 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc59h\" (UniqueName: \"kubernetes.io/projected/ab61e4c5-9f11-4bf8-a885-bc10fdf4d3b1-kube-api-access-lc59h\") pod \"odh-model-controller-769875db56-j2scg\" (UID: \"ab61e4c5-9f11-4bf8-a885-bc10fdf4d3b1\") " pod="opendatahub/odh-model-controller-769875db56-j2scg" Nov 04 05:57:40.648991 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.647998 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbqkl\" (UniqueName: \"kubernetes.io/projected/a7b48a8d-23bd-4e46-bfb5-27b2e2cf5098-kube-api-access-wbqkl\") pod \"model-serving-api-75bd89fdfc-jvh5s\" (UID: \"a7b48a8d-23bd-4e46-bfb5-27b2e2cf5098\") " pod="opendatahub/model-serving-api-75bd89fdfc-jvh5s" Nov 04 05:57:40.652945 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.652026 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7b48a8d-23bd-4e46-bfb5-27b2e2cf5098-tls-certs\") pod \"model-serving-api-75bd89fdfc-jvh5s\" (UID: \"a7b48a8d-23bd-4e46-bfb5-27b2e2cf5098\") " pod="opendatahub/model-serving-api-75bd89fdfc-jvh5s" Nov 04 05:57:40.714581 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.714518 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbqkl\" (UniqueName: \"kubernetes.io/projected/a7b48a8d-23bd-4e46-bfb5-27b2e2cf5098-kube-api-access-wbqkl\") pod \"model-serving-api-75bd89fdfc-jvh5s\" (UID: \"a7b48a8d-23bd-4e46-bfb5-27b2e2cf5098\") " pod="opendatahub/model-serving-api-75bd89fdfc-jvh5s" Nov 04 05:57:40.729506 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.729482 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-jvh5s" Nov 04 05:57:40.748914 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.748887 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab61e4c5-9f11-4bf8-a885-bc10fdf4d3b1-cert\") pod \"odh-model-controller-769875db56-j2scg\" (UID: \"ab61e4c5-9f11-4bf8-a885-bc10fdf4d3b1\") " pod="opendatahub/odh-model-controller-769875db56-j2scg" Nov 04 05:57:40.748998 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.748927 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc59h\" (UniqueName: \"kubernetes.io/projected/ab61e4c5-9f11-4bf8-a885-bc10fdf4d3b1-kube-api-access-lc59h\") pod \"odh-model-controller-769875db56-j2scg\" (UID: \"ab61e4c5-9f11-4bf8-a885-bc10fdf4d3b1\") " pod="opendatahub/odh-model-controller-769875db56-j2scg" Nov 04 05:57:40.748998 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.748982 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab61e4c5-9f11-4bf8-a885-bc10fdf4d3b1-metrics-certs\") pod \"odh-model-controller-769875db56-j2scg\" (UID: \"ab61e4c5-9f11-4bf8-a885-bc10fdf4d3b1\") " pod="opendatahub/odh-model-controller-769875db56-j2scg" Nov 04 05:57:40.751171 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.751150 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab61e4c5-9f11-4bf8-a885-bc10fdf4d3b1-metrics-certs\") pod \"odh-model-controller-769875db56-j2scg\" (UID: \"ab61e4c5-9f11-4bf8-a885-bc10fdf4d3b1\") " pod="opendatahub/odh-model-controller-769875db56-j2scg" Nov 04 05:57:40.751262 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.751196 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab61e4c5-9f11-4bf8-a885-bc10fdf4d3b1-cert\") pod \"odh-model-controller-769875db56-j2scg\" (UID: \"ab61e4c5-9f11-4bf8-a885-bc10fdf4d3b1\") " pod="opendatahub/odh-model-controller-769875db56-j2scg" Nov 04 05:57:40.816016 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.815990 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc59h\" (UniqueName: \"kubernetes.io/projected/ab61e4c5-9f11-4bf8-a885-bc10fdf4d3b1-kube-api-access-lc59h\") pod \"odh-model-controller-769875db56-j2scg\" (UID: \"ab61e4c5-9f11-4bf8-a885-bc10fdf4d3b1\") " pod="opendatahub/odh-model-controller-769875db56-j2scg" Nov 04 05:57:40.859691 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.859657 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-j2scg" Nov 04 05:57:40.861977 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.861948 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-5sp6z"] Nov 04 05:57:40.863309 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:57:40.863278 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod070d92df_00ba_41ef_869f_574bbc71f8e3.slice/crio-f31144ebcb385d3f68a2634ed384d135173f0a50be16c5317ae4c3bb18f9cd15 WatchSource:0}: Error finding container f31144ebcb385d3f68a2634ed384d135173f0a50be16c5317ae4c3bb18f9cd15: Status 404 returned error can't find the container with id f31144ebcb385d3f68a2634ed384d135173f0a50be16c5317ae4c3bb18f9cd15 Nov 04 05:57:40.917478 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.917449 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-f9tvh" Nov 04 05:57:40.956515 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.956485 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-5sp6z" event={"ID":"070d92df-00ba-41ef-869f-574bbc71f8e3","Type":"ContainerStarted","Data":"f31144ebcb385d3f68a2634ed384d135173f0a50be16c5317ae4c3bb18f9cd15"} Nov 04 05:57:40.972360 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:40.972338 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n"] Nov 04 05:57:40.974840 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:57:40.974805 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode9b6985d_f9ca_4957_b01c_41fd724dacbd.slice/crio-d76dc1f27f2dc4ccc23f3b7c3820dac0ac0c1e859d78dae9758af846b1f112d7 WatchSource:0}: Error finding container d76dc1f27f2dc4ccc23f3b7c3820dac0ac0c1e859d78dae9758af846b1f112d7: Status 404 returned error can't find the container with id d76dc1f27f2dc4ccc23f3b7c3820dac0ac0c1e859d78dae9758af846b1f112d7 Nov 04 05:57:41.107149 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:41.107127 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-jvh5s"] Nov 04 05:57:41.108971 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:57:41.108944 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b48a8d_23bd_4e46_bfb5_27b2e2cf5098.slice/crio-f993299ed37ba2feec7d6b96d78372ef2fc9cf28598a067842eeb78d6615df03 WatchSource:0}: Error finding container f993299ed37ba2feec7d6b96d78372ef2fc9cf28598a067842eeb78d6615df03: Status 404 returned error can't find the container with id f993299ed37ba2feec7d6b96d78372ef2fc9cf28598a067842eeb78d6615df03 Nov 04 05:57:41.240224 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:41.240200 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-j2scg"] Nov 04 05:57:41.241770 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:57:41.241742 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab61e4c5_9f11_4bf8_a885_bc10fdf4d3b1.slice/crio-5a3986cac89f10c8a0e90202e793b600266fdf1f2cfe8622ae56957deda1877c WatchSource:0}: Error finding container 5a3986cac89f10c8a0e90202e793b600266fdf1f2cfe8622ae56957deda1877c: Status 404 returned error can't find the container with id 5a3986cac89f10c8a0e90202e793b600266fdf1f2cfe8622ae56957deda1877c Nov 04 05:57:41.966135 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:41.966039 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n" event={"ID":"e9b6985d-f9ca-4957-b01c-41fd724dacbd","Type":"ContainerStarted","Data":"d76dc1f27f2dc4ccc23f3b7c3820dac0ac0c1e859d78dae9758af846b1f112d7"} Nov 04 05:57:41.968500 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:41.968465 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-j2scg" event={"ID":"ab61e4c5-9f11-4bf8-a885-bc10fdf4d3b1","Type":"ContainerStarted","Data":"5a3986cac89f10c8a0e90202e793b600266fdf1f2cfe8622ae56957deda1877c"} Nov 04 05:57:41.970167 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:41.970129 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-jvh5s" event={"ID":"a7b48a8d-23bd-4e46-bfb5-27b2e2cf5098","Type":"ContainerStarted","Data":"f993299ed37ba2feec7d6b96d78372ef2fc9cf28598a067842eeb78d6615df03"} Nov 04 05:57:44.995257 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:44.995211 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-jvh5s" event={"ID":"a7b48a8d-23bd-4e46-bfb5-27b2e2cf5098","Type":"ContainerStarted","Data":"17ef5866f48eb8c09d9c6c9199621761057d68405a9b88debbf5b8268ef1592d"} Nov 04 05:57:44.995751 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:44.995312 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-jvh5s" Nov 04 05:57:44.997326 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:44.997298 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-5sp6z" event={"ID":"070d92df-00ba-41ef-869f-574bbc71f8e3","Type":"ContainerStarted","Data":"8e17a8c9f9e02b1d69b9840e25a7737e8bff277098f224c03c648e07ff663464"} Nov 04 05:57:44.997457 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:44.997357 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-5sp6z" Nov 04 05:57:44.999412 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:44.999000 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n" event={"ID":"e9b6985d-f9ca-4957-b01c-41fd724dacbd","Type":"ContainerStarted","Data":"b81da03af73396804e2546fdd4160e9da7069346ac8196914110c638e2bd1a60"} Nov 04 05:57:44.999412 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:44.999118 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n" Nov 04 05:57:45.123042 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:45.122993 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-jvh5s" podStartSLOduration=1.844015613 podStartE2EDuration="5.122980248s" totalImagesPullingTime="3.278964635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:57:45.121934857 +0000 UTC m=+464.258631245" watchObservedRunningTime="2026-11-04 05:57:45.122980248 +0000 UTC m=+464.259676647" Nov 04 05:57:45.249175 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:45.249048 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n" podStartSLOduration=2.008893206 podStartE2EDuration="5.249034345s" totalImagesPullingTime="3.240141139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:57:45.24838786 +0000 UTC m=+464.385084258" watchObservedRunningTime="2026-11-04 05:57:45.249034345 +0000 UTC m=+464.385730742" Nov 04 05:57:45.409110 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:45.409030 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-5sp6z" podStartSLOduration=2.013426395 podStartE2EDuration="5.409018124s" totalImagesPullingTime="3.395591729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:57:45.407566049 +0000 UTC m=+464.544262474" watchObservedRunningTime="2026-11-04 05:57:45.409018124 +0000 UTC m=+464.545714553" Nov 04 05:57:45.418449 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:57:45.418417 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 05:57:46.006347 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:46.006313 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-j2scg" event={"ID":"ab61e4c5-9f11-4bf8-a885-bc10fdf4d3b1","Type":"ContainerStarted","Data":"fa4fb2b48d1d15c55d4ae0a54eae8fcdbae6152a6f1f90a2d18f4418614027a5"} Nov 04 05:57:46.006802 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:46.006451 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-j2scg" Nov 04 05:57:46.134082 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:46.134014 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-j2scg" podStartSLOduration=2.263426715 podStartE2EDuration="6.134001738s" totalImagesPullingTime="3.870575023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:57:46.133712405 +0000 UTC m=+465.270408826" watchObservedRunningTime="2026-11-04 05:57:46.134001738 +0000 UTC m=+465.270698135" Nov 04 05:57:51.513762 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:51.513728 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 05:57:56.010356 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:56.010330 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-jvh5s" Nov 04 05:57:57.014805 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:57:57.014781 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-j2scg" Nov 04 05:58:15.419223 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:58:15.419180 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 05:58:16.009234 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:58:16.009204 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n" Nov 04 05:58:16.012183 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:58:16.012161 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-5sp6z" Nov 04 05:58:45.417468 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:58:45.417434 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 05:59:02.776777 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:02.776744 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-ddvq8"] Nov 04 05:59:02.779141 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:02.779123 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-ddvq8" Nov 04 05:59:02.840755 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:02.840723 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-ddvq8"] Nov 04 05:59:02.885522 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:02.885488 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf5526b8-c8a9-44f4-8127-fd8d3c9ab780-cert\") pod \"llmisvc-controller-manager-6466c554d8-ddvq8\" (UID: \"bf5526b8-c8a9-44f4-8127-fd8d3c9ab780\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-ddvq8" Nov 04 05:59:02.885522 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:02.885525 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzp86\" (UniqueName: \"kubernetes.io/projected/bf5526b8-c8a9-44f4-8127-fd8d3c9ab780-kube-api-access-bzp86\") pod \"llmisvc-controller-manager-6466c554d8-ddvq8\" (UID: \"bf5526b8-c8a9-44f4-8127-fd8d3c9ab780\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-ddvq8" Nov 04 05:59:02.986598 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:02.986550 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf5526b8-c8a9-44f4-8127-fd8d3c9ab780-cert\") pod \"llmisvc-controller-manager-6466c554d8-ddvq8\" (UID: \"bf5526b8-c8a9-44f4-8127-fd8d3c9ab780\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-ddvq8" Nov 04 05:59:02.986598 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:02.986601 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzp86\" (UniqueName: \"kubernetes.io/projected/bf5526b8-c8a9-44f4-8127-fd8d3c9ab780-kube-api-access-bzp86\") pod \"llmisvc-controller-manager-6466c554d8-ddvq8\" (UID: \"bf5526b8-c8a9-44f4-8127-fd8d3c9ab780\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-ddvq8" Nov 04 05:59:02.989071 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:02.989039 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf5526b8-c8a9-44f4-8127-fd8d3c9ab780-cert\") pod \"llmisvc-controller-manager-6466c554d8-ddvq8\" (UID: \"bf5526b8-c8a9-44f4-8127-fd8d3c9ab780\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-ddvq8" Nov 04 05:59:03.057578 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:03.057499 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzp86\" (UniqueName: \"kubernetes.io/projected/bf5526b8-c8a9-44f4-8127-fd8d3c9ab780-kube-api-access-bzp86\") pod \"llmisvc-controller-manager-6466c554d8-ddvq8\" (UID: \"bf5526b8-c8a9-44f4-8127-fd8d3c9ab780\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-ddvq8" Nov 04 05:59:03.098302 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:03.098262 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-ddvq8" Nov 04 05:59:03.474836 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:03.474813 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-ddvq8"] Nov 04 05:59:03.477322 ip-10-0-134-45 kubenswrapper[5784]: W1104 05:59:03.477286 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf5526b8_c8a9_44f4_8127_fd8d3c9ab780.slice/crio-d6b787e2549da4dfc668b177b9c1e1b7ac42bf1fee957d1855a43c0c7f5f2488 WatchSource:0}: Error finding container d6b787e2549da4dfc668b177b9c1e1b7ac42bf1fee957d1855a43c0c7f5f2488: Status 404 returned error can't find the container with id d6b787e2549da4dfc668b177b9c1e1b7ac42bf1fee957d1855a43c0c7f5f2488 Nov 04 05:59:04.358849 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:04.358815 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-ddvq8" event={"ID":"bf5526b8-c8a9-44f4-8127-fd8d3c9ab780","Type":"ContainerStarted","Data":"99aab08a0570f00103cc3035a6d7ba3a0a268aba2014c7ff29dc57150be72749"} Nov 04 05:59:04.359281 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:04.358878 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-ddvq8" event={"ID":"bf5526b8-c8a9-44f4-8127-fd8d3c9ab780","Type":"ContainerStarted","Data":"d6b787e2549da4dfc668b177b9c1e1b7ac42bf1fee957d1855a43c0c7f5f2488"} Nov 04 05:59:04.359281 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:04.358906 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-ddvq8" Nov 04 05:59:04.486848 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:04.486798 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-ddvq8" podStartSLOduration=1.674481222 podStartE2EDuration="2.486783253s" totalImagesPullingTime="812.302031ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:59:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:59:04.485596894 +0000 UTC m=+543.622293294" watchObservedRunningTime="2026-11-04 05:59:04.486783253 +0000 UTC m=+543.623479651" Nov 04 05:59:15.419990 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:59:15.419869 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 05:59:35.366331 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:35.366296 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-ddvq8" Nov 04 05:59:35.552138 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:35.552105 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n"] Nov 04 05:59:35.552381 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:35.552352 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n" podUID="e9b6985d-f9ca-4957-b01c-41fd724dacbd" containerName="manager" containerID="cri-o://b81da03af73396804e2546fdd4160e9da7069346ac8196914110c638e2bd1a60" gracePeriod=30 Nov 04 05:59:35.797890 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:35.797864 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n" Nov 04 05:59:35.975285 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:35.975205 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e9b6985d-f9ca-4957-b01c-41fd724dacbd-kube-api-access-6zmzh\" (UniqueName: \"kubernetes.io/projected/e9b6985d-f9ca-4957-b01c-41fd724dacbd-kube-api-access-6zmzh\") pod \"e9b6985d-f9ca-4957-b01c-41fd724dacbd\" (UID: \"e9b6985d-f9ca-4957-b01c-41fd724dacbd\") " Nov 04 05:59:35.975435 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:35.975308 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e9b6985d-f9ca-4957-b01c-41fd724dacbd-cert\" (UniqueName: \"kubernetes.io/secret/e9b6985d-f9ca-4957-b01c-41fd724dacbd-cert\") pod \"e9b6985d-f9ca-4957-b01c-41fd724dacbd\" (UID: \"e9b6985d-f9ca-4957-b01c-41fd724dacbd\") " Nov 04 05:59:35.977356 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:35.977324 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9b6985d-f9ca-4957-b01c-41fd724dacbd-cert" pod "e9b6985d-f9ca-4957-b01c-41fd724dacbd" (UID: "e9b6985d-f9ca-4957-b01c-41fd724dacbd"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:59:35.977467 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:35.977405 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9b6985d-f9ca-4957-b01c-41fd724dacbd-kube-api-access-6zmzh" pod "e9b6985d-f9ca-4957-b01c-41fd724dacbd" (UID: "e9b6985d-f9ca-4957-b01c-41fd724dacbd"). InnerVolumeSpecName "kube-api-access-6zmzh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:59:36.076458 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:36.076429 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zmzh\" (UniqueName: \"kubernetes.io/projected/e9b6985d-f9ca-4957-b01c-41fd724dacbd-kube-api-access-6zmzh\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:59:36.076458 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:36.076453 5784 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9b6985d-f9ca-4957-b01c-41fd724dacbd-cert\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:59:36.509917 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:36.509884 5784 generic.go:356] "Generic (PLEG): container finished" podID="e9b6985d-f9ca-4957-b01c-41fd724dacbd" containerID="b81da03af73396804e2546fdd4160e9da7069346ac8196914110c638e2bd1a60" exitCode=0 Nov 04 05:59:36.510344 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:36.509928 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n" Nov 04 05:59:36.510344 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:36.509943 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n" event={"ID":"e9b6985d-f9ca-4957-b01c-41fd724dacbd","Type":"ContainerDied","Data":"b81da03af73396804e2546fdd4160e9da7069346ac8196914110c638e2bd1a60"} Nov 04 05:59:36.510344 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:36.509987 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n" event={"ID":"e9b6985d-f9ca-4957-b01c-41fd724dacbd","Type":"ContainerDied","Data":"d76dc1f27f2dc4ccc23f3b7c3820dac0ac0c1e859d78dae9758af846b1f112d7"} Nov 04 05:59:36.510344 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:36.510007 5784 scope.go:122] "RemoveContainer" containerID="b81da03af73396804e2546fdd4160e9da7069346ac8196914110c638e2bd1a60" Nov 04 05:59:36.519273 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:36.519256 5784 scope.go:122] "RemoveContainer" containerID="b81da03af73396804e2546fdd4160e9da7069346ac8196914110c638e2bd1a60" Nov 04 05:59:36.519566 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:59:36.519547 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b81da03af73396804e2546fdd4160e9da7069346ac8196914110c638e2bd1a60\": container with ID starting with b81da03af73396804e2546fdd4160e9da7069346ac8196914110c638e2bd1a60 not found: ID does not exist" containerID="b81da03af73396804e2546fdd4160e9da7069346ac8196914110c638e2bd1a60" Nov 04 05:59:36.519613 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:36.519575 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b81da03af73396804e2546fdd4160e9da7069346ac8196914110c638e2bd1a60"} err="failed to get container status \"b81da03af73396804e2546fdd4160e9da7069346ac8196914110c638e2bd1a60\": rpc error: code = NotFound desc = could not find container \"b81da03af73396804e2546fdd4160e9da7069346ac8196914110c638e2bd1a60\": container with ID starting with b81da03af73396804e2546fdd4160e9da7069346ac8196914110c638e2bd1a60 not found: ID does not exist" Nov 04 05:59:36.690622 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:36.690588 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n"] Nov 04 05:59:36.694979 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:36.694955 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-cz48n"] Nov 04 05:59:37.014413 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:37.014384 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e9b6985d-f9ca-4957-b01c-41fd724dacbd" path="/var/lib/kubelet/pods/e9b6985d-f9ca-4957-b01c-41fd724dacbd/volumes" Nov 04 05:59:40.532014 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:40.531979 5784 generic.go:356] "Generic (PLEG): container finished" podID="3a430fb7-e8ae-4f64-8f57-e5ea2b808725" containerID="c070aab727e08f06150b70400fba7b01f75a41e1005f58d5f465342d23274118" exitCode=1 Nov 04 05:59:40.532427 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:40.532028 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6684d95577-2m9xk" event={"ID":"3a430fb7-e8ae-4f64-8f57-e5ea2b808725","Type":"ContainerDied","Data":"c070aab727e08f06150b70400fba7b01f75a41e1005f58d5f465342d23274118"} Nov 04 05:59:40.532470 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:40.532428 5784 scope.go:122] "RemoveContainer" containerID="c070aab727e08f06150b70400fba7b01f75a41e1005f58d5f465342d23274118" Nov 04 05:59:42.542948 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:42.542914 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6684d95577-2m9xk" event={"ID":"3a430fb7-e8ae-4f64-8f57-e5ea2b808725","Type":"ContainerStarted","Data":"54288469650a9e9096e8142e0832dfd7e6dcfa7c4c811c1f3b172de80b8f344e"} Nov 04 05:59:42.543331 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:42.543276 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6684d95577-2m9xk" Nov 04 05:59:45.418258 ip-10-0-134-45 kubenswrapper[5784]: E1104 05:59:45.418211 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 05:59:53.549911 ip-10-0-134-45 kubenswrapper[5784]: I1104 05:59:53.549882 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6684d95577-2m9xk" Nov 04 06:00:00.768842 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:00.768808 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:00:01.066433 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:01.066405 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvgv2_206b2e75-0735-49df-a53c-bdd17aab8ae6/ovn-acl-logging/0.log" Nov 04 06:00:01.067669 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:01.067650 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvgv2_206b2e75-0735-49df-a53c-bdd17aab8ae6/ovn-acl-logging/0.log" Nov 04 06:00:12.990322 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:12.990288 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:00:15.417787 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:00:15.417748 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:00:25.240828 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.240794 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9"] Nov 04 06:00:25.241351 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.241266 5784 cpu_manager.go:414] "containerMap: removing container" podUID="e9b6985d-f9ca-4957-b01c-41fd724dacbd" containerName="manager" Nov 04 06:00:25.241351 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.241283 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e9b6985d-f9ca-4957-b01c-41fd724dacbd" containerName="manager" Nov 04 06:00:25.241441 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.241373 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="e9b6985d-f9ca-4957-b01c-41fd724dacbd" containerName="manager" Nov 04 06:00:25.244765 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.244746 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.360904 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.360870 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9"] Nov 04 06:00:25.400010 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.399969 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Nov 04 06:00:25.400010 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.399996 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-kfq2b\"" Nov 04 06:00:25.418547 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.418519 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.418674 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.418595 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.418674 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.418660 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.418750 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.418701 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.418750 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.418724 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.418858 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.418838 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/969cda36-4b05-4d9b-b695-e3ea82cad956-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.418892 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.418874 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.418966 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.418902 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cdtw\" (UniqueName: \"kubernetes.io/projected/969cda36-4b05-4d9b-b695-e3ea82cad956-kube-api-access-4cdtw\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.418966 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.418937 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.520405 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.520315 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.520405 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.520356 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.520405 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.520393 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.520701 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.520418 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.520701 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.520464 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/969cda36-4b05-4d9b-b695-e3ea82cad956-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.520701 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.520498 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.520701 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.520536 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cdtw\" (UniqueName: \"kubernetes.io/projected/969cda36-4b05-4d9b-b695-e3ea82cad956-kube-api-access-4cdtw\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.520929 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.520700 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.520929 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.520765 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.520929 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.520788 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.521111 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.520963 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.521175 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.521105 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.521220 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.521166 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.521220 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.521210 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/969cda36-4b05-4d9b-b695-e3ea82cad956-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.522718 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.522699 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.522860 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.522843 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.587504 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.587478 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.587672 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.587542 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cdtw\" (UniqueName: \"kubernetes.io/projected/969cda36-4b05-4d9b-b695-e3ea82cad956-kube-api-access-4cdtw\") pod \"maas-default-gateway-openshift-default-6886b96f9-gs6m9\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:25.857690 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:25.857653 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:26.293404 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:26.293342 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9"] Nov 04 06:00:26.297742 ip-10-0-134-45 kubenswrapper[5784]: W1104 06:00:26.297708 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod969cda36_4b05_4d9b_b695_e3ea82cad956.slice/crio-21fb368d541c2791833b99445f0fe1f6aa0207c9ec25ed18dbc68c9c40519062 WatchSource:0}: Error finding container 21fb368d541c2791833b99445f0fe1f6aa0207c9ec25ed18dbc68c9c40519062: Status 404 returned error can't find the container with id 21fb368d541c2791833b99445f0fe1f6aa0207c9ec25ed18dbc68c9c40519062 Nov 04 06:00:26.299657 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:26.299634 5784 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 06:00:26.749903 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:26.749861 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" event={"ID":"969cda36-4b05-4d9b-b695-e3ea82cad956","Type":"ContainerStarted","Data":"21fb368d541c2791833b99445f0fe1f6aa0207c9ec25ed18dbc68c9c40519062"} Nov 04 06:00:29.300425 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:29.299717 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:00:31.016613 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:31.016574 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:00:31.017014 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:31.016660 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:00:31.017014 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:31.016711 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:00:31.781600 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:31.781563 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" event={"ID":"969cda36-4b05-4d9b-b695-e3ea82cad956","Type":"ContainerStarted","Data":"cd6b0b87ae0e5dbfeb35771dcfb9f9cf3f102406f748fb45223d59a9288ab897"} Nov 04 06:00:31.867087 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:31.861180 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:32.875224 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:32.875177 5784 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-gs6m9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Nov 04 06:00:32.875618 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:32.875245 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" podUID="969cda36-4b05-4d9b-b695-e3ea82cad956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Nov 04 06:00:33.858913 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:33.858479 5784 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-gs6m9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Nov 04 06:00:33.858913 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:33.858538 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" podUID="969cda36-4b05-4d9b-b695-e3ea82cad956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Nov 04 06:00:34.858533 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:34.858497 5784 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-gs6m9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Nov 04 06:00:34.859115 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:34.859085 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" podUID="969cda36-4b05-4d9b-b695-e3ea82cad956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Nov 04 06:00:35.870088 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:35.866498 5784 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-gs6m9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Nov 04 06:00:35.870088 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:35.866573 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" podUID="969cda36-4b05-4d9b-b695-e3ea82cad956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Nov 04 06:00:36.871087 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:36.870467 5784 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-gs6m9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Nov 04 06:00:36.871087 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:36.870529 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" podUID="969cda36-4b05-4d9b-b695-e3ea82cad956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Nov 04 06:00:37.858591 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:37.858554 5784 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-gs6m9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Nov 04 06:00:37.858778 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:37.858610 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" podUID="969cda36-4b05-4d9b-b695-e3ea82cad956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Nov 04 06:00:39.374882 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:39.374842 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:39.375326 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:39.375174 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:39.376011 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:39.375990 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:00:39.563912 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:39.563857 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" podStartSLOduration=9.848210223 podStartE2EDuration="14.563843804s" totalImagesPullingTime="4.715633581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:00:31.972096009 +0000 UTC m=+631.108792409" watchObservedRunningTime="2026-11-04 06:00:39.563843804 +0000 UTC m=+638.700540202" Nov 04 06:00:42.000121 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:42.000080 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:00:45.418922 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:00:45.418888 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:00:55.494515 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.494463 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm"] Nov 04 06:00:55.498531 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.498507 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.599727 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.599690 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm"] Nov 04 06:00:55.605870 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.605841 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.606025 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.605874 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.606025 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.605901 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.606121 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.606053 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7x8f\" (UniqueName: \"kubernetes.io/projected/30ac0e57-a72e-410c-ac43-6ddbc262930c-kube-api-access-w7x8f\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.606162 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.606133 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.606162 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.606157 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30ac0e57-a72e-410c-ac43-6ddbc262930c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.606225 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.606184 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.606258 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.606246 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.606465 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.606439 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.707699 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.707660 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7x8f\" (UniqueName: \"kubernetes.io/projected/30ac0e57-a72e-410c-ac43-6ddbc262930c-kube-api-access-w7x8f\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.707699 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.707707 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.707970 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.707736 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30ac0e57-a72e-410c-ac43-6ddbc262930c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.707970 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.707762 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.707970 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.707790 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.707970 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.707866 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.707970 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.707901 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.708293 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.707981 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.708293 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.708038 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.708410 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.708342 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.708467 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.708436 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.708515 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.708472 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.708551 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.708534 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.708587 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.708550 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30ac0e57-a72e-410c-ac43-6ddbc262930c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.710221 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.710191 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.710396 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.710376 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.774846 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.774771 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.774999 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.774974 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7x8f\" (UniqueName: \"kubernetes.io/projected/30ac0e57-a72e-410c-ac43-6ddbc262930c-kube-api-access-w7x8f\") pod \"maas-default-gateway-openshift-default-6886b96f9-79hwm\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:55.813422 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:55.813384 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:56.247197 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:56.247164 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm"] Nov 04 06:00:56.250187 ip-10-0-134-45 kubenswrapper[5784]: W1104 06:00:56.250158 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ac0e57_a72e_410c_ac43_6ddbc262930c.slice/crio-381ded715e8673db287ff2c32144a77b059e4bbd52da0567927fcb6817486ab9 WatchSource:0}: Error finding container 381ded715e8673db287ff2c32144a77b059e4bbd52da0567927fcb6817486ab9: Status 404 returned error can't find the container with id 381ded715e8673db287ff2c32144a77b059e4bbd52da0567927fcb6817486ab9 Nov 04 06:00:56.252360 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:56.252333 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:00:56.252425 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:56.252390 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:00:56.252425 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:56.252419 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:00:56.908000 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:56.907961 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" event={"ID":"30ac0e57-a72e-410c-ac43-6ddbc262930c","Type":"ContainerStarted","Data":"340eefbea674c13416e2f54832936ec3bc43d46f321a615d46e116c1bdd78693"} Nov 04 06:00:56.908459 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:56.908016 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" event={"ID":"30ac0e57-a72e-410c-ac43-6ddbc262930c","Type":"ContainerStarted","Data":"381ded715e8673db287ff2c32144a77b059e4bbd52da0567927fcb6817486ab9"} Nov 04 06:00:57.174145 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:57.173143 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" podStartSLOduration=2.173121606 podStartE2EDuration="2.173121606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:00:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:00:57.103621016 +0000 UTC m=+656.240317415" watchObservedRunningTime="2026-11-04 06:00:57.173121606 +0000 UTC m=+656.309818003" Nov 04 06:00:57.813755 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:57.813713 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:00:57.814993 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:57.814961 5784 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-79hwm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Nov 04 06:00:57.815158 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:57.815023 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" podUID="30ac0e57-a72e-410c-ac43-6ddbc262930c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Nov 04 06:00:58.814526 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:58.814491 5784 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-79hwm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Nov 04 06:00:58.814930 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:58.814544 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" podUID="30ac0e57-a72e-410c-ac43-6ddbc262930c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Nov 04 06:00:59.813825 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:59.813783 5784 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-79hwm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Nov 04 06:00:59.813983 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:00:59.813847 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" podUID="30ac0e57-a72e-410c-ac43-6ddbc262930c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Nov 04 06:01:00.814277 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:01:00.814237 5784 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-79hwm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Nov 04 06:01:00.814688 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:01:00.814292 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" podUID="30ac0e57-a72e-410c-ac43-6ddbc262930c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Nov 04 06:01:01.814796 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:01:01.814753 5784 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-79hwm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Nov 04 06:01:01.815292 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:01:01.814822 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" podUID="30ac0e57-a72e-410c-ac43-6ddbc262930c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Nov 04 06:01:02.813850 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:01:02.813813 5784 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-79hwm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Nov 04 06:01:02.814027 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:01:02.813882 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" podUID="30ac0e57-a72e-410c-ac43-6ddbc262930c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Nov 04 06:01:03.814281 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:01:03.814240 5784 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-79hwm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Nov 04 06:01:03.814770 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:01:03.814312 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" podUID="30ac0e57-a72e-410c-ac43-6ddbc262930c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Nov 04 06:01:04.874873 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:01:04.874837 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:01:04.875398 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:01:04.875294 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:01:04.876121 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:01:04.876091 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:01:15.422448 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:01:15.422407 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:01:45.418488 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:01:45.418448 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:02:15.418574 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:02:15.418492 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:02:37.376810 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:37.376765 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:02:45.418866 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:02:45.418829 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:02:47.172846 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:47.172811 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:02:55.976844 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:55.976807 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889"] Nov 04 06:02:55.980573 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:55.980553 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" Nov 04 06:02:56.096246 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:56.096201 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 04 06:02:56.096427 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:56.096283 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w6-18990c-serving-cert\"" Nov 04 06:02:56.096427 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:56.096355 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 04 06:02:56.096427 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:56.096388 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sw66w\"" Nov 04 06:02:56.096549 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:56.096438 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Nov 04 06:02:56.097734 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:56.097713 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889"] Nov 04 06:02:56.102781 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:56.102763 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/795b3a01-e94b-410a-816a-c040f4ec86e8-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-18990c-6755674b87-pn889\" (UID: \"795b3a01-e94b-410a-816a-c040f4ec86e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" Nov 04 06:02:56.102856 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:56.102809 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twszf\" (UniqueName: \"kubernetes.io/projected/795b3a01-e94b-410a-816a-c040f4ec86e8-kube-api-access-twszf\") pod \"maas-api-e2e-worker-w6-18990c-6755674b87-pn889\" (UID: \"795b3a01-e94b-410a-816a-c040f4ec86e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" Nov 04 06:02:56.102921 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:56.102907 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/795b3a01-e94b-410a-816a-c040f4ec86e8-maas-api-tls\") pod \"maas-api-e2e-worker-w6-18990c-6755674b87-pn889\" (UID: \"795b3a01-e94b-410a-816a-c040f4ec86e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" Nov 04 06:02:56.102990 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:56.102976 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/795b3a01-e94b-410a-816a-c040f4ec86e8-metrics-certs\") pod \"maas-api-e2e-worker-w6-18990c-6755674b87-pn889\" (UID: \"795b3a01-e94b-410a-816a-c040f4ec86e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" Nov 04 06:02:56.203995 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:56.203957 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/795b3a01-e94b-410a-816a-c040f4ec86e8-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-18990c-6755674b87-pn889\" (UID: \"795b3a01-e94b-410a-816a-c040f4ec86e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" Nov 04 06:02:56.204196 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:56.204023 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twszf\" (UniqueName: \"kubernetes.io/projected/795b3a01-e94b-410a-816a-c040f4ec86e8-kube-api-access-twszf\") pod \"maas-api-e2e-worker-w6-18990c-6755674b87-pn889\" (UID: \"795b3a01-e94b-410a-816a-c040f4ec86e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" Nov 04 06:02:56.204267 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:56.204196 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/795b3a01-e94b-410a-816a-c040f4ec86e8-maas-api-tls\") pod \"maas-api-e2e-worker-w6-18990c-6755674b87-pn889\" (UID: \"795b3a01-e94b-410a-816a-c040f4ec86e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" Nov 04 06:02:56.204326 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:56.204291 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/795b3a01-e94b-410a-816a-c040f4ec86e8-metrics-certs\") pod \"maas-api-e2e-worker-w6-18990c-6755674b87-pn889\" (UID: \"795b3a01-e94b-410a-816a-c040f4ec86e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" Nov 04 06:02:56.204375 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:02:56.204332 5784 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-serving-cert: secret "maas-api-e2e-worker-w6-18990c-serving-cert" not found Nov 04 06:02:56.204428 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:02:56.204417 5784 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/795b3a01-e94b-410a-816a-c040f4ec86e8-maas-api-tls podName:795b3a01-e94b-410a-816a-c040f4ec86e8 nodeName:}" failed. No retries permitted until 2026-11-04 06:02:56.704395427 +0000 UTC m=+775.841091828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/795b3a01-e94b-410a-816a-c040f4ec86e8-maas-api-tls") pod "maas-api-e2e-worker-w6-18990c-6755674b87-pn889" (UID: "795b3a01-e94b-410a-816a-c040f4ec86e8") : secret "maas-api-e2e-worker-w6-18990c-serving-cert" not found Nov 04 06:02:56.204777 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:56.204745 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/795b3a01-e94b-410a-816a-c040f4ec86e8-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-18990c-6755674b87-pn889\" (UID: \"795b3a01-e94b-410a-816a-c040f4ec86e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" Nov 04 06:02:56.206624 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:56.206605 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/795b3a01-e94b-410a-816a-c040f4ec86e8-metrics-certs\") pod \"maas-api-e2e-worker-w6-18990c-6755674b87-pn889\" (UID: \"795b3a01-e94b-410a-816a-c040f4ec86e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" Nov 04 06:02:56.271634 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:56.271557 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twszf\" (UniqueName: \"kubernetes.io/projected/795b3a01-e94b-410a-816a-c040f4ec86e8-kube-api-access-twszf\") pod \"maas-api-e2e-worker-w6-18990c-6755674b87-pn889\" (UID: \"795b3a01-e94b-410a-816a-c040f4ec86e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" Nov 04 06:02:56.709739 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:56.709696 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/795b3a01-e94b-410a-816a-c040f4ec86e8-maas-api-tls\") pod \"maas-api-e2e-worker-w6-18990c-6755674b87-pn889\" (UID: \"795b3a01-e94b-410a-816a-c040f4ec86e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" Nov 04 06:02:56.712334 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:56.712306 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/795b3a01-e94b-410a-816a-c040f4ec86e8-maas-api-tls\") pod \"maas-api-e2e-worker-w6-18990c-6755674b87-pn889\" (UID: \"795b3a01-e94b-410a-816a-c040f4ec86e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" Nov 04 06:02:56.893470 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:56.893430 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" Nov 04 06:02:57.276281 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:57.276255 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889"] Nov 04 06:02:57.278484 ip-10-0-134-45 kubenswrapper[5784]: W1104 06:02:57.278451 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod795b3a01_e94b_410a_816a_c040f4ec86e8.slice/crio-8b18d0fdeaac9c5b011ae3443b5a8aff893829e1c25aac04c48e941815fdf04e WatchSource:0}: Error finding container 8b18d0fdeaac9c5b011ae3443b5a8aff893829e1c25aac04c48e941815fdf04e: Status 404 returned error can't find the container with id 8b18d0fdeaac9c5b011ae3443b5a8aff893829e1c25aac04c48e941815fdf04e Nov 04 06:02:57.504904 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:57.504863 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" event={"ID":"795b3a01-e94b-410a-816a-c040f4ec86e8","Type":"ContainerStarted","Data":"8b18d0fdeaac9c5b011ae3443b5a8aff893829e1c25aac04c48e941815fdf04e"} Nov 04 06:02:57.802959 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:57.802926 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq"] Nov 04 06:02:57.807872 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:57.807845 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:57.920725 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:57.920687 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:57.920939 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:57.920745 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztscf\" (UniqueName: \"kubernetes.io/projected/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-kube-api-access-ztscf\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:57.920939 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:57.920891 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:57.920939 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:57.920922 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:57.921111 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:57.920956 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:57.921111 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:57.921097 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:57.921187 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:57.921131 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:57.921227 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:57.921193 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:57.921270 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:57.921252 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:57.928680 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:57.928658 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq"] Nov 04 06:02:57.939859 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:57.939840 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-f38f69-openshift-default-dockercfg-4859w\"" Nov 04 06:02:58.022571 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:58.022530 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:58.022571 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:58.022570 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:58.022844 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:58.022603 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:58.022844 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:58.022642 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:58.022844 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:58.022662 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:58.022844 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:58.022697 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:58.022844 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:58.022732 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:58.022844 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:58.022760 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:58.022844 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:58.022802 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztscf\" (UniqueName: \"kubernetes.io/projected/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-kube-api-access-ztscf\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:58.023623 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:58.023169 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:58.023623 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:58.023592 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:58.023862 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:58.023836 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:58.023934 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:58.023919 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:58.024136 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:58.024116 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:58.025180 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:58.025158 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:58.025486 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:58.025469 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:58.089504 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:58.089465 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztscf\" (UniqueName: \"kubernetes.io/projected/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-kube-api-access-ztscf\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:58.089504 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:58.089467 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:58.121401 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:58.121366 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:02:58.560010 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:58.559986 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq"] Nov 04 06:02:58.562454 ip-10-0-134-45 kubenswrapper[5784]: W1104 06:02:58.562426 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2a3b0d0_9798_4e82_99ae_a199e50fe6e8.slice/crio-f7900615b442937feb8be9eef6980289fbc49461ba39955387c1c85c865b1ffc WatchSource:0}: Error finding container f7900615b442937feb8be9eef6980289fbc49461ba39955387c1c85c865b1ffc: Status 404 returned error can't find the container with id f7900615b442937feb8be9eef6980289fbc49461ba39955387c1c85c865b1ffc Nov 04 06:02:58.565663 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:58.565628 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:02:58.565742 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:58.565711 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:02:58.565788 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:58.565752 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:02:59.516926 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:59.516820 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" event={"ID":"795b3a01-e94b-410a-816a-c040f4ec86e8","Type":"ContainerStarted","Data":"1d6c667bd4aec4171227cea29fb77ba624e4e70e7659b7dfe5ad7acf8b4103e5"} Nov 04 06:02:59.516926 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:59.516893 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" Nov 04 06:02:59.519222 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:59.519195 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" event={"ID":"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8","Type":"ContainerStarted","Data":"acb6155500d6757504d5133daa1af97d9ae601cecfa1ba87aaa26282f52d5d1d"} Nov 04 06:02:59.519343 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:59.519244 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" event={"ID":"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8","Type":"ContainerStarted","Data":"f7900615b442937feb8be9eef6980289fbc49461ba39955387c1c85c865b1ffc"} Nov 04 06:02:59.531292 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:59.531268 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:02:59.647371 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:59.647318 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" podStartSLOduration=2.740243066 podStartE2EDuration="4.647302048s" totalImagesPullingTime="1.907058982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:59.646245977 +0000 UTC m=+778.782942376" watchObservedRunningTime="2026-11-04 06:02:59.647302048 +0000 UTC m=+778.783998447" Nov 04 06:02:59.780143 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:02:59.778869 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" podStartSLOduration=2.778849384 podStartE2EDuration="2.778849384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:02:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:02:59.777842766 +0000 UTC m=+778.914539169" watchObservedRunningTime="2026-11-04 06:02:59.778849384 +0000 UTC m=+778.915545783" Nov 04 06:03:00.122381 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:00.122349 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:03:00.123379 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:00.123353 5784 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Nov 04 06:03:00.123512 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:00.123398 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" podUID="b2a3b0d0-9798-4e82-99ae-a199e50fe6e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Nov 04 06:03:01.121788 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:01.121756 5784 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Nov 04 06:03:01.122254 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:01.121807 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" podUID="b2a3b0d0-9798-4e82-99ae-a199e50fe6e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Nov 04 06:03:01.598076 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:01.598037 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n"] Nov 04 06:03:01.602033 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:01.602009 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" Nov 04 06:03:01.732213 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:01.732180 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-356418-serving-cert\"" Nov 04 06:03:01.733789 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:01.733761 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n"] Nov 04 06:03:01.783712 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:01.783678 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n\" (UID: \"3041ac2c-1f12-4e2c-b8fc-a387938b7ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" Nov 04 06:03:01.783712 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:01.783715 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-metrics-certs\") pod \"maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n\" (UID: \"3041ac2c-1f12-4e2c-b8fc-a387938b7ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" Nov 04 06:03:01.783934 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:01.783795 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfgqv\" (UniqueName: \"kubernetes.io/projected/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-kube-api-access-gfgqv\") pod \"maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n\" (UID: \"3041ac2c-1f12-4e2c-b8fc-a387938b7ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" Nov 04 06:03:01.783934 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:01.783835 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-maas-api-tls\") pod \"maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n\" (UID: \"3041ac2c-1f12-4e2c-b8fc-a387938b7ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" Nov 04 06:03:01.884804 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:01.884705 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n\" (UID: \"3041ac2c-1f12-4e2c-b8fc-a387938b7ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" Nov 04 06:03:01.884804 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:01.884756 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-metrics-certs\") pod \"maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n\" (UID: \"3041ac2c-1f12-4e2c-b8fc-a387938b7ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" Nov 04 06:03:01.884804 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:01.884797 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfgqv\" (UniqueName: \"kubernetes.io/projected/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-kube-api-access-gfgqv\") pod \"maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n\" (UID: \"3041ac2c-1f12-4e2c-b8fc-a387938b7ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" Nov 04 06:03:01.885155 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:01.884841 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-maas-api-tls\") pod \"maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n\" (UID: \"3041ac2c-1f12-4e2c-b8fc-a387938b7ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" Nov 04 06:03:01.885155 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:03:01.884971 5784 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-serving-cert: secret "maas-api-e2e-worker-w1-356418-serving-cert" not found Nov 04 06:03:01.885155 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:03:01.885046 5784 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-maas-api-tls podName:3041ac2c-1f12-4e2c-b8fc-a387938b7ead nodeName:}" failed. No retries permitted until 2026-11-04 06:03:02.385023768 +0000 UTC m=+781.521720149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-maas-api-tls") pod "maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" (UID: "3041ac2c-1f12-4e2c-b8fc-a387938b7ead") : secret "maas-api-e2e-worker-w1-356418-serving-cert" not found Nov 04 06:03:01.885473 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:01.885451 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n\" (UID: \"3041ac2c-1f12-4e2c-b8fc-a387938b7ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" Nov 04 06:03:01.887312 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:01.887286 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-metrics-certs\") pod \"maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n\" (UID: \"3041ac2c-1f12-4e2c-b8fc-a387938b7ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" Nov 04 06:03:01.976687 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:01.976650 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfgqv\" (UniqueName: \"kubernetes.io/projected/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-kube-api-access-gfgqv\") pod \"maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n\" (UID: \"3041ac2c-1f12-4e2c-b8fc-a387938b7ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" Nov 04 06:03:02.122724 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:02.122689 5784 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Nov 04 06:03:02.123149 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:02.122743 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" podUID="b2a3b0d0-9798-4e82-99ae-a199e50fe6e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Nov 04 06:03:02.390154 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:02.390113 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-maas-api-tls\") pod \"maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n\" (UID: \"3041ac2c-1f12-4e2c-b8fc-a387938b7ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" Nov 04 06:03:02.392695 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:02.392667 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-maas-api-tls\") pod \"maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n\" (UID: \"3041ac2c-1f12-4e2c-b8fc-a387938b7ead\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" Nov 04 06:03:02.515218 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:02.515174 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" Nov 04 06:03:02.923275 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:02.923248 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n"] Nov 04 06:03:02.925677 ip-10-0-134-45 kubenswrapper[5784]: W1104 06:03:02.925646 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3041ac2c_1f12_4e2c_b8fc_a387938b7ead.slice/crio-fbb442056f9f3cd190ece747db3835782b07ded5f5a6b2134614b23451eb0caa WatchSource:0}: Error finding container fbb442056f9f3cd190ece747db3835782b07ded5f5a6b2134614b23451eb0caa: Status 404 returned error can't find the container with id fbb442056f9f3cd190ece747db3835782b07ded5f5a6b2134614b23451eb0caa Nov 04 06:03:03.122638 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:03.122591 5784 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Nov 04 06:03:03.122819 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:03.122655 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" podUID="b2a3b0d0-9798-4e82-99ae-a199e50fe6e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Nov 04 06:03:03.544291 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:03.544257 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" event={"ID":"3041ac2c-1f12-4e2c-b8fc-a387938b7ead","Type":"ContainerStarted","Data":"fbb442056f9f3cd190ece747db3835782b07ded5f5a6b2134614b23451eb0caa"} Nov 04 06:03:04.122007 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:04.121973 5784 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Nov 04 06:03:04.122208 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:04.122023 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" podUID="b2a3b0d0-9798-4e82-99ae-a199e50fe6e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Nov 04 06:03:04.561145 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:04.551200 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" event={"ID":"3041ac2c-1f12-4e2c-b8fc-a387938b7ead","Type":"ContainerStarted","Data":"ce305d04da4131c01859198fc0eb0133bfefa63682f6cb1f7ec7bf9dc176cc60"} Nov 04 06:03:04.562636 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:04.562607 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" Nov 04 06:03:04.692622 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:04.692570 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" podStartSLOduration=2.806618988 podStartE2EDuration="3.692553235s" totalImagesPullingTime="885.934247ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:03:04.691036352 +0000 UTC m=+783.827732752" watchObservedRunningTime="2026-11-04 06:03:04.692553235 +0000 UTC m=+783.829249635" Nov 04 06:03:05.126005 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:05.125974 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:03:05.126392 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:05.126370 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:03:05.127139 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:05.127118 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:03:05.531162 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:05.531089 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" Nov 04 06:03:11.565922 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:11.565889 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" Nov 04 06:03:11.681501 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:11.681469 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:03:12.434874 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:12.434839 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7"] Nov 04 06:03:12.438737 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:12.438714 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" Nov 04 06:03:12.488643 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:12.488616 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7\" (UID: \"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" Nov 04 06:03:12.488775 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:12.488686 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trfl7\" (UniqueName: \"kubernetes.io/projected/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-kube-api-access-trfl7\") pod \"maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7\" (UID: \"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" Nov 04 06:03:12.488814 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:12.488787 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-maas-api-tls\") pod \"maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7\" (UID: \"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" Nov 04 06:03:12.488849 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:12.488817 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-metrics-certs\") pod \"maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7\" (UID: \"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" Nov 04 06:03:12.554001 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:12.553968 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-6b62c0-serving-cert\"" Nov 04 06:03:12.555589 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:12.555568 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7"] Nov 04 06:03:12.589580 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:12.589544 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7\" (UID: \"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" Nov 04 06:03:12.589963 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:12.589690 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trfl7\" (UniqueName: \"kubernetes.io/projected/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-kube-api-access-trfl7\") pod \"maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7\" (UID: \"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" Nov 04 06:03:12.589963 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:12.589767 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-maas-api-tls\") pod \"maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7\" (UID: \"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" Nov 04 06:03:12.589963 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:12.589795 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-metrics-certs\") pod \"maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7\" (UID: \"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" Nov 04 06:03:12.589963 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:03:12.589921 5784 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-serving-cert: secret "maas-api-e2e-worker-w5-6b62c0-serving-cert" not found Nov 04 06:03:12.590153 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:03:12.590003 5784 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-maas-api-tls podName:a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4 nodeName:}" failed. No retries permitted until 2026-11-04 06:03:13.089982815 +0000 UTC m=+792.226679194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-maas-api-tls") pod "maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" (UID: "a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4") : secret "maas-api-e2e-worker-w5-6b62c0-serving-cert" not found Nov 04 06:03:12.590276 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:12.590257 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7\" (UID: \"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" Nov 04 06:03:12.592253 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:12.592233 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-metrics-certs\") pod \"maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7\" (UID: \"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" Nov 04 06:03:12.656764 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:12.656729 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trfl7\" (UniqueName: \"kubernetes.io/projected/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-kube-api-access-trfl7\") pod \"maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7\" (UID: \"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" Nov 04 06:03:13.095673 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:13.095638 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-maas-api-tls\") pod \"maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7\" (UID: \"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" Nov 04 06:03:13.098343 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:13.098316 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-maas-api-tls\") pod \"maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7\" (UID: \"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" Nov 04 06:03:13.352040 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:13.351953 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" Nov 04 06:03:13.732731 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:13.732703 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7"] Nov 04 06:03:13.734462 ip-10-0-134-45 kubenswrapper[5784]: W1104 06:03:13.734429 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda23da9f7_5ec2_4c17_ab34_ee9d303f2ee4.slice/crio-6c47ebecc8fa56ec28e7f8681d5e1b1be0ec66bcd05c69c363cfd2dcc7bcca7e WatchSource:0}: Error finding container 6c47ebecc8fa56ec28e7f8681d5e1b1be0ec66bcd05c69c363cfd2dcc7bcca7e: Status 404 returned error can't find the container with id 6c47ebecc8fa56ec28e7f8681d5e1b1be0ec66bcd05c69c363cfd2dcc7bcca7e Nov 04 06:03:14.598380 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:14.598342 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" event={"ID":"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4","Type":"ContainerStarted","Data":"6c47ebecc8fa56ec28e7f8681d5e1b1be0ec66bcd05c69c363cfd2dcc7bcca7e"} Nov 04 06:03:15.417818 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:03:15.417783 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:03:15.605097 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:15.605051 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" event={"ID":"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4","Type":"ContainerStarted","Data":"625f49b83740e6a1fd7dbc16d0dee6985d529f716143df6416e6d3035a56213d"} Nov 04 06:03:15.605294 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:15.605194 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" Nov 04 06:03:15.734713 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:15.734615 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" podStartSLOduration=2.858798788 podStartE2EDuration="3.734593521s" totalImagesPullingTime="875.794733ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:03:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:03:15.733597845 +0000 UTC m=+794.870294243" watchObservedRunningTime="2026-11-04 06:03:15.734593521 +0000 UTC m=+794.871289919" Nov 04 06:03:20.913550 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:20.913513 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75"] Nov 04 06:03:20.917487 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:20.917467 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:20.977479 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:20.977449 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75"] Nov 04 06:03:20.981437 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:20.981413 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-model-cache\") pod \"simulator-w4-856c68-kserve-c9d965b45-phb75\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:20.981575 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:20.981455 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dba3c05a-be4e-49c8-b02e-f7024af3da05-tls-certs\") pod \"simulator-w4-856c68-kserve-c9d965b45-phb75\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:20.981575 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:20.981481 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-home\") pod \"simulator-w4-856c68-kserve-c9d965b45-phb75\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:20.981704 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:20.981683 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-tmp-dir\") pod \"simulator-w4-856c68-kserve-c9d965b45-phb75\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:20.981758 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:20.981735 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5tfv\" (UniqueName: \"kubernetes.io/projected/dba3c05a-be4e-49c8-b02e-f7024af3da05-kube-api-access-q5tfv\") pod \"simulator-w4-856c68-kserve-c9d965b45-phb75\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:20.981857 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:20.981836 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-dshm\") pod \"simulator-w4-856c68-kserve-c9d965b45-phb75\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:21.031712 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:21.031682 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-856c68\"/\"kube-root-ca.crt\"" Nov 04 06:03:21.032663 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:21.032642 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-856c68\"/\"openshift-service-ca.crt\"" Nov 04 06:03:21.032903 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:21.032887 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-856c68\"/\"default-dockercfg-xtn25\"" Nov 04 06:03:21.032953 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:21.032899 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-856c68\"/\"simulator-w4-856c68-kserve-self-signed-certs\"" Nov 04 06:03:21.082771 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:21.082741 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-tmp-dir\") pod \"simulator-w4-856c68-kserve-c9d965b45-phb75\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:21.082941 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:21.082781 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5tfv\" (UniqueName: \"kubernetes.io/projected/dba3c05a-be4e-49c8-b02e-f7024af3da05-kube-api-access-q5tfv\") pod \"simulator-w4-856c68-kserve-c9d965b45-phb75\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:21.082941 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:21.082828 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-dshm\") pod \"simulator-w4-856c68-kserve-c9d965b45-phb75\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:21.082941 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:21.082874 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-model-cache\") pod \"simulator-w4-856c68-kserve-c9d965b45-phb75\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:21.083133 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:21.083002 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dba3c05a-be4e-49c8-b02e-f7024af3da05-tls-certs\") pod \"simulator-w4-856c68-kserve-c9d965b45-phb75\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:21.083133 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:21.083056 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-home\") pod \"simulator-w4-856c68-kserve-c9d965b45-phb75\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:21.083227 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:21.083208 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-tmp-dir\") pod \"simulator-w4-856c68-kserve-c9d965b45-phb75\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:21.083306 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:21.083276 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-model-cache\") pod \"simulator-w4-856c68-kserve-c9d965b45-phb75\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:21.083417 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:21.083372 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-home\") pod \"simulator-w4-856c68-kserve-c9d965b45-phb75\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:21.085096 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:21.085056 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-dshm\") pod \"simulator-w4-856c68-kserve-c9d965b45-phb75\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:21.085363 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:21.085347 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dba3c05a-be4e-49c8-b02e-f7024af3da05-tls-certs\") pod \"simulator-w4-856c68-kserve-c9d965b45-phb75\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:21.151862 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:21.151830 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5tfv\" (UniqueName: \"kubernetes.io/projected/dba3c05a-be4e-49c8-b02e-f7024af3da05-kube-api-access-q5tfv\") pod \"simulator-w4-856c68-kserve-c9d965b45-phb75\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:21.229307 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:21.229227 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:21.616145 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:21.616111 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" Nov 04 06:03:21.617283 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:21.617260 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75"] Nov 04 06:03:21.619244 ip-10-0-134-45 kubenswrapper[5784]: W1104 06:03:21.619209 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddba3c05a_be4e_49c8_b02e_f7024af3da05.slice/crio-e5b20989886f5b776265c59bae0220d961e9c5267ea2cf1ae83430a0ff5a4d0d WatchSource:0}: Error finding container e5b20989886f5b776265c59bae0220d961e9c5267ea2cf1ae83430a0ff5a4d0d: Status 404 returned error can't find the container with id e5b20989886f5b776265c59bae0220d961e9c5267ea2cf1ae83430a0ff5a4d0d Nov 04 06:03:21.638309 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:21.638279 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" event={"ID":"dba3c05a-be4e-49c8-b02e-f7024af3da05","Type":"ContainerStarted","Data":"e5b20989886f5b776265c59bae0220d961e9c5267ea2cf1ae83430a0ff5a4d0d"} Nov 04 06:03:22.587505 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:22.586689 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:03:23.650791 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:23.650752 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" event={"ID":"dba3c05a-be4e-49c8-b02e-f7024af3da05","Type":"ContainerStarted","Data":"fc648b341aae789d4f4f00b8259b3e83eccf2a544a80f692bcee0e07910502a7"} Nov 04 06:03:23.779541 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:23.779483 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" podStartSLOduration=2.175965335 podStartE2EDuration="3.779469323s" totalImagesPullingTime="1.603503988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:03:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:03:23.778580057 +0000 UTC m=+802.915276455" watchObservedRunningTime="2026-11-04 06:03:23.779469323 +0000 UTC m=+802.916165721" Nov 04 06:03:24.230377 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:24.230337 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:31.230414 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:31.230370 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:31.242628 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:31.242601 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:31.706116 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:31.705045 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:03:33.759178 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:33.759141 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:03:45.425916 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:03:45.425815 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:03:48.671794 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.671761 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc"] Nov 04 06:03:48.675648 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.675623 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:03:48.782270 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.782237 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-dshm\") pod \"simulator-w0-f38f69-kserve-6d4b454675-94xgc\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:03:48.782479 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.782353 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-model-cache\") pod \"simulator-w0-f38f69-kserve-6d4b454675-94xgc\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:03:48.782479 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.782389 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-home\") pod \"simulator-w0-f38f69-kserve-6d4b454675-94xgc\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:03:48.782614 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.782483 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3adae990-c59e-42e0-98bc-a76106ad9448-tls-certs\") pod \"simulator-w0-f38f69-kserve-6d4b454675-94xgc\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:03:48.782614 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.782524 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-tmp-dir\") pod \"simulator-w0-f38f69-kserve-6d4b454675-94xgc\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:03:48.782724 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.782629 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxrtm\" (UniqueName: \"kubernetes.io/projected/3adae990-c59e-42e0-98bc-a76106ad9448-kube-api-access-jxrtm\") pod \"simulator-w0-f38f69-kserve-6d4b454675-94xgc\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:03:48.790016 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.789988 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-f38f69\"/\"default-dockercfg-zgpp6\"" Nov 04 06:03:48.790195 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.790134 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-f38f69\"/\"simulator-w0-f38f69-kserve-self-signed-certs\"" Nov 04 06:03:48.790195 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.790152 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-f38f69\"/\"openshift-service-ca.crt\"" Nov 04 06:03:48.790284 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.790202 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-f38f69\"/\"kube-root-ca.crt\"" Nov 04 06:03:48.791869 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.791853 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc"] Nov 04 06:03:48.883412 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.883378 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-model-cache\") pod \"simulator-w0-f38f69-kserve-6d4b454675-94xgc\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:03:48.883568 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.883420 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-home\") pod \"simulator-w0-f38f69-kserve-6d4b454675-94xgc\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:03:48.883568 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.883468 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3adae990-c59e-42e0-98bc-a76106ad9448-tls-certs\") pod \"simulator-w0-f38f69-kserve-6d4b454675-94xgc\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:03:48.883568 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.883493 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-tmp-dir\") pod \"simulator-w0-f38f69-kserve-6d4b454675-94xgc\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:03:48.883568 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.883544 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxrtm\" (UniqueName: \"kubernetes.io/projected/3adae990-c59e-42e0-98bc-a76106ad9448-kube-api-access-jxrtm\") pod \"simulator-w0-f38f69-kserve-6d4b454675-94xgc\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:03:48.883778 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.883620 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-dshm\") pod \"simulator-w0-f38f69-kserve-6d4b454675-94xgc\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:03:48.883916 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.883869 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-model-cache\") pod \"simulator-w0-f38f69-kserve-6d4b454675-94xgc\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:03:48.884052 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.883920 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-home\") pod \"simulator-w0-f38f69-kserve-6d4b454675-94xgc\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:03:48.884052 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.883981 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-tmp-dir\") pod \"simulator-w0-f38f69-kserve-6d4b454675-94xgc\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:03:48.885912 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.885888 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-dshm\") pod \"simulator-w0-f38f69-kserve-6d4b454675-94xgc\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:03:48.886210 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.886191 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3adae990-c59e-42e0-98bc-a76106ad9448-tls-certs\") pod \"simulator-w0-f38f69-kserve-6d4b454675-94xgc\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:03:48.952327 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.952245 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxrtm\" (UniqueName: \"kubernetes.io/projected/3adae990-c59e-42e0-98bc-a76106ad9448-kube-api-access-jxrtm\") pod \"simulator-w0-f38f69-kserve-6d4b454675-94xgc\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:03:48.988044 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:48.988008 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:03:49.417177 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:49.417147 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc"] Nov 04 06:03:49.418886 ip-10-0-134-45 kubenswrapper[5784]: W1104 06:03:49.418856 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3adae990_c59e_42e0_98bc_a76106ad9448.slice/crio-eaf80d1d70233f5b1bb3931384b637f937af1a07d9e059808f86ada9a68e43c3 WatchSource:0}: Error finding container eaf80d1d70233f5b1bb3931384b637f937af1a07d9e059808f86ada9a68e43c3: Status 404 returned error can't find the container with id eaf80d1d70233f5b1bb3931384b637f937af1a07d9e059808f86ada9a68e43c3 Nov 04 06:03:49.783470 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:49.783364 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" event={"ID":"3adae990-c59e-42e0-98bc-a76106ad9448","Type":"ContainerStarted","Data":"02c6ca151fcb0d1bf3a4f4bd6e34257b6c19bd0b2d9e0c58608466da44797bdc"} Nov 04 06:03:49.783470 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:49.783419 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" event={"ID":"3adae990-c59e-42e0-98bc-a76106ad9448","Type":"ContainerStarted","Data":"eaf80d1d70233f5b1bb3931384b637f937af1a07d9e059808f86ada9a68e43c3"} Nov 04 06:03:49.912899 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:49.912845 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" podStartSLOduration=1.912826456 podStartE2EDuration="1.912826456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:03:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:03:49.911234538 +0000 UTC m=+829.047930938" watchObservedRunningTime="2026-11-04 06:03:49.912826456 +0000 UTC m=+829.049522940" Nov 04 06:03:49.989190 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:49.989141 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:03:54.654702 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:54.654669 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:03:58.988961 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:58.988923 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:03:59.001771 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:59.001740 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:03:59.848403 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:03:59.848373 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:04:04.852884 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:04.852844 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w"] Nov 04 06:04:04.858332 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:04.858308 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:04.916974 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:04.916940 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w"] Nov 04 06:04:04.951694 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:04.951656 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-home\") pod \"simulator-w3-32f7d6-kserve-7569466498-s9s9w\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:04.951874 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:04.951706 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-model-cache\") pod \"simulator-w3-32f7d6-kserve-7569466498-s9s9w\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:04.951874 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:04.951809 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43d2e899-72d6-4006-90fd-3c140efca1fd-tls-certs\") pod \"simulator-w3-32f7d6-kserve-7569466498-s9s9w\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:04.951874 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:04.951862 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-dshm\") pod \"simulator-w3-32f7d6-kserve-7569466498-s9s9w\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:04.951988 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:04.951965 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mshch\" (UniqueName: \"kubernetes.io/projected/43d2e899-72d6-4006-90fd-3c140efca1fd-kube-api-access-mshch\") pod \"simulator-w3-32f7d6-kserve-7569466498-s9s9w\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:04.952025 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:04.952017 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-tmp-dir\") pod \"simulator-w3-32f7d6-kserve-7569466498-s9s9w\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:04.971182 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:04.971150 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-32f7d6\"/\"openshift-service-ca.crt\"" Nov 04 06:04:04.971362 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:04.971175 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-32f7d6\"/\"kube-root-ca.crt\"" Nov 04 06:04:04.973820 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:04.973793 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-32f7d6\"/\"default-dockercfg-wf5hh\"" Nov 04 06:04:04.973939 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:04.973819 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-32f7d6\"/\"simulator-w3-32f7d6-kserve-self-signed-certs\"" Nov 04 06:04:05.053544 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:05.053511 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-model-cache\") pod \"simulator-w3-32f7d6-kserve-7569466498-s9s9w\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:05.053774 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:05.053559 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43d2e899-72d6-4006-90fd-3c140efca1fd-tls-certs\") pod \"simulator-w3-32f7d6-kserve-7569466498-s9s9w\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:05.053774 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:05.053594 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-dshm\") pod \"simulator-w3-32f7d6-kserve-7569466498-s9s9w\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:05.053774 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:05.053634 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mshch\" (UniqueName: \"kubernetes.io/projected/43d2e899-72d6-4006-90fd-3c140efca1fd-kube-api-access-mshch\") pod \"simulator-w3-32f7d6-kserve-7569466498-s9s9w\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:05.053981 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:05.053775 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-tmp-dir\") pod \"simulator-w3-32f7d6-kserve-7569466498-s9s9w\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:05.053981 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:05.053848 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-home\") pod \"simulator-w3-32f7d6-kserve-7569466498-s9s9w\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:05.053981 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:05.053941 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-model-cache\") pod \"simulator-w3-32f7d6-kserve-7569466498-s9s9w\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:05.054250 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:05.054226 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-home\") pod \"simulator-w3-32f7d6-kserve-7569466498-s9s9w\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:05.054296 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:05.054264 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-tmp-dir\") pod \"simulator-w3-32f7d6-kserve-7569466498-s9s9w\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:05.055915 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:05.055894 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-dshm\") pod \"simulator-w3-32f7d6-kserve-7569466498-s9s9w\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:05.056180 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:05.056164 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43d2e899-72d6-4006-90fd-3c140efca1fd-tls-certs\") pod \"simulator-w3-32f7d6-kserve-7569466498-s9s9w\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:05.120819 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:05.120737 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mshch\" (UniqueName: \"kubernetes.io/projected/43d2e899-72d6-4006-90fd-3c140efca1fd-kube-api-access-mshch\") pod \"simulator-w3-32f7d6-kserve-7569466498-s9s9w\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:05.170390 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:05.170355 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:05.562451 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:05.562423 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w"] Nov 04 06:04:05.564340 ip-10-0-134-45 kubenswrapper[5784]: W1104 06:04:05.564316 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43d2e899_72d6_4006_90fd_3c140efca1fd.slice/crio-33592f466fec752b070c0aa15ef4235f41636eb38dd30887fa20f9b38ffde99d WatchSource:0}: Error finding container 33592f466fec752b070c0aa15ef4235f41636eb38dd30887fa20f9b38ffde99d: Status 404 returned error can't find the container with id 33592f466fec752b070c0aa15ef4235f41636eb38dd30887fa20f9b38ffde99d Nov 04 06:04:05.869671 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:05.869632 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" event={"ID":"43d2e899-72d6-4006-90fd-3c140efca1fd","Type":"ContainerStarted","Data":"f430b86d330133bd679dccce0ad4fb5399d8e4127502707ca9006b224a10d372"} Nov 04 06:04:05.870082 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:05.869682 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" event={"ID":"43d2e899-72d6-4006-90fd-3c140efca1fd","Type":"ContainerStarted","Data":"33592f466fec752b070c0aa15ef4235f41636eb38dd30887fa20f9b38ffde99d"} Nov 04 06:04:05.998193 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:05.998142 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" podStartSLOduration=1.9981272620000001 podStartE2EDuration="1.998127262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:04:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:04:05.997287249 +0000 UTC m=+845.133983650" watchObservedRunningTime="2026-11-04 06:04:05.998127262 +0000 UTC m=+845.134823658" Nov 04 06:04:06.170995 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:06.170899 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:15.170810 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:15.170771 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:15.183413 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:15.183381 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:15.418292 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:04:15.418257 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:04:15.932279 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:15.932249 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:04:16.355993 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:16.355957 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:04:39.463667 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:39.463629 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:04:44.520599 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.520563 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp"] Nov 04 06:04:44.524276 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.524255 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:04:44.639314 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.639283 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-6b62c0\"/\"default-dockercfg-v58b7\"" Nov 04 06:04:44.639314 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.639306 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-6b62c0\"/\"kube-root-ca.crt\"" Nov 04 06:04:44.639558 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.639290 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-6b62c0\"/\"openshift-service-ca.crt\"" Nov 04 06:04:44.639558 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.639325 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-6b62c0\"/\"simulator-w5-6b62c0-kserve-self-signed-certs\"" Nov 04 06:04:44.641028 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.641003 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp"] Nov 04 06:04:44.671400 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.671365 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-home\") pod \"simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:04:44.671600 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.671414 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-tmp-dir\") pod \"simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:04:44.671600 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.671509 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75tdm\" (UniqueName: \"kubernetes.io/projected/a6bd6631-6581-4335-839b-bd713b746271-kube-api-access-75tdm\") pod \"simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:04:44.671729 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.671612 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-model-cache\") pod \"simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:04:44.671729 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.671708 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-dshm\") pod \"simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:04:44.671833 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.671777 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6bd6631-6581-4335-839b-bd713b746271-tls-certs\") pod \"simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:04:44.773227 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.773141 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-dshm\") pod \"simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:04:44.773227 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.773183 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6bd6631-6581-4335-839b-bd713b746271-tls-certs\") pod \"simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:04:44.773453 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.773303 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-home\") pod \"simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:04:44.773453 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.773353 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-tmp-dir\") pod \"simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:04:44.773453 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.773385 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75tdm\" (UniqueName: \"kubernetes.io/projected/a6bd6631-6581-4335-839b-bd713b746271-kube-api-access-75tdm\") pod \"simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:04:44.773453 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.773434 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-model-cache\") pod \"simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:04:44.773722 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.773693 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-home\") pod \"simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:04:44.773799 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.773762 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-tmp-dir\") pod \"simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:04:44.773799 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.773790 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-model-cache\") pod \"simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:04:44.775512 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.775455 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-dshm\") pod \"simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:04:44.775686 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.775669 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6bd6631-6581-4335-839b-bd713b746271-tls-certs\") pod \"simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:04:44.840514 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:44.840479 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75tdm\" (UniqueName: \"kubernetes.io/projected/a6bd6631-6581-4335-839b-bd713b746271-kube-api-access-75tdm\") pod \"simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:04:45.137533 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:45.137499 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:04:45.420018 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:04:45.419935 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:04:45.521515 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:45.521489 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp"] Nov 04 06:04:45.523898 ip-10-0-134-45 kubenswrapper[5784]: W1104 06:04:45.523871 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6bd6631_6581_4335_839b_bd713b746271.slice/crio-5785a8e3bb782536907d45fd5a7fd05655cfe1dbdcf1ae65f08b8c9516debfe4 WatchSource:0}: Error finding container 5785a8e3bb782536907d45fd5a7fd05655cfe1dbdcf1ae65f08b8c9516debfe4: Status 404 returned error can't find the container with id 5785a8e3bb782536907d45fd5a7fd05655cfe1dbdcf1ae65f08b8c9516debfe4 Nov 04 06:04:46.073946 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:46.073916 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" event={"ID":"a6bd6631-6581-4335-839b-bd713b746271","Type":"ContainerStarted","Data":"7197d967c90337a1606226c3743daf25392e6cf0a66dd71dc00663e6d514df0b"} Nov 04 06:04:46.074124 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:46.073954 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" event={"ID":"a6bd6631-6581-4335-839b-bd713b746271","Type":"ContainerStarted","Data":"5785a8e3bb782536907d45fd5a7fd05655cfe1dbdcf1ae65f08b8c9516debfe4"} Nov 04 06:04:46.138010 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:46.137980 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:04:46.202518 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:46.202464 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" podStartSLOduration=2.202450924 podStartE2EDuration="2.202450924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:04:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:04:46.201897347 +0000 UTC m=+885.338593746" watchObservedRunningTime="2026-11-04 06:04:46.202450924 +0000 UTC m=+885.339147322" Nov 04 06:04:55.138541 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:55.138508 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:04:55.150916 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:55.150891 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:04:56.143480 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:04:56.143451 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:05:01.100702 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:01.100672 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvgv2_206b2e75-0735-49df-a53c-bdd17aab8ae6/ovn-acl-logging/0.log" Nov 04 06:05:01.102358 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:01.102336 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvgv2_206b2e75-0735-49df-a53c-bdd17aab8ae6/ovn-acl-logging/0.log" Nov 04 06:05:01.157659 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:01.157628 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:05:15.418118 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:05:15.418035 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:05:23.255863 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:23.255822 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:05:26.014902 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.014871 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd"] Nov 04 06:05:26.019078 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.019045 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:26.088393 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.088361 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g94p\" (UniqueName: \"kubernetes.io/projected/19be279e-8cc8-4d9c-baf1-72f119e0c509-kube-api-access-4g94p\") pod \"premium-w2-db31ef-kserve-86976d47b7-bdmmd\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:26.088555 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.088401 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-tmp-dir\") pod \"premium-w2-db31ef-kserve-86976d47b7-bdmmd\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:26.088555 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.088499 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19be279e-8cc8-4d9c-baf1-72f119e0c509-tls-certs\") pod \"premium-w2-db31ef-kserve-86976d47b7-bdmmd\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:26.088555 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.088540 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-home\") pod \"premium-w2-db31ef-kserve-86976d47b7-bdmmd\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:26.088660 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.088608 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-dshm\") pod \"premium-w2-db31ef-kserve-86976d47b7-bdmmd\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:26.088660 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.088632 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-model-cache\") pod \"premium-w2-db31ef-kserve-86976d47b7-bdmmd\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:26.133540 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.133512 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-db31ef\"/\"openshift-service-ca.crt\"" Nov 04 06:05:26.133540 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.133533 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-db31ef\"/\"kube-root-ca.crt\"" Nov 04 06:05:26.133745 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.133557 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-db31ef\"/\"premium-w2-db31ef-kserve-self-signed-certs\"" Nov 04 06:05:26.133745 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.133597 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-db31ef\"/\"default-dockercfg-v4btb\"" Nov 04 06:05:26.135392 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.135365 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd"] Nov 04 06:05:26.190143 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.190113 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g94p\" (UniqueName: \"kubernetes.io/projected/19be279e-8cc8-4d9c-baf1-72f119e0c509-kube-api-access-4g94p\") pod \"premium-w2-db31ef-kserve-86976d47b7-bdmmd\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:26.190324 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.190151 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-tmp-dir\") pod \"premium-w2-db31ef-kserve-86976d47b7-bdmmd\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:26.190324 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.190199 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19be279e-8cc8-4d9c-baf1-72f119e0c509-tls-certs\") pod \"premium-w2-db31ef-kserve-86976d47b7-bdmmd\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:26.190324 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.190219 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-home\") pod \"premium-w2-db31ef-kserve-86976d47b7-bdmmd\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:26.190324 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.190238 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-dshm\") pod \"premium-w2-db31ef-kserve-86976d47b7-bdmmd\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:26.190324 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.190261 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-model-cache\") pod \"premium-w2-db31ef-kserve-86976d47b7-bdmmd\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:26.190699 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.190678 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-home\") pod \"premium-w2-db31ef-kserve-86976d47b7-bdmmd\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:26.190764 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.190726 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-tmp-dir\") pod \"premium-w2-db31ef-kserve-86976d47b7-bdmmd\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:26.190764 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.190739 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-model-cache\") pod \"premium-w2-db31ef-kserve-86976d47b7-bdmmd\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:26.192631 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.192609 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-dshm\") pod \"premium-w2-db31ef-kserve-86976d47b7-bdmmd\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:26.192741 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.192729 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19be279e-8cc8-4d9c-baf1-72f119e0c509-tls-certs\") pod \"premium-w2-db31ef-kserve-86976d47b7-bdmmd\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:26.257638 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.257598 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g94p\" (UniqueName: \"kubernetes.io/projected/19be279e-8cc8-4d9c-baf1-72f119e0c509-kube-api-access-4g94p\") pod \"premium-w2-db31ef-kserve-86976d47b7-bdmmd\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:26.331021 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.330982 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:26.716250 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:26.716222 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd"] Nov 04 06:05:26.718366 ip-10-0-134-45 kubenswrapper[5784]: W1104 06:05:26.718339 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19be279e_8cc8_4d9c_baf1_72f119e0c509.slice/crio-20c3460751576afdb39ba2b86294a8be4e67527a6fa8f29e7cf3951972b19ce0 WatchSource:0}: Error finding container 20c3460751576afdb39ba2b86294a8be4e67527a6fa8f29e7cf3951972b19ce0: Status 404 returned error can't find the container with id 20c3460751576afdb39ba2b86294a8be4e67527a6fa8f29e7cf3951972b19ce0 Nov 04 06:05:27.314167 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:27.314128 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" event={"ID":"19be279e-8cc8-4d9c-baf1-72f119e0c509","Type":"ContainerStarted","Data":"5256492efe5b802a1d7c475b6771bec4ceaaf3c71637efc7efa2f2bde33d2487"} Nov 04 06:05:27.314569 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:27.314179 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" event={"ID":"19be279e-8cc8-4d9c-baf1-72f119e0c509","Type":"ContainerStarted","Data":"20c3460751576afdb39ba2b86294a8be4e67527a6fa8f29e7cf3951972b19ce0"} Nov 04 06:05:27.331492 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:27.331466 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:27.444483 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:27.444426 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" podStartSLOduration=2.444412515 podStartE2EDuration="2.444412515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:05:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:05:27.443980766 +0000 UTC m=+926.580677166" watchObservedRunningTime="2026-11-04 06:05:27.444412515 +0000 UTC m=+926.581108914" Nov 04 06:05:36.331960 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:36.331925 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:36.344440 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:36.344408 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:36.369842 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:36.369817 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:05:45.419305 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:05:45.419263 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:05:53.847774 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:53.847738 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c"] Nov 04 06:05:53.851359 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:53.851341 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:05:53.964947 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:53.964904 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-18990c\"/\"openshift-service-ca.crt\"" Nov 04 06:05:53.965159 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:53.964972 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-18990c\"/\"kube-root-ca.crt\"" Nov 04 06:05:53.965159 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:53.965000 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-18990c\"/\"default-dockercfg-wpsdm\"" Nov 04 06:05:53.965159 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:53.965048 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-18990c\"/\"premium-w6-18990c-kserve-self-signed-certs\"" Nov 04 06:05:53.966988 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:53.966960 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c"] Nov 04 06:05:53.989194 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:53.989166 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-model-cache\") pod \"premium-w6-18990c-kserve-6bc4668d94-tdt9c\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:05:53.989327 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:53.989204 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-dshm\") pod \"premium-w6-18990c-kserve-6bc4668d94-tdt9c\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:05:53.989327 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:53.989226 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-tmp-dir\") pod \"premium-w6-18990c-kserve-6bc4668d94-tdt9c\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:05:53.989406 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:53.989373 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e10253e-b217-4181-8d04-e3640198d83f-tls-certs\") pod \"premium-w6-18990c-kserve-6bc4668d94-tdt9c\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:05:53.989441 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:53.989416 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-home\") pod \"premium-w6-18990c-kserve-6bc4668d94-tdt9c\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:05:53.989483 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:53.989449 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt859\" (UniqueName: \"kubernetes.io/projected/1e10253e-b217-4181-8d04-e3640198d83f-kube-api-access-tt859\") pod \"premium-w6-18990c-kserve-6bc4668d94-tdt9c\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:05:54.090956 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:54.090921 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-model-cache\") pod \"premium-w6-18990c-kserve-6bc4668d94-tdt9c\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:05:54.091172 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:54.090964 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-dshm\") pod \"premium-w6-18990c-kserve-6bc4668d94-tdt9c\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:05:54.091172 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:54.090983 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-tmp-dir\") pod \"premium-w6-18990c-kserve-6bc4668d94-tdt9c\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:05:54.091172 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:54.091034 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e10253e-b217-4181-8d04-e3640198d83f-tls-certs\") pod \"premium-w6-18990c-kserve-6bc4668d94-tdt9c\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:05:54.091172 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:54.091104 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-home\") pod \"premium-w6-18990c-kserve-6bc4668d94-tdt9c\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:05:54.091172 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:54.091126 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt859\" (UniqueName: \"kubernetes.io/projected/1e10253e-b217-4181-8d04-e3640198d83f-kube-api-access-tt859\") pod \"premium-w6-18990c-kserve-6bc4668d94-tdt9c\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:05:54.091528 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:54.091476 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-tmp-dir\") pod \"premium-w6-18990c-kserve-6bc4668d94-tdt9c\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:05:54.091630 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:54.091501 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-model-cache\") pod \"premium-w6-18990c-kserve-6bc4668d94-tdt9c\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:05:54.091630 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:54.091538 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-home\") pod \"premium-w6-18990c-kserve-6bc4668d94-tdt9c\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:05:54.093269 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:54.093247 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-dshm\") pod \"premium-w6-18990c-kserve-6bc4668d94-tdt9c\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:05:54.093639 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:54.093614 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e10253e-b217-4181-8d04-e3640198d83f-tls-certs\") pod \"premium-w6-18990c-kserve-6bc4668d94-tdt9c\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:05:54.157978 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:54.157910 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt859\" (UniqueName: \"kubernetes.io/projected/1e10253e-b217-4181-8d04-e3640198d83f-kube-api-access-tt859\") pod \"premium-w6-18990c-kserve-6bc4668d94-tdt9c\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:05:54.162808 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:54.162774 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:05:54.545285 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:54.545258 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c"] Nov 04 06:05:54.547597 ip-10-0-134-45 kubenswrapper[5784]: W1104 06:05:54.547569 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e10253e_b217_4181_8d04_e3640198d83f.slice/crio-b49601a2bb0424bd399afd81769d7447e463eb648bc0b0389dcfedc64a81ed31 WatchSource:0}: Error finding container b49601a2bb0424bd399afd81769d7447e463eb648bc0b0389dcfedc64a81ed31: Status 404 returned error can't find the container with id b49601a2bb0424bd399afd81769d7447e463eb648bc0b0389dcfedc64a81ed31 Nov 04 06:05:55.463820 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:55.463773 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" event={"ID":"1e10253e-b217-4181-8d04-e3640198d83f","Type":"ContainerStarted","Data":"91c967474686d5db75dcc8a7dc294347eefa7212e8667e42b76aba0a864e1c17"} Nov 04 06:05:55.464219 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:55.463827 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" event={"ID":"1e10253e-b217-4181-8d04-e3640198d83f","Type":"ContainerStarted","Data":"b49601a2bb0424bd399afd81769d7447e463eb648bc0b0389dcfedc64a81ed31"} Nov 04 06:05:55.594143 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:55.594080 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" podStartSLOduration=2.594051463 podStartE2EDuration="2.594051463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:05:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:05:55.592167717 +0000 UTC m=+954.728864117" watchObservedRunningTime="2026-11-04 06:05:55.594051463 +0000 UTC m=+954.730747860" Nov 04 06:05:56.163363 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:56.163331 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:05:59.796199 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:05:59.796168 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:06:04.163515 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:06:04.163481 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:06:04.176366 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:06:04.176338 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:06:04.523332 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:06:04.523251 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:06:15.418473 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:06:15.418439 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:06:31.918715 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:06:31.918679 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:06:45.417800 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:06:45.417723 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:07:15.418441 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:07:15.418406 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:07:19.053259 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:19.053227 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:07:31.185978 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.185947 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb"] Nov 04 06:07:31.192140 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.190766 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:31.252567 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.252533 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb"] Nov 04 06:07:31.303051 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.303017 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnmr7\" (UniqueName: \"kubernetes.io/projected/11451a43-a404-4f2a-817d-47eacf3f50c1-kube-api-access-rnmr7\") pod \"distinct-w0-f38f69-kserve-6b87889557-4vbfb\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:31.303242 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.303085 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-dshm\") pod \"distinct-w0-f38f69-kserve-6b87889557-4vbfb\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:31.303281 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.303259 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-tmp-dir\") pod \"distinct-w0-f38f69-kserve-6b87889557-4vbfb\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:31.303313 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.303294 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-model-cache\") pod \"distinct-w0-f38f69-kserve-6b87889557-4vbfb\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:31.303348 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.303321 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11451a43-a404-4f2a-817d-47eacf3f50c1-tls-certs\") pod \"distinct-w0-f38f69-kserve-6b87889557-4vbfb\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:31.303449 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.303432 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-home\") pod \"distinct-w0-f38f69-kserve-6b87889557-4vbfb\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:31.306412 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.306389 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-f38f69\"/\"distinct-w0-f38f69-kserve-self-signed-certs\"" Nov 04 06:07:31.404565 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.404530 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-tmp-dir\") pod \"distinct-w0-f38f69-kserve-6b87889557-4vbfb\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:31.404565 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.404568 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-model-cache\") pod \"distinct-w0-f38f69-kserve-6b87889557-4vbfb\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:31.404805 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.404584 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11451a43-a404-4f2a-817d-47eacf3f50c1-tls-certs\") pod \"distinct-w0-f38f69-kserve-6b87889557-4vbfb\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:31.404805 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.404638 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-home\") pod \"distinct-w0-f38f69-kserve-6b87889557-4vbfb\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:31.404805 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.404677 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnmr7\" (UniqueName: \"kubernetes.io/projected/11451a43-a404-4f2a-817d-47eacf3f50c1-kube-api-access-rnmr7\") pod \"distinct-w0-f38f69-kserve-6b87889557-4vbfb\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:31.404805 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.404710 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-dshm\") pod \"distinct-w0-f38f69-kserve-6b87889557-4vbfb\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:31.405054 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.405028 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-tmp-dir\") pod \"distinct-w0-f38f69-kserve-6b87889557-4vbfb\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:31.405157 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.405086 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-model-cache\") pod \"distinct-w0-f38f69-kserve-6b87889557-4vbfb\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:31.405157 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.405133 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-home\") pod \"distinct-w0-f38f69-kserve-6b87889557-4vbfb\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:31.406982 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.406962 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-dshm\") pod \"distinct-w0-f38f69-kserve-6b87889557-4vbfb\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:31.407428 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.407407 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11451a43-a404-4f2a-817d-47eacf3f50c1-tls-certs\") pod \"distinct-w0-f38f69-kserve-6b87889557-4vbfb\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:31.474653 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.474574 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnmr7\" (UniqueName: \"kubernetes.io/projected/11451a43-a404-4f2a-817d-47eacf3f50c1-kube-api-access-rnmr7\") pod \"distinct-w0-f38f69-kserve-6b87889557-4vbfb\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:31.506143 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.506107 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:31.581189 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.581150 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7281-41f7f7"] Nov 04 06:07:31.593024 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.592387 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7281-41f7f7" Nov 04 06:07:31.686652 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.686287 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-2cc4r\"" Nov 04 06:07:31.687869 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.687839 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7281-41f7f7"] Nov 04 06:07:31.707609 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.707570 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wfhb\" (UniqueName: \"kubernetes.io/projected/a0f02a6c-4a01-4d0d-987f-84ab58b837b1-kube-api-access-6wfhb\") pod \"test-curl-7281-41f7f7\" (UID: \"a0f02a6c-4a01-4d0d-987f-84ab58b837b1\") " pod="opendatahub/test-curl-7281-41f7f7" Nov 04 06:07:31.809031 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.808961 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wfhb\" (UniqueName: \"kubernetes.io/projected/a0f02a6c-4a01-4d0d-987f-84ab58b837b1-kube-api-access-6wfhb\") pod \"test-curl-7281-41f7f7\" (UID: \"a0f02a6c-4a01-4d0d-987f-84ab58b837b1\") " pod="opendatahub/test-curl-7281-41f7f7" Nov 04 06:07:31.875510 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.875484 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wfhb\" (UniqueName: \"kubernetes.io/projected/a0f02a6c-4a01-4d0d-987f-84ab58b837b1-kube-api-access-6wfhb\") pod \"test-curl-7281-41f7f7\" (UID: \"a0f02a6c-4a01-4d0d-987f-84ab58b837b1\") " pod="opendatahub/test-curl-7281-41f7f7" Nov 04 06:07:31.899408 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.899381 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb"] Nov 04 06:07:31.901204 ip-10-0-134-45 kubenswrapper[5784]: W1104 06:07:31.901181 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11451a43_a404_4f2a_817d_47eacf3f50c1.slice/crio-e2c76818d7bfaa9cab28f0b4fedef1c48ee7810129ab77a4aad4f07bdf2ce231 WatchSource:0}: Error finding container e2c76818d7bfaa9cab28f0b4fedef1c48ee7810129ab77a4aad4f07bdf2ce231: Status 404 returned error can't find the container with id e2c76818d7bfaa9cab28f0b4fedef1c48ee7810129ab77a4aad4f07bdf2ce231 Nov 04 06:07:31.920621 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.920597 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7281-41f7f7" Nov 04 06:07:31.969676 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:31.969648 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" event={"ID":"11451a43-a404-4f2a-817d-47eacf3f50c1","Type":"ContainerStarted","Data":"e2c76818d7bfaa9cab28f0b4fedef1c48ee7810129ab77a4aad4f07bdf2ce231"} Nov 04 06:07:32.300543 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:32.300518 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7281-41f7f7"] Nov 04 06:07:32.302245 ip-10-0-134-45 kubenswrapper[5784]: W1104 06:07:32.302220 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0f02a6c_4a01_4d0d_987f_84ab58b837b1.slice/crio-eac8ad4da50f1b26fad6555b2e172398ed618133dcd0e50bf008a0b2983d9e6b WatchSource:0}: Error finding container eac8ad4da50f1b26fad6555b2e172398ed618133dcd0e50bf008a0b2983d9e6b: Status 404 returned error can't find the container with id eac8ad4da50f1b26fad6555b2e172398ed618133dcd0e50bf008a0b2983d9e6b Nov 04 06:07:32.304189 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:32.304168 5784 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 06:07:32.975977 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:32.975942 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7281-41f7f7" event={"ID":"a0f02a6c-4a01-4d0d-987f-84ab58b837b1","Type":"ContainerStarted","Data":"eac8ad4da50f1b26fad6555b2e172398ed618133dcd0e50bf008a0b2983d9e6b"} Nov 04 06:07:32.977466 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:32.977439 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" event={"ID":"11451a43-a404-4f2a-817d-47eacf3f50c1","Type":"ContainerStarted","Data":"c365bd8066b8630ba907b6e50d6194024c87703aaf7dacd150d678c19f1c2da0"} Nov 04 06:07:33.106278 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:33.106229 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" podStartSLOduration=2.106214855 podStartE2EDuration="2.106214855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:07:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:07:33.105645899 +0000 UTC m=+1052.242342297" watchObservedRunningTime="2026-11-04 06:07:33.106214855 +0000 UTC m=+1052.242911253" Nov 04 06:07:33.506347 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:33.506315 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:33.983933 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:33.983902 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7281-41f7f7" event={"ID":"a0f02a6c-4a01-4d0d-987f-84ab58b837b1","Type":"ContainerStarted","Data":"eb6ec62d12841ef5af972bb89f118ad1335d522de57dfae0bfa12351f5c5b47d"} Nov 04 06:07:34.109884 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:34.109827 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7281-41f7f7" podStartSLOduration=2.100414072 podStartE2EDuration="3.10981361s" totalImagesPullingTime="1.009399538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:07:34.108753425 +0000 UTC m=+1053.245449823" watchObservedRunningTime="2026-11-04 06:07:34.10981361 +0000 UTC m=+1053.246510045" Nov 04 06:07:35.741875 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:35.741840 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7281-41f7f7"] Nov 04 06:07:35.746024 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:35.745993 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7281-41f7f7"] Nov 04 06:07:35.993750 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:35.993653 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7281-41f7f7" podUID="a0f02a6c-4a01-4d0d-987f-84ab58b837b1" containerName="test-curl-7281-41f7f7" containerID="cri-o://eb6ec62d12841ef5af972bb89f118ad1335d522de57dfae0bfa12351f5c5b47d" gracePeriod=2 Nov 04 06:07:36.050687 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:07:36.050646 5784 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7281-41f7f7\" is forbidden: User \"system:node:ip-10-0-134-45.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-45.us-west-1.compute.internal' and this object" podUID="a0f02a6c-4a01-4d0d-987f-84ab58b837b1" pod="opendatahub/test-curl-7281-41f7f7" Nov 04 06:07:38.240856 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:38.240826 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7281-41f7f7" Nov 04 06:07:38.378179 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:38.378145 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0f02a6c-4a01-4d0d-987f-84ab58b837b1-kube-api-access-6wfhb\" (UniqueName: \"kubernetes.io/projected/a0f02a6c-4a01-4d0d-987f-84ab58b837b1-kube-api-access-6wfhb\") pod \"a0f02a6c-4a01-4d0d-987f-84ab58b837b1\" (UID: \"a0f02a6c-4a01-4d0d-987f-84ab58b837b1\") " Nov 04 06:07:38.380255 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:38.380230 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0f02a6c-4a01-4d0d-987f-84ab58b837b1-kube-api-access-6wfhb" pod "a0f02a6c-4a01-4d0d-987f-84ab58b837b1" (UID: "a0f02a6c-4a01-4d0d-987f-84ab58b837b1"). InnerVolumeSpecName "kube-api-access-6wfhb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:07:38.479662 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:38.479622 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wfhb\" (UniqueName: \"kubernetes.io/projected/a0f02a6c-4a01-4d0d-987f-84ab58b837b1-kube-api-access-6wfhb\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:39.011441 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:39.011407 5784 generic.go:356] "Generic (PLEG): container finished" podID="a0f02a6c-4a01-4d0d-987f-84ab58b837b1" containerID="eb6ec62d12841ef5af972bb89f118ad1335d522de57dfae0bfa12351f5c5b47d" exitCode=137 Nov 04 06:07:39.011638 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:39.011498 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7281-41f7f7" Nov 04 06:07:39.016793 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:39.016766 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a0f02a6c-4a01-4d0d-987f-84ab58b837b1" path="/var/lib/kubelet/pods/a0f02a6c-4a01-4d0d-987f-84ab58b837b1/volumes" Nov 04 06:07:39.017187 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:39.017172 5784 scope.go:122] "RemoveContainer" containerID="eb6ec62d12841ef5af972bb89f118ad1335d522de57dfae0bfa12351f5c5b47d" Nov 04 06:07:39.026094 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:39.026052 5784 scope.go:122] "RemoveContainer" containerID="eb6ec62d12841ef5af972bb89f118ad1335d522de57dfae0bfa12351f5c5b47d" Nov 04 06:07:39.026378 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:07:39.026360 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb6ec62d12841ef5af972bb89f118ad1335d522de57dfae0bfa12351f5c5b47d\": container with ID starting with eb6ec62d12841ef5af972bb89f118ad1335d522de57dfae0bfa12351f5c5b47d not found: ID does not exist" containerID="eb6ec62d12841ef5af972bb89f118ad1335d522de57dfae0bfa12351f5c5b47d" Nov 04 06:07:39.026454 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:39.026385 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb6ec62d12841ef5af972bb89f118ad1335d522de57dfae0bfa12351f5c5b47d"} err="failed to get container status \"eb6ec62d12841ef5af972bb89f118ad1335d522de57dfae0bfa12351f5c5b47d\": rpc error: code = NotFound desc = could not find container \"eb6ec62d12841ef5af972bb89f118ad1335d522de57dfae0bfa12351f5c5b47d\": container with ID starting with eb6ec62d12841ef5af972bb89f118ad1335d522de57dfae0bfa12351f5c5b47d not found: ID does not exist" Nov 04 06:07:40.926057 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:40.926022 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w"] Nov 04 06:07:41.506637 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:41.506606 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:41.520544 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:41.520520 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:42.039821 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:42.039792 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:07:42.677317 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:42.677280 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c"] Nov 04 06:07:44.658045 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.658014 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb"] Nov 04 06:07:44.658516 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.658500 5784 cpu_manager.go:414] "containerMap: removing container" podUID="a0f02a6c-4a01-4d0d-987f-84ab58b837b1" containerName="test-curl-7281-41f7f7" Nov 04 06:07:44.658582 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.658517 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a0f02a6c-4a01-4d0d-987f-84ab58b837b1" containerName="test-curl-7281-41f7f7" Nov 04 06:07:44.658663 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.658653 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="a0f02a6c-4a01-4d0d-987f-84ab58b837b1" containerName="test-curl-7281-41f7f7" Nov 04 06:07:44.663560 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.663534 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.723844 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.723809 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-856c68-openshift-default-dockercfg-fv7lh\"" Nov 04 06:07:44.747127 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.747092 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.747314 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.747143 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.747314 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.747280 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rscwl\" (UniqueName: \"kubernetes.io/projected/b91f7014-bca4-4179-b042-a02f6a7f3ea1-kube-api-access-rscwl\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.747436 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.747314 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.747436 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.747360 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.747513 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.747472 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.747553 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.747519 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.747665 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.747644 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.747716 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.747699 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.780899 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.780864 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb"] Nov 04 06:07:44.848680 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.848647 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.848837 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.848689 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.848837 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.848748 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.848837 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.848770 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.848837 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.848810 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rscwl\" (UniqueName: \"kubernetes.io/projected/b91f7014-bca4-4179-b042-a02f6a7f3ea1-kube-api-access-rscwl\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.848837 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.848832 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.849094 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.848868 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.849094 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.848927 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.849094 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.848959 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.849268 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.849194 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.849330 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.849276 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.849395 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.849349 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.849450 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.849416 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.849559 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.849534 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.851104 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.851077 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.851393 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.851376 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.915216 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.915153 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.915325 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.915299 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rscwl\" (UniqueName: \"kubernetes.io/projected/b91f7014-bca4-4179-b042-a02f6a7f3ea1-kube-api-access-rscwl\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:44.976642 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:44.976616 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:45.192125 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:45.192040 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp"] Nov 04 06:07:45.418474 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:07:45.418436 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:07:45.421561 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:45.421538 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb"] Nov 04 06:07:45.423410 ip-10-0-134-45 kubenswrapper[5784]: W1104 06:07:45.423384 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb91f7014_bca4_4179_b042_a02f6a7f3ea1.slice/crio-0cb61aa13500c1398333406806cb0161d20c2d9d9cfd80a1beb9ee11e1d91a3c WatchSource:0}: Error finding container 0cb61aa13500c1398333406806cb0161d20c2d9d9cfd80a1beb9ee11e1d91a3c: Status 404 returned error can't find the container with id 0cb61aa13500c1398333406806cb0161d20c2d9d9cfd80a1beb9ee11e1d91a3c Nov 04 06:07:45.425729 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:45.425698 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:07:45.425811 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:45.425761 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:07:45.425811 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:45.425793 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:07:46.053541 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:46.053507 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" event={"ID":"b91f7014-bca4-4179-b042-a02f6a7f3ea1","Type":"ContainerStarted","Data":"9554655ac1916faabf8de83185475cdbe62c41a685ff16d85a3e4af2faeac65e"} Nov 04 06:07:46.053914 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:46.053561 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" event={"ID":"b91f7014-bca4-4179-b042-a02f6a7f3ea1","Type":"ContainerStarted","Data":"0cb61aa13500c1398333406806cb0161d20c2d9d9cfd80a1beb9ee11e1d91a3c"} Nov 04 06:07:46.186313 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:46.186261 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" podStartSLOduration=2.186245747 podStartE2EDuration="2.186245747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:07:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:07:46.184541896 +0000 UTC m=+1065.321238294" watchObservedRunningTime="2026-11-04 06:07:46.186245747 +0000 UTC m=+1065.322942144" Nov 04 06:07:46.977086 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:46.977023 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:46.978846 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:46.978816 5784 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Nov 04 06:07:46.978994 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:46.978869 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" podUID="b91f7014-bca4-4179-b042-a02f6a7f3ea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Nov 04 06:07:47.384278 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:47.384241 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:07:47.977450 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:47.977416 5784 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Nov 04 06:07:47.977623 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:47.977474 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" podUID="b91f7014-bca4-4179-b042-a02f6a7f3ea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Nov 04 06:07:48.980461 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:48.980421 5784 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Nov 04 06:07:48.981087 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:48.981026 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" podUID="b91f7014-bca4-4179-b042-a02f6a7f3ea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Nov 04 06:07:49.977166 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:49.977133 5784 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Nov 04 06:07:49.977375 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:49.977191 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" podUID="b91f7014-bca4-4179-b042-a02f6a7f3ea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Nov 04 06:07:50.977451 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:50.977417 5784 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Nov 04 06:07:50.977910 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:50.977883 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" podUID="b91f7014-bca4-4179-b042-a02f6a7f3ea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Nov 04 06:07:51.977101 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:51.977052 5784 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Nov 04 06:07:51.977273 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:51.977117 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" podUID="b91f7014-bca4-4179-b042-a02f6a7f3ea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Nov 04 06:07:52.983029 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:52.982998 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:52.983448 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:52.983296 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:52.984132 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:52.984108 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:07:55.946807 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:55.946760 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" podUID="43d2e899-72d6-4006-90fd-3c140efca1fd" containerName="main" containerID="cri-o://f430b86d330133bd679dccce0ad4fb5399d8e4127502707ca9006b224a10d372" gracePeriod=45 Nov 04 06:07:56.143309 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:56.143269 5784 generic.go:356] "Generic (PLEG): container finished" podID="43d2e899-72d6-4006-90fd-3c140efca1fd" containerID="f430b86d330133bd679dccce0ad4fb5399d8e4127502707ca9006b224a10d372" exitCode=0 Nov 04 06:07:56.143512 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:56.143362 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" event={"ID":"43d2e899-72d6-4006-90fd-3c140efca1fd","Type":"ContainerDied","Data":"f430b86d330133bd679dccce0ad4fb5399d8e4127502707ca9006b224a10d372"} Nov 04 06:07:56.209932 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:56.209871 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:07:56.286173 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:56.286143 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-model-cache\") pod \"43d2e899-72d6-4006-90fd-3c140efca1fd\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " Nov 04 06:07:56.286374 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:56.286231 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/43d2e899-72d6-4006-90fd-3c140efca1fd-tls-certs\" (UniqueName: \"kubernetes.io/secret/43d2e899-72d6-4006-90fd-3c140efca1fd-tls-certs\") pod \"43d2e899-72d6-4006-90fd-3c140efca1fd\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " Nov 04 06:07:56.286374 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:56.286290 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-dshm\" (UniqueName: \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-dshm\") pod \"43d2e899-72d6-4006-90fd-3c140efca1fd\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " Nov 04 06:07:56.286374 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:56.286322 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-tmp-dir\") pod \"43d2e899-72d6-4006-90fd-3c140efca1fd\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " Nov 04 06:07:56.286577 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:56.286378 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-home\" (UniqueName: \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-home\") pod \"43d2e899-72d6-4006-90fd-3c140efca1fd\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " Nov 04 06:07:56.286577 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:56.286440 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/43d2e899-72d6-4006-90fd-3c140efca1fd-kube-api-access-mshch\" (UniqueName: \"kubernetes.io/projected/43d2e899-72d6-4006-90fd-3c140efca1fd-kube-api-access-mshch\") pod \"43d2e899-72d6-4006-90fd-3c140efca1fd\" (UID: \"43d2e899-72d6-4006-90fd-3c140efca1fd\") " Nov 04 06:07:56.286577 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:56.286486 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-model-cache" pod "43d2e899-72d6-4006-90fd-3c140efca1fd" (UID: "43d2e899-72d6-4006-90fd-3c140efca1fd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:07:56.286703 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:56.286678 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-tmp-dir" pod "43d2e899-72d6-4006-90fd-3c140efca1fd" (UID: "43d2e899-72d6-4006-90fd-3c140efca1fd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:07:56.286768 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:56.286699 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-home" pod "43d2e899-72d6-4006-90fd-3c140efca1fd" (UID: "43d2e899-72d6-4006-90fd-3c140efca1fd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:07:56.286913 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:56.286895 5784 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-home\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:56.287008 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:56.286915 5784 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-model-cache\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:56.287008 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:56.286926 5784 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-tmp-dir\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:56.288644 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:56.288620 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43d2e899-72d6-4006-90fd-3c140efca1fd-tls-certs" pod "43d2e899-72d6-4006-90fd-3c140efca1fd" (UID: "43d2e899-72d6-4006-90fd-3c140efca1fd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:07:56.288745 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:56.288670 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43d2e899-72d6-4006-90fd-3c140efca1fd-kube-api-access-mshch" pod "43d2e899-72d6-4006-90fd-3c140efca1fd" (UID: "43d2e899-72d6-4006-90fd-3c140efca1fd"). InnerVolumeSpecName "kube-api-access-mshch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:07:56.288745 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:56.288671 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-dshm" pod "43d2e899-72d6-4006-90fd-3c140efca1fd" (UID: "43d2e899-72d6-4006-90fd-3c140efca1fd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:07:56.387987 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:56.387953 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mshch\" (UniqueName: \"kubernetes.io/projected/43d2e899-72d6-4006-90fd-3c140efca1fd-kube-api-access-mshch\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:56.387987 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:56.387986 5784 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43d2e899-72d6-4006-90fd-3c140efca1fd-tls-certs\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:56.388234 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:56.388000 5784 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43d2e899-72d6-4006-90fd-3c140efca1fd-dshm\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:57.149945 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:57.149916 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" Nov 04 06:07:57.150396 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:57.149951 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w" event={"ID":"43d2e899-72d6-4006-90fd-3c140efca1fd","Type":"ContainerDied","Data":"33592f466fec752b070c0aa15ef4235f41636eb38dd30887fa20f9b38ffde99d"} Nov 04 06:07:57.150396 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:57.150000 5784 scope.go:122] "RemoveContainer" containerID="f430b86d330133bd679dccce0ad4fb5399d8e4127502707ca9006b224a10d372" Nov 04 06:07:57.331522 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:57.331491 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w"] Nov 04 06:07:57.333111 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:57.333086 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-32f7d6/simulator-w3-32f7d6-kserve-7569466498-s9s9w"] Nov 04 06:07:57.698077 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:57.697986 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" podUID="1e10253e-b217-4181-8d04-e3640198d83f" containerName="main" containerID="cri-o://91c967474686d5db75dcc8a7dc294347eefa7212e8667e42b76aba0a864e1c17" gracePeriod=45 Nov 04 06:07:57.954788 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:57.954734 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:07:58.006240 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.006209 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-model-cache\") pod \"1e10253e-b217-4181-8d04-e3640198d83f\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " Nov 04 06:07:58.006404 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.006261 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-dshm\") pod \"1e10253e-b217-4181-8d04-e3640198d83f\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " Nov 04 06:07:58.006404 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.006294 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1e10253e-b217-4181-8d04-e3640198d83f-kube-api-access-tt859\" (UniqueName: \"kubernetes.io/projected/1e10253e-b217-4181-8d04-e3640198d83f-kube-api-access-tt859\") pod \"1e10253e-b217-4181-8d04-e3640198d83f\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " Nov 04 06:07:58.006404 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.006332 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-home\" (UniqueName: \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-home\") pod \"1e10253e-b217-4181-8d04-e3640198d83f\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " Nov 04 06:07:58.006404 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.006365 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-tmp-dir\") pod \"1e10253e-b217-4181-8d04-e3640198d83f\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " Nov 04 06:07:58.006652 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.006460 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1e10253e-b217-4181-8d04-e3640198d83f-tls-certs\" (UniqueName: \"kubernetes.io/secret/1e10253e-b217-4181-8d04-e3640198d83f-tls-certs\") pod \"1e10253e-b217-4181-8d04-e3640198d83f\" (UID: \"1e10253e-b217-4181-8d04-e3640198d83f\") " Nov 04 06:07:58.006652 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.006469 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-model-cache" pod "1e10253e-b217-4181-8d04-e3640198d83f" (UID: "1e10253e-b217-4181-8d04-e3640198d83f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:07:58.006762 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.006637 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-home" pod "1e10253e-b217-4181-8d04-e3640198d83f" (UID: "1e10253e-b217-4181-8d04-e3640198d83f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:07:58.006762 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.006709 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-tmp-dir" pod "1e10253e-b217-4181-8d04-e3640198d83f" (UID: "1e10253e-b217-4181-8d04-e3640198d83f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:07:58.006893 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.006876 5784 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-home\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:58.006933 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.006899 5784 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-tmp-dir\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:58.006933 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.006913 5784 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-model-cache\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:58.008584 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.008557 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-dshm" pod "1e10253e-b217-4181-8d04-e3640198d83f" (UID: "1e10253e-b217-4181-8d04-e3640198d83f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:07:58.008688 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.008588 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e10253e-b217-4181-8d04-e3640198d83f-kube-api-access-tt859" pod "1e10253e-b217-4181-8d04-e3640198d83f" (UID: "1e10253e-b217-4181-8d04-e3640198d83f"). InnerVolumeSpecName "kube-api-access-tt859". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:07:58.008688 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.008639 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e10253e-b217-4181-8d04-e3640198d83f-tls-certs" pod "1e10253e-b217-4181-8d04-e3640198d83f" (UID: "1e10253e-b217-4181-8d04-e3640198d83f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:07:58.108223 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.108187 5784 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e10253e-b217-4181-8d04-e3640198d83f-tls-certs\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:58.108223 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.108225 5784 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e10253e-b217-4181-8d04-e3640198d83f-dshm\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:58.108425 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.108243 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt859\" (UniqueName: \"kubernetes.io/projected/1e10253e-b217-4181-8d04-e3640198d83f-kube-api-access-tt859\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:07:58.156400 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.156368 5784 generic.go:356] "Generic (PLEG): container finished" podID="1e10253e-b217-4181-8d04-e3640198d83f" containerID="91c967474686d5db75dcc8a7dc294347eefa7212e8667e42b76aba0a864e1c17" exitCode=0 Nov 04 06:07:58.156825 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.156408 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" Nov 04 06:07:58.156825 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.156442 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" event={"ID":"1e10253e-b217-4181-8d04-e3640198d83f","Type":"ContainerDied","Data":"91c967474686d5db75dcc8a7dc294347eefa7212e8667e42b76aba0a864e1c17"} Nov 04 06:07:58.156825 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.156482 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c" event={"ID":"1e10253e-b217-4181-8d04-e3640198d83f","Type":"ContainerDied","Data":"b49601a2bb0424bd399afd81769d7447e463eb648bc0b0389dcfedc64a81ed31"} Nov 04 06:07:58.156825 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.156502 5784 scope.go:122] "RemoveContainer" containerID="91c967474686d5db75dcc8a7dc294347eefa7212e8667e42b76aba0a864e1c17" Nov 04 06:07:58.165999 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.165981 5784 scope.go:122] "RemoveContainer" containerID="91c967474686d5db75dcc8a7dc294347eefa7212e8667e42b76aba0a864e1c17" Nov 04 06:07:58.166278 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:07:58.166259 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91c967474686d5db75dcc8a7dc294347eefa7212e8667e42b76aba0a864e1c17\": container with ID starting with 91c967474686d5db75dcc8a7dc294347eefa7212e8667e42b76aba0a864e1c17 not found: ID does not exist" containerID="91c967474686d5db75dcc8a7dc294347eefa7212e8667e42b76aba0a864e1c17" Nov 04 06:07:58.166334 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.166287 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91c967474686d5db75dcc8a7dc294347eefa7212e8667e42b76aba0a864e1c17"} err="failed to get container status \"91c967474686d5db75dcc8a7dc294347eefa7212e8667e42b76aba0a864e1c17\": rpc error: code = NotFound desc = could not find container \"91c967474686d5db75dcc8a7dc294347eefa7212e8667e42b76aba0a864e1c17\": container with ID starting with 91c967474686d5db75dcc8a7dc294347eefa7212e8667e42b76aba0a864e1c17 not found: ID does not exist" Nov 04 06:07:58.336978 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.336942 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c"] Nov 04 06:07:58.341472 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:58.341446 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-18990c/premium-w6-18990c-kserve-6bc4668d94-tdt9c"] Nov 04 06:07:59.016943 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:59.016909 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1e10253e-b217-4181-8d04-e3640198d83f" path="/var/lib/kubelet/pods/1e10253e-b217-4181-8d04-e3640198d83f/volumes" Nov 04 06:07:59.021973 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:07:59.018131 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="43d2e899-72d6-4006-90fd-3c140efca1fd" path="/var/lib/kubelet/pods/43d2e899-72d6-4006-90fd-3c140efca1fd/volumes" Nov 04 06:08:00.212144 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:00.212084 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" podUID="a6bd6631-6581-4335-839b-bd713b746271" containerName="main" containerID="cri-o://7197d967c90337a1606226c3743daf25392e6cf0a66dd71dc00663e6d514df0b" gracePeriod=45 Nov 04 06:08:00.463921 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:00.463869 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:08:00.534997 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:00.534967 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-model-cache\") pod \"a6bd6631-6581-4335-839b-bd713b746271\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " Nov 04 06:08:00.534997 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:00.535004 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-home\" (UniqueName: \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-home\") pod \"a6bd6631-6581-4335-839b-bd713b746271\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " Nov 04 06:08:00.535246 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:00.535098 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-tmp-dir\") pod \"a6bd6631-6581-4335-839b-bd713b746271\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " Nov 04 06:08:00.535246 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:00.535124 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-dshm\") pod \"a6bd6631-6581-4335-839b-bd713b746271\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " Nov 04 06:08:00.535246 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:00.535146 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a6bd6631-6581-4335-839b-bd713b746271-tls-certs\" (UniqueName: \"kubernetes.io/secret/a6bd6631-6581-4335-839b-bd713b746271-tls-certs\") pod \"a6bd6631-6581-4335-839b-bd713b746271\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " Nov 04 06:08:00.535246 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:00.535202 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a6bd6631-6581-4335-839b-bd713b746271-kube-api-access-75tdm\" (UniqueName: \"kubernetes.io/projected/a6bd6631-6581-4335-839b-bd713b746271-kube-api-access-75tdm\") pod \"a6bd6631-6581-4335-839b-bd713b746271\" (UID: \"a6bd6631-6581-4335-839b-bd713b746271\") " Nov 04 06:08:00.535454 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:00.535290 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-model-cache" pod "a6bd6631-6581-4335-839b-bd713b746271" (UID: "a6bd6631-6581-4335-839b-bd713b746271"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:00.535454 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:00.535303 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-home" pod "a6bd6631-6581-4335-839b-bd713b746271" (UID: "a6bd6631-6581-4335-839b-bd713b746271"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:00.535454 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:00.535375 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-tmp-dir" pod "a6bd6631-6581-4335-839b-bd713b746271" (UID: "a6bd6631-6581-4335-839b-bd713b746271"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:00.535597 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:00.535571 5784 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-tmp-dir\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:00.535641 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:00.535598 5784 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-model-cache\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:00.535641 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:00.535612 5784 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-home\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:00.537524 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:00.537497 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6bd6631-6581-4335-839b-bd713b746271-tls-certs" pod "a6bd6631-6581-4335-839b-bd713b746271" (UID: "a6bd6631-6581-4335-839b-bd713b746271"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:08:00.537687 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:00.537634 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6bd6631-6581-4335-839b-bd713b746271-kube-api-access-75tdm" pod "a6bd6631-6581-4335-839b-bd713b746271" (UID: "a6bd6631-6581-4335-839b-bd713b746271"). InnerVolumeSpecName "kube-api-access-75tdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:00.537760 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:00.537701 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-dshm" pod "a6bd6631-6581-4335-839b-bd713b746271" (UID: "a6bd6631-6581-4335-839b-bd713b746271"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:00.636822 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:00.636789 5784 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6bd6631-6581-4335-839b-bd713b746271-dshm\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:00.636822 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:00.636823 5784 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6bd6631-6581-4335-839b-bd713b746271-tls-certs\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:00.637004 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:00.636841 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75tdm\" (UniqueName: \"kubernetes.io/projected/a6bd6631-6581-4335-839b-bd713b746271-kube-api-access-75tdm\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:01.176073 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:01.176026 5784 generic.go:356] "Generic (PLEG): container finished" podID="a6bd6631-6581-4335-839b-bd713b746271" containerID="7197d967c90337a1606226c3743daf25392e6cf0a66dd71dc00663e6d514df0b" exitCode=0 Nov 04 06:08:01.176194 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:01.176088 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" Nov 04 06:08:01.176194 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:01.176109 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" event={"ID":"a6bd6631-6581-4335-839b-bd713b746271","Type":"ContainerDied","Data":"7197d967c90337a1606226c3743daf25392e6cf0a66dd71dc00663e6d514df0b"} Nov 04 06:08:01.176194 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:01.176148 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp" event={"ID":"a6bd6631-6581-4335-839b-bd713b746271","Type":"ContainerDied","Data":"5785a8e3bb782536907d45fd5a7fd05655cfe1dbdcf1ae65f08b8c9516debfe4"} Nov 04 06:08:01.176194 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:01.176171 5784 scope.go:122] "RemoveContainer" containerID="7197d967c90337a1606226c3743daf25392e6cf0a66dd71dc00663e6d514df0b" Nov 04 06:08:01.184432 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:01.184414 5784 scope.go:122] "RemoveContainer" containerID="7197d967c90337a1606226c3743daf25392e6cf0a66dd71dc00663e6d514df0b" Nov 04 06:08:01.184696 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:08:01.184677 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7197d967c90337a1606226c3743daf25392e6cf0a66dd71dc00663e6d514df0b\": container with ID starting with 7197d967c90337a1606226c3743daf25392e6cf0a66dd71dc00663e6d514df0b not found: ID does not exist" containerID="7197d967c90337a1606226c3743daf25392e6cf0a66dd71dc00663e6d514df0b" Nov 04 06:08:01.184756 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:01.184710 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7197d967c90337a1606226c3743daf25392e6cf0a66dd71dc00663e6d514df0b"} err="failed to get container status \"7197d967c90337a1606226c3743daf25392e6cf0a66dd71dc00663e6d514df0b\": rpc error: code = NotFound desc = could not find container \"7197d967c90337a1606226c3743daf25392e6cf0a66dd71dc00663e6d514df0b\": container with ID starting with 7197d967c90337a1606226c3743daf25392e6cf0a66dd71dc00663e6d514df0b not found: ID does not exist" Nov 04 06:08:01.357573 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:01.357541 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp"] Nov 04 06:08:01.413194 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:01.413163 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-6b62c0/simulator-w5-6b62c0-kserve-577bd5d6b5-rkkpp"] Nov 04 06:08:03.015283 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:03.015250 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a6bd6631-6581-4335-839b-bd713b746271" path="/var/lib/kubelet/pods/a6bd6631-6581-4335-839b-bd713b746271/volumes" Nov 04 06:08:14.046851 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:14.046763 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm"] Nov 04 06:08:14.047319 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:14.047023 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" podUID="30ac0e57-a72e-410c-ac43-6ddbc262930c" containerName="istio-proxy" containerID="cri-o://340eefbea674c13416e2f54832936ec3bc43d46f321a615d46e116c1bdd78693" gracePeriod=30 Nov 04 06:08:15.418113 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:08:15.418079 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:08:16.361487 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.361458 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj"] Nov 04 06:08:16.361951 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.361935 5784 cpu_manager.go:414] "containerMap: removing container" podUID="43d2e899-72d6-4006-90fd-3c140efca1fd" containerName="main" Nov 04 06:08:16.361996 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.361952 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43d2e899-72d6-4006-90fd-3c140efca1fd" containerName="main" Nov 04 06:08:16.361996 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.361972 5784 cpu_manager.go:414] "containerMap: removing container" podUID="1e10253e-b217-4181-8d04-e3640198d83f" containerName="main" Nov 04 06:08:16.361996 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.361977 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1e10253e-b217-4181-8d04-e3640198d83f" containerName="main" Nov 04 06:08:16.361996 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.361989 5784 cpu_manager.go:414] "containerMap: removing container" podUID="a6bd6631-6581-4335-839b-bd713b746271" containerName="main" Nov 04 06:08:16.361996 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.361993 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a6bd6631-6581-4335-839b-bd713b746271" containerName="main" Nov 04 06:08:16.362189 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.362077 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="43d2e899-72d6-4006-90fd-3c140efca1fd" containerName="main" Nov 04 06:08:16.362189 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.362086 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="1e10253e-b217-4181-8d04-e3640198d83f" containerName="main" Nov 04 06:08:16.362189 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.362093 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="a6bd6631-6581-4335-839b-bd713b746271" containerName="main" Nov 04 06:08:16.365076 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.365052 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.414407 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.414381 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-podinfo\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.414562 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.414433 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-workload-certs\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.414562 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.414550 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-workload-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.414644 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.414586 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-credential-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.414678 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.414653 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istiod-ca-cert\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.414712 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.414683 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-envoy\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.414745 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.414719 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-data\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.414781 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.414750 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b67cz\" (UniqueName: \"kubernetes.io/projected/20e6f162-67a7-4f5a-9cba-280835f9e9eb-kube-api-access-b67cz\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.414876 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.414863 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-token\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.423353 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.423331 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-db31ef-openshift-default-dockercfg-v5k8n\"" Nov 04 06:08:16.480683 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.480648 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj"] Nov 04 06:08:16.516347 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.516314 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-workload-certs\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.516529 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.516359 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-workload-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.516529 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.516402 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-credential-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.516529 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.516423 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istiod-ca-cert\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.516529 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.516441 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-envoy\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.516529 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.516482 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-data\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.516529 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.516504 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b67cz\" (UniqueName: \"kubernetes.io/projected/20e6f162-67a7-4f5a-9cba-280835f9e9eb-kube-api-access-b67cz\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.516832 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.516586 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-token\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.516832 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.516641 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-podinfo\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.516832 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.516718 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-workload-certs\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.516979 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.516835 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-credential-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.516979 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.516722 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-workload-socket\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.517105 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.517044 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-data\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.517248 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.517226 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istiod-ca-cert\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.518981 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.518956 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-envoy\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.519164 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.519121 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-podinfo\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.585905 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.585879 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-token\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.586205 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.586183 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b67cz\" (UniqueName: \"kubernetes.io/projected/20e6f162-67a7-4f5a-9cba-280835f9e9eb-kube-api-access-b67cz\") pod \"e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:16.682141 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:16.682042 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:17.120034 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:17.118486 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj"] Nov 04 06:08:17.122430 ip-10-0-134-45 kubenswrapper[5784]: W1104 06:08:17.121712 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e6f162_67a7_4f5a_9cba_280835f9e9eb.slice/crio-c2e1b5eeae32b96a636c72cecfc853999b92aa6e49616fbcfdce1e63f79cfcec WatchSource:0}: Error finding container c2e1b5eeae32b96a636c72cecfc853999b92aa6e49616fbcfdce1e63f79cfcec: Status 404 returned error can't find the container with id c2e1b5eeae32b96a636c72cecfc853999b92aa6e49616fbcfdce1e63f79cfcec Nov 04 06:08:17.127946 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:17.127906 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:08:17.128045 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:17.127992 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:08:17.128045 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:17.128032 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:08:17.262957 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:17.262916 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" event={"ID":"20e6f162-67a7-4f5a-9cba-280835f9e9eb","Type":"ContainerStarted","Data":"5269fd6a91516ad0b62784c13008214277548d37ba9e7fefbf9da8280081bf5a"} Nov 04 06:08:17.263174 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:17.262971 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" event={"ID":"20e6f162-67a7-4f5a-9cba-280835f9e9eb","Type":"ContainerStarted","Data":"c2e1b5eeae32b96a636c72cecfc853999b92aa6e49616fbcfdce1e63f79cfcec"} Nov 04 06:08:17.404355 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:17.404243 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" podStartSLOduration=1.404226216 podStartE2EDuration="1.404226216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:08:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:08:17.401924433 +0000 UTC m=+1096.538620828" watchObservedRunningTime="2026-11-04 06:08:17.404226216 +0000 UTC m=+1096.540922615" Nov 04 06:08:17.682505 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:17.682426 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:18.298785 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:18.298753 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889"] Nov 04 06:08:18.298965 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:18.298920 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" podUID="795b3a01-e94b-410a-816a-c040f4ec86e8" containerName="maas-api" containerID="cri-o://1d6c667bd4aec4171227cea29fb77ba624e4e70e7659b7dfe5ad7acf8b4103e5" gracePeriod=30 Nov 04 06:08:18.684502 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:18.684468 5784 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Nov 04 06:08:18.684901 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:18.684522 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" podUID="20e6f162-67a7-4f5a-9cba-280835f9e9eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Nov 04 06:08:19.242014 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.241990 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:08:19.298023 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.297983 5784 generic.go:356] "Generic (PLEG): container finished" podID="30ac0e57-a72e-410c-ac43-6ddbc262930c" containerID="340eefbea674c13416e2f54832936ec3bc43d46f321a615d46e116c1bdd78693" exitCode=0 Nov 04 06:08:19.298223 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.298025 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" event={"ID":"30ac0e57-a72e-410c-ac43-6ddbc262930c","Type":"ContainerDied","Data":"340eefbea674c13416e2f54832936ec3bc43d46f321a615d46e116c1bdd78693"} Nov 04 06:08:19.298223 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.298043 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" Nov 04 06:08:19.298223 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.298137 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm" event={"ID":"30ac0e57-a72e-410c-ac43-6ddbc262930c","Type":"ContainerDied","Data":"381ded715e8673db287ff2c32144a77b059e4bbd52da0567927fcb6817486ab9"} Nov 04 06:08:19.298223 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.298171 5784 scope.go:122] "RemoveContainer" containerID="340eefbea674c13416e2f54832936ec3bc43d46f321a615d46e116c1bdd78693" Nov 04 06:08:19.309279 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.309257 5784 scope.go:122] "RemoveContainer" containerID="340eefbea674c13416e2f54832936ec3bc43d46f321a615d46e116c1bdd78693" Nov 04 06:08:19.309697 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:08:19.309635 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"340eefbea674c13416e2f54832936ec3bc43d46f321a615d46e116c1bdd78693\": container with ID starting with 340eefbea674c13416e2f54832936ec3bc43d46f321a615d46e116c1bdd78693 not found: ID does not exist" containerID="340eefbea674c13416e2f54832936ec3bc43d46f321a615d46e116c1bdd78693" Nov 04 06:08:19.309697 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.309675 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"340eefbea674c13416e2f54832936ec3bc43d46f321a615d46e116c1bdd78693"} err="failed to get container status \"340eefbea674c13416e2f54832936ec3bc43d46f321a615d46e116c1bdd78693\": rpc error: code = NotFound desc = could not find container \"340eefbea674c13416e2f54832936ec3bc43d46f321a615d46e116c1bdd78693\": container with ID starting with 340eefbea674c13416e2f54832936ec3bc43d46f321a615d46e116c1bdd78693 not found: ID does not exist" Nov 04 06:08:19.361137 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.350328 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-credential-socket\") pod \"30ac0e57-a72e-410c-ac43-6ddbc262930c\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " Nov 04 06:08:19.361137 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.350388 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/30ac0e57-a72e-410c-ac43-6ddbc262930c-kube-api-access-w7x8f\" (UniqueName: \"kubernetes.io/projected/30ac0e57-a72e-410c-ac43-6ddbc262930c-kube-api-access-w7x8f\") pod \"30ac0e57-a72e-410c-ac43-6ddbc262930c\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " Nov 04 06:08:19.361137 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.350432 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-token\" (UniqueName: \"kubernetes.io/projected/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-token\") pod \"30ac0e57-a72e-410c-ac43-6ddbc262930c\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " Nov 04 06:08:19.361137 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.350488 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-podinfo\") pod \"30ac0e57-a72e-410c-ac43-6ddbc262930c\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " Nov 04 06:08:19.361137 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.350604 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-data\") pod \"30ac0e57-a72e-410c-ac43-6ddbc262930c\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " Nov 04 06:08:19.361137 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.350657 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-envoy\") pod \"30ac0e57-a72e-410c-ac43-6ddbc262930c\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " Nov 04 06:08:19.361137 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.350742 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/30ac0e57-a72e-410c-ac43-6ddbc262930c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30ac0e57-a72e-410c-ac43-6ddbc262930c-istiod-ca-cert\") pod \"30ac0e57-a72e-410c-ac43-6ddbc262930c\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " Nov 04 06:08:19.361137 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.350808 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-workload-socket\") pod \"30ac0e57-a72e-410c-ac43-6ddbc262930c\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " Nov 04 06:08:19.361137 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.350839 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-workload-certs\") pod \"30ac0e57-a72e-410c-ac43-6ddbc262930c\" (UID: \"30ac0e57-a72e-410c-ac43-6ddbc262930c\") " Nov 04 06:08:19.364565 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.364251 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30ac0e57-a72e-410c-ac43-6ddbc262930c-istiod-ca-cert" pod "30ac0e57-a72e-410c-ac43-6ddbc262930c" (UID: "30ac0e57-a72e-410c-ac43-6ddbc262930c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:08:19.370559 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.370507 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-credential-socket" pod "30ac0e57-a72e-410c-ac43-6ddbc262930c" (UID: "30ac0e57-a72e-410c-ac43-6ddbc262930c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:19.370783 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.370757 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-workload-socket" pod "30ac0e57-a72e-410c-ac43-6ddbc262930c" (UID: "30ac0e57-a72e-410c-ac43-6ddbc262930c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:19.371190 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.371168 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-workload-certs" pod "30ac0e57-a72e-410c-ac43-6ddbc262930c" (UID: "30ac0e57-a72e-410c-ac43-6ddbc262930c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:19.373385 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.372314 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-data" pod "30ac0e57-a72e-410c-ac43-6ddbc262930c" (UID: "30ac0e57-a72e-410c-ac43-6ddbc262930c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:19.383746 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.383638 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-token" pod "30ac0e57-a72e-410c-ac43-6ddbc262930c" (UID: "30ac0e57-a72e-410c-ac43-6ddbc262930c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:19.383853 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.383771 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-podinfo" pod "30ac0e57-a72e-410c-ac43-6ddbc262930c" (UID: "30ac0e57-a72e-410c-ac43-6ddbc262930c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:08:19.384960 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.384928 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30ac0e57-a72e-410c-ac43-6ddbc262930c-kube-api-access-w7x8f" pod "30ac0e57-a72e-410c-ac43-6ddbc262930c" (UID: "30ac0e57-a72e-410c-ac43-6ddbc262930c"). InnerVolumeSpecName "kube-api-access-w7x8f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:19.385293 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.385271 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-envoy" pod "30ac0e57-a72e-410c-ac43-6ddbc262930c" (UID: "30ac0e57-a72e-410c-ac43-6ddbc262930c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:19.468092 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.464824 5784 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30ac0e57-a72e-410c-ac43-6ddbc262930c-istiod-ca-cert\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:19.468092 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.464870 5784 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-workload-socket\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:19.468092 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.464887 5784 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-workload-certs\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:19.468092 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.464904 5784 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-credential-socket\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:19.468092 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.464919 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7x8f\" (UniqueName: \"kubernetes.io/projected/30ac0e57-a72e-410c-ac43-6ddbc262930c-kube-api-access-w7x8f\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:19.468092 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.464934 5784 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-token\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:19.468092 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.464947 5784 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-podinfo\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:19.468092 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.464960 5784 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-data\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:19.468092 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.464973 5784 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30ac0e57-a72e-410c-ac43-6ddbc262930c-istio-envoy\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:19.524151 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.524120 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n"] Nov 04 06:08:19.524369 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.524344 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" podUID="3041ac2c-1f12-4e2c-b8fc-a387938b7ead" containerName="maas-api" containerID="cri-o://ce305d04da4131c01859198fc0eb0133bfefa63682f6cb1f7ec7bf9dc176cc60" gracePeriod=30 Nov 04 06:08:19.604476 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.604453 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" Nov 04 06:08:19.675145 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.674352 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/795b3a01-e94b-410a-816a-c040f4ec86e8-metrics-certs\" (UniqueName: \"kubernetes.io/secret/795b3a01-e94b-410a-816a-c040f4ec86e8-metrics-certs\") pod \"795b3a01-e94b-410a-816a-c040f4ec86e8\" (UID: \"795b3a01-e94b-410a-816a-c040f4ec86e8\") " Nov 04 06:08:19.675145 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.674425 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/795b3a01-e94b-410a-816a-c040f4ec86e8-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/795b3a01-e94b-410a-816a-c040f4ec86e8-openshift-service-ca\") pod \"795b3a01-e94b-410a-816a-c040f4ec86e8\" (UID: \"795b3a01-e94b-410a-816a-c040f4ec86e8\") " Nov 04 06:08:19.675145 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.674612 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/795b3a01-e94b-410a-816a-c040f4ec86e8-kube-api-access-twszf\" (UniqueName: \"kubernetes.io/projected/795b3a01-e94b-410a-816a-c040f4ec86e8-kube-api-access-twszf\") pod \"795b3a01-e94b-410a-816a-c040f4ec86e8\" (UID: \"795b3a01-e94b-410a-816a-c040f4ec86e8\") " Nov 04 06:08:19.675145 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.674696 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/795b3a01-e94b-410a-816a-c040f4ec86e8-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/795b3a01-e94b-410a-816a-c040f4ec86e8-maas-api-tls\") pod \"795b3a01-e94b-410a-816a-c040f4ec86e8\" (UID: \"795b3a01-e94b-410a-816a-c040f4ec86e8\") " Nov 04 06:08:19.680122 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.675711 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/795b3a01-e94b-410a-816a-c040f4ec86e8-openshift-service-ca" pod "795b3a01-e94b-410a-816a-c040f4ec86e8" (UID: "795b3a01-e94b-410a-816a-c040f4ec86e8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:08:19.680709 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.680679 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/795b3a01-e94b-410a-816a-c040f4ec86e8-kube-api-access-twszf" pod "795b3a01-e94b-410a-816a-c040f4ec86e8" (UID: "795b3a01-e94b-410a-816a-c040f4ec86e8"). InnerVolumeSpecName "kube-api-access-twszf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:19.681014 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.680978 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/795b3a01-e94b-410a-816a-c040f4ec86e8-maas-api-tls" pod "795b3a01-e94b-410a-816a-c040f4ec86e8" (UID: "795b3a01-e94b-410a-816a-c040f4ec86e8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:08:19.681131 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.681011 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/795b3a01-e94b-410a-816a-c040f4ec86e8-metrics-certs" pod "795b3a01-e94b-410a-816a-c040f4ec86e8" (UID: "795b3a01-e94b-410a-816a-c040f4ec86e8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:08:19.683373 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.683344 5784 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Nov 04 06:08:19.683473 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.683385 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" podUID="20e6f162-67a7-4f5a-9cba-280835f9e9eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Nov 04 06:08:19.778909 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.778872 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twszf\" (UniqueName: \"kubernetes.io/projected/795b3a01-e94b-410a-816a-c040f4ec86e8-kube-api-access-twszf\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:19.779347 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.778914 5784 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/795b3a01-e94b-410a-816a-c040f4ec86e8-maas-api-tls\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:19.779347 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.778931 5784 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/795b3a01-e94b-410a-816a-c040f4ec86e8-metrics-certs\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:19.779347 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.778945 5784 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/795b3a01-e94b-410a-816a-c040f4ec86e8-openshift-service-ca\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:19.791078 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.791033 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm"] Nov 04 06:08:19.795309 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:19.795283 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm"] Nov 04 06:08:20.308049 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:20.308013 5784 generic.go:356] "Generic (PLEG): container finished" podID="795b3a01-e94b-410a-816a-c040f4ec86e8" containerID="1d6c667bd4aec4171227cea29fb77ba624e4e70e7659b7dfe5ad7acf8b4103e5" exitCode=0 Nov 04 06:08:20.308239 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:20.308085 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" event={"ID":"795b3a01-e94b-410a-816a-c040f4ec86e8","Type":"ContainerDied","Data":"1d6c667bd4aec4171227cea29fb77ba624e4e70e7659b7dfe5ad7acf8b4103e5"} Nov 04 06:08:20.308239 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:20.308099 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" Nov 04 06:08:20.308239 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:20.308139 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889" event={"ID":"795b3a01-e94b-410a-816a-c040f4ec86e8","Type":"ContainerDied","Data":"8b18d0fdeaac9c5b011ae3443b5a8aff893829e1c25aac04c48e941815fdf04e"} Nov 04 06:08:20.308239 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:20.308187 5784 scope.go:122] "RemoveContainer" containerID="1d6c667bd4aec4171227cea29fb77ba624e4e70e7659b7dfe5ad7acf8b4103e5" Nov 04 06:08:20.319777 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:20.319172 5784 scope.go:122] "RemoveContainer" containerID="1d6c667bd4aec4171227cea29fb77ba624e4e70e7659b7dfe5ad7acf8b4103e5" Nov 04 06:08:20.319777 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:08:20.319646 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d6c667bd4aec4171227cea29fb77ba624e4e70e7659b7dfe5ad7acf8b4103e5\": container with ID starting with 1d6c667bd4aec4171227cea29fb77ba624e4e70e7659b7dfe5ad7acf8b4103e5 not found: ID does not exist" containerID="1d6c667bd4aec4171227cea29fb77ba624e4e70e7659b7dfe5ad7acf8b4103e5" Nov 04 06:08:20.319777 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:20.319682 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d6c667bd4aec4171227cea29fb77ba624e4e70e7659b7dfe5ad7acf8b4103e5"} err="failed to get container status \"1d6c667bd4aec4171227cea29fb77ba624e4e70e7659b7dfe5ad7acf8b4103e5\": rpc error: code = NotFound desc = could not find container \"1d6c667bd4aec4171227cea29fb77ba624e4e70e7659b7dfe5ad7acf8b4103e5\": container with ID starting with 1d6c667bd4aec4171227cea29fb77ba624e4e70e7659b7dfe5ad7acf8b4103e5 not found: ID does not exist" Nov 04 06:08:20.498083 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:20.497964 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889"] Nov 04 06:08:20.514025 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:20.513991 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-18990c-6755674b87-pn889"] Nov 04 06:08:20.682999 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:20.682966 5784 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Nov 04 06:08:20.683176 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:20.683026 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" podUID="20e6f162-67a7-4f5a-9cba-280835f9e9eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Nov 04 06:08:20.839424 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:20.839391 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" Nov 04 06:08:20.993874 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:20.993825 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-maas-api-tls\") pod \"3041ac2c-1f12-4e2c-b8fc-a387938b7ead\" (UID: \"3041ac2c-1f12-4e2c-b8fc-a387938b7ead\") " Nov 04 06:08:20.994171 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:20.993980 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-kube-api-access-gfgqv\" (UniqueName: \"kubernetes.io/projected/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-kube-api-access-gfgqv\") pod \"3041ac2c-1f12-4e2c-b8fc-a387938b7ead\" (UID: \"3041ac2c-1f12-4e2c-b8fc-a387938b7ead\") " Nov 04 06:08:20.994171 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:20.994013 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-metrics-certs\" (UniqueName: \"kubernetes.io/secret/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-metrics-certs\") pod \"3041ac2c-1f12-4e2c-b8fc-a387938b7ead\" (UID: \"3041ac2c-1f12-4e2c-b8fc-a387938b7ead\") " Nov 04 06:08:20.994171 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:20.994132 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-openshift-service-ca\") pod \"3041ac2c-1f12-4e2c-b8fc-a387938b7ead\" (UID: \"3041ac2c-1f12-4e2c-b8fc-a387938b7ead\") " Nov 04 06:08:20.994534 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:20.994485 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-openshift-service-ca" pod "3041ac2c-1f12-4e2c-b8fc-a387938b7ead" (UID: "3041ac2c-1f12-4e2c-b8fc-a387938b7ead"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:08:20.994632 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:20.994600 5784 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-openshift-service-ca\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:20.996501 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:20.996476 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-kube-api-access-gfgqv" pod "3041ac2c-1f12-4e2c-b8fc-a387938b7ead" (UID: "3041ac2c-1f12-4e2c-b8fc-a387938b7ead"). InnerVolumeSpecName "kube-api-access-gfgqv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:20.996827 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:20.996798 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-maas-api-tls" pod "3041ac2c-1f12-4e2c-b8fc-a387938b7ead" (UID: "3041ac2c-1f12-4e2c-b8fc-a387938b7ead"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:08:20.996978 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:20.996957 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-metrics-certs" pod "3041ac2c-1f12-4e2c-b8fc-a387938b7ead" (UID: "3041ac2c-1f12-4e2c-b8fc-a387938b7ead"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:08:21.016022 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:21.015991 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="30ac0e57-a72e-410c-ac43-6ddbc262930c" path="/var/lib/kubelet/pods/30ac0e57-a72e-410c-ac43-6ddbc262930c/volumes" Nov 04 06:08:21.016505 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:21.016483 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="795b3a01-e94b-410a-816a-c040f4ec86e8" path="/var/lib/kubelet/pods/795b3a01-e94b-410a-816a-c040f4ec86e8/volumes" Nov 04 06:08:21.095837 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:21.095802 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfgqv\" (UniqueName: \"kubernetes.io/projected/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-kube-api-access-gfgqv\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:21.095837 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:21.095832 5784 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-metrics-certs\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:21.095837 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:21.095841 5784 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3041ac2c-1f12-4e2c-b8fc-a387938b7ead-maas-api-tls\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:21.316016 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:21.315977 5784 generic.go:356] "Generic (PLEG): container finished" podID="3041ac2c-1f12-4e2c-b8fc-a387938b7ead" containerID="ce305d04da4131c01859198fc0eb0133bfefa63682f6cb1f7ec7bf9dc176cc60" exitCode=0 Nov 04 06:08:21.316188 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:21.316028 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" Nov 04 06:08:21.316188 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:21.316080 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" event={"ID":"3041ac2c-1f12-4e2c-b8fc-a387938b7ead","Type":"ContainerDied","Data":"ce305d04da4131c01859198fc0eb0133bfefa63682f6cb1f7ec7bf9dc176cc60"} Nov 04 06:08:21.316188 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:21.316133 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n" event={"ID":"3041ac2c-1f12-4e2c-b8fc-a387938b7ead","Type":"ContainerDied","Data":"fbb442056f9f3cd190ece747db3835782b07ded5f5a6b2134614b23451eb0caa"} Nov 04 06:08:21.316188 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:21.316155 5784 scope.go:122] "RemoveContainer" containerID="ce305d04da4131c01859198fc0eb0133bfefa63682f6cb1f7ec7bf9dc176cc60" Nov 04 06:08:21.325957 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:21.325939 5784 scope.go:122] "RemoveContainer" containerID="ce305d04da4131c01859198fc0eb0133bfefa63682f6cb1f7ec7bf9dc176cc60" Nov 04 06:08:21.326244 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:08:21.326222 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce305d04da4131c01859198fc0eb0133bfefa63682f6cb1f7ec7bf9dc176cc60\": container with ID starting with ce305d04da4131c01859198fc0eb0133bfefa63682f6cb1f7ec7bf9dc176cc60 not found: ID does not exist" containerID="ce305d04da4131c01859198fc0eb0133bfefa63682f6cb1f7ec7bf9dc176cc60" Nov 04 06:08:21.326300 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:21.326253 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce305d04da4131c01859198fc0eb0133bfefa63682f6cb1f7ec7bf9dc176cc60"} err="failed to get container status \"ce305d04da4131c01859198fc0eb0133bfefa63682f6cb1f7ec7bf9dc176cc60\": rpc error: code = NotFound desc = could not find container \"ce305d04da4131c01859198fc0eb0133bfefa63682f6cb1f7ec7bf9dc176cc60\": container with ID starting with ce305d04da4131c01859198fc0eb0133bfefa63682f6cb1f7ec7bf9dc176cc60 not found: ID does not exist" Nov 04 06:08:21.502739 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:21.502666 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n"] Nov 04 06:08:21.506450 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:21.506420 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-356418-5f4c9cb54f-sjk9n"] Nov 04 06:08:21.683444 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:21.683406 5784 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Nov 04 06:08:21.683623 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:21.683458 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" podUID="20e6f162-67a7-4f5a-9cba-280835f9e9eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Nov 04 06:08:22.682620 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:22.682577 5784 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Nov 04 06:08:22.683023 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:22.682646 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" podUID="20e6f162-67a7-4f5a-9cba-280835f9e9eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Nov 04 06:08:23.021499 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:23.021432 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3041ac2c-1f12-4e2c-b8fc-a387938b7ead" path="/var/lib/kubelet/pods/3041ac2c-1f12-4e2c-b8fc-a387938b7ead/volumes" Nov 04 06:08:23.682928 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:23.682887 5784 patch_prober.go:29] interesting pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Nov 04 06:08:23.683478 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:23.682956 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" podUID="20e6f162-67a7-4f5a-9cba-280835f9e9eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Nov 04 06:08:24.711247 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:24.711213 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:24.711774 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:24.711564 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:24.713132 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:24.713110 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:08:31.813878 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:31.813841 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7"] Nov 04 06:08:31.814316 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:31.814039 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" podUID="a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4" containerName="maas-api" containerID="cri-o://625f49b83740e6a1fd7dbc16d0dee6985d529f716143df6416e6d3035a56213d" gracePeriod=30 Nov 04 06:08:33.065586 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:33.065562 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" Nov 04 06:08:33.233370 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:33.233292 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-maas-api-tls\") pod \"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4\" (UID: \"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4\") " Nov 04 06:08:33.233528 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:33.233386 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-kube-api-access-trfl7\" (UniqueName: \"kubernetes.io/projected/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-kube-api-access-trfl7\") pod \"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4\" (UID: \"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4\") " Nov 04 06:08:33.233528 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:33.233424 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-openshift-service-ca\") pod \"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4\" (UID: \"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4\") " Nov 04 06:08:33.233528 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:33.233439 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-metrics-certs\") pod \"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4\" (UID: \"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4\") " Nov 04 06:08:33.234051 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:33.234022 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-openshift-service-ca" pod "a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4" (UID: "a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:08:33.236141 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:33.236111 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-maas-api-tls" pod "a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4" (UID: "a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:08:33.237381 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:33.237356 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-kube-api-access-trfl7" pod "a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4" (UID: "a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4"). InnerVolumeSpecName "kube-api-access-trfl7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:33.237526 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:33.237498 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-metrics-certs" pod "a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4" (UID: "a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:08:33.335222 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:33.335186 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trfl7\" (UniqueName: \"kubernetes.io/projected/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-kube-api-access-trfl7\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:33.335222 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:33.335219 5784 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-openshift-service-ca\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:33.335435 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:33.335235 5784 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-metrics-certs\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:33.335435 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:33.335248 5784 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4-maas-api-tls\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:33.384802 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:33.384770 5784 generic.go:356] "Generic (PLEG): container finished" podID="a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4" containerID="625f49b83740e6a1fd7dbc16d0dee6985d529f716143df6416e6d3035a56213d" exitCode=0 Nov 04 06:08:33.384958 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:33.384812 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" Nov 04 06:08:33.384958 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:33.384831 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" event={"ID":"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4","Type":"ContainerDied","Data":"625f49b83740e6a1fd7dbc16d0dee6985d529f716143df6416e6d3035a56213d"} Nov 04 06:08:33.384958 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:33.384880 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7" event={"ID":"a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4","Type":"ContainerDied","Data":"6c47ebecc8fa56ec28e7f8681d5e1b1be0ec66bcd05c69c363cfd2dcc7bcca7e"} Nov 04 06:08:33.384958 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:33.384915 5784 scope.go:122] "RemoveContainer" containerID="625f49b83740e6a1fd7dbc16d0dee6985d529f716143df6416e6d3035a56213d" Nov 04 06:08:33.393923 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:33.393908 5784 scope.go:122] "RemoveContainer" containerID="625f49b83740e6a1fd7dbc16d0dee6985d529f716143df6416e6d3035a56213d" Nov 04 06:08:33.394205 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:08:33.394185 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"625f49b83740e6a1fd7dbc16d0dee6985d529f716143df6416e6d3035a56213d\": container with ID starting with 625f49b83740e6a1fd7dbc16d0dee6985d529f716143df6416e6d3035a56213d not found: ID does not exist" containerID="625f49b83740e6a1fd7dbc16d0dee6985d529f716143df6416e6d3035a56213d" Nov 04 06:08:33.394279 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:33.394211 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"625f49b83740e6a1fd7dbc16d0dee6985d529f716143df6416e6d3035a56213d"} err="failed to get container status \"625f49b83740e6a1fd7dbc16d0dee6985d529f716143df6416e6d3035a56213d\": rpc error: code = NotFound desc = could not find container \"625f49b83740e6a1fd7dbc16d0dee6985d529f716143df6416e6d3035a56213d\": container with ID starting with 625f49b83740e6a1fd7dbc16d0dee6985d529f716143df6416e6d3035a56213d not found: ID does not exist" Nov 04 06:08:33.565882 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:33.565805 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7"] Nov 04 06:08:33.567880 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:33.567858 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-6b62c0-649fb8c85c-wmhw7"] Nov 04 06:08:35.014431 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:35.014400 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4" path="/var/lib/kubelet/pods/a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4/volumes" Nov 04 06:08:39.934307 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:39.934272 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:08:44.294217 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:44.294186 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9"] Nov 04 06:08:44.294665 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:44.294400 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" podUID="969cda36-4b05-4d9b-b695-e3ea82cad956" containerName="istio-proxy" containerID="cri-o://cd6b0b87ae0e5dbfeb35771dcfb9f9cf3f102406f748fb45223d59a9288ab897" gracePeriod=30 Nov 04 06:08:45.417619 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:08:45.417582 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:08:49.472191 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.471898 5784 generic.go:356] "Generic (PLEG): container finished" podID="969cda36-4b05-4d9b-b695-e3ea82cad956" containerID="cd6b0b87ae0e5dbfeb35771dcfb9f9cf3f102406f748fb45223d59a9288ab897" exitCode=0 Nov 04 06:08:49.472191 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.471968 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" event={"ID":"969cda36-4b05-4d9b-b695-e3ea82cad956","Type":"ContainerDied","Data":"cd6b0b87ae0e5dbfeb35771dcfb9f9cf3f102406f748fb45223d59a9288ab897"} Nov 04 06:08:49.552143 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.552118 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:08:49.605938 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.605910 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/969cda36-4b05-4d9b-b695-e3ea82cad956-kube-api-access-4cdtw\" (UniqueName: \"kubernetes.io/projected/969cda36-4b05-4d9b-b695-e3ea82cad956-kube-api-access-4cdtw\") pod \"969cda36-4b05-4d9b-b695-e3ea82cad956\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " Nov 04 06:08:49.606143 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.605947 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-envoy\") pod \"969cda36-4b05-4d9b-b695-e3ea82cad956\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " Nov 04 06:08:49.606143 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.605979 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-data\") pod \"969cda36-4b05-4d9b-b695-e3ea82cad956\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " Nov 04 06:08:49.606143 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.606035 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/969cda36-4b05-4d9b-b695-e3ea82cad956-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/969cda36-4b05-4d9b-b695-e3ea82cad956-istiod-ca-cert\") pod \"969cda36-4b05-4d9b-b695-e3ea82cad956\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " Nov 04 06:08:49.606143 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.606103 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-podinfo\") pod \"969cda36-4b05-4d9b-b695-e3ea82cad956\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " Nov 04 06:08:49.606143 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.606140 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-workload-certs\") pod \"969cda36-4b05-4d9b-b695-e3ea82cad956\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " Nov 04 06:08:49.606422 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.606188 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-token\" (UniqueName: \"kubernetes.io/projected/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-token\") pod \"969cda36-4b05-4d9b-b695-e3ea82cad956\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " Nov 04 06:08:49.606422 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.606213 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-workload-socket\") pod \"969cda36-4b05-4d9b-b695-e3ea82cad956\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " Nov 04 06:08:49.606422 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.606277 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-credential-socket\") pod \"969cda36-4b05-4d9b-b695-e3ea82cad956\" (UID: \"969cda36-4b05-4d9b-b695-e3ea82cad956\") " Nov 04 06:08:49.606422 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.606309 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-data" pod "969cda36-4b05-4d9b-b695-e3ea82cad956" (UID: "969cda36-4b05-4d9b-b695-e3ea82cad956"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:49.606653 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.606446 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/969cda36-4b05-4d9b-b695-e3ea82cad956-istiod-ca-cert" pod "969cda36-4b05-4d9b-b695-e3ea82cad956" (UID: "969cda36-4b05-4d9b-b695-e3ea82cad956"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:08:49.606710 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.606653 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-credential-socket" pod "969cda36-4b05-4d9b-b695-e3ea82cad956" (UID: "969cda36-4b05-4d9b-b695-e3ea82cad956"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:49.606767 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.606733 5784 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-credential-socket\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:49.606767 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.606752 5784 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-data\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:49.606869 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.606766 5784 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/969cda36-4b05-4d9b-b695-e3ea82cad956-istiod-ca-cert\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:49.606869 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.606785 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-workload-certs" pod "969cda36-4b05-4d9b-b695-e3ea82cad956" (UID: "969cda36-4b05-4d9b-b695-e3ea82cad956"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:49.606869 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.606592 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-workload-socket" pod "969cda36-4b05-4d9b-b695-e3ea82cad956" (UID: "969cda36-4b05-4d9b-b695-e3ea82cad956"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:49.608392 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.608362 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-envoy" pod "969cda36-4b05-4d9b-b695-e3ea82cad956" (UID: "969cda36-4b05-4d9b-b695-e3ea82cad956"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:08:49.608510 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.608395 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-token" pod "969cda36-4b05-4d9b-b695-e3ea82cad956" (UID: "969cda36-4b05-4d9b-b695-e3ea82cad956"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:49.608510 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.608423 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-podinfo" pod "969cda36-4b05-4d9b-b695-e3ea82cad956" (UID: "969cda36-4b05-4d9b-b695-e3ea82cad956"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:08:49.608604 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.608520 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/969cda36-4b05-4d9b-b695-e3ea82cad956-kube-api-access-4cdtw" pod "969cda36-4b05-4d9b-b695-e3ea82cad956" (UID: "969cda36-4b05-4d9b-b695-e3ea82cad956"). InnerVolumeSpecName "kube-api-access-4cdtw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:08:49.707576 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.707546 5784 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-workload-certs\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:49.707576 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.707572 5784 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-token\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:49.707576 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.707581 5784 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-workload-socket\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:49.707821 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.707592 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cdtw\" (UniqueName: \"kubernetes.io/projected/969cda36-4b05-4d9b-b695-e3ea82cad956-kube-api-access-4cdtw\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:49.707821 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.707602 5784 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-envoy\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:49.707821 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:49.707611 5784 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/969cda36-4b05-4d9b-b695-e3ea82cad956-istio-podinfo\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:08:50.477919 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:50.477885 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" Nov 04 06:08:50.477919 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:50.477896 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9" event={"ID":"969cda36-4b05-4d9b-b695-e3ea82cad956","Type":"ContainerDied","Data":"21fb368d541c2791833b99445f0fe1f6aa0207c9ec25ed18dbc68c9c40519062"} Nov 04 06:08:50.478499 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:50.477968 5784 scope.go:122] "RemoveContainer" containerID="cd6b0b87ae0e5dbfeb35771dcfb9f9cf3f102406f748fb45223d59a9288ab897" Nov 04 06:08:50.715411 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:50.715371 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9"] Nov 04 06:08:50.772197 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:50.772122 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9"] Nov 04 06:08:51.015198 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:08:51.015161 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="969cda36-4b05-4d9b-b695-e3ea82cad956" path="/var/lib/kubelet/pods/969cda36-4b05-4d9b-b695-e3ea82cad956/volumes" Nov 04 06:09:00.294181 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.294149 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd"] Nov 04 06:09:00.294724 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.294613 5784 cpu_manager.go:414] "containerMap: removing container" podUID="30ac0e57-a72e-410c-ac43-6ddbc262930c" containerName="istio-proxy" Nov 04 06:09:00.294724 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.294629 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="30ac0e57-a72e-410c-ac43-6ddbc262930c" containerName="istio-proxy" Nov 04 06:09:00.294724 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.294642 5784 cpu_manager.go:414] "containerMap: removing container" podUID="3041ac2c-1f12-4e2c-b8fc-a387938b7ead" containerName="maas-api" Nov 04 06:09:00.294724 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.294647 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3041ac2c-1f12-4e2c-b8fc-a387938b7ead" containerName="maas-api" Nov 04 06:09:00.294724 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.294703 5784 cpu_manager.go:414] "containerMap: removing container" podUID="a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4" containerName="maas-api" Nov 04 06:09:00.294724 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.294712 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4" containerName="maas-api" Nov 04 06:09:00.294724 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.294726 5784 cpu_manager.go:414] "containerMap: removing container" podUID="969cda36-4b05-4d9b-b695-e3ea82cad956" containerName="istio-proxy" Nov 04 06:09:00.295187 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.294733 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="969cda36-4b05-4d9b-b695-e3ea82cad956" containerName="istio-proxy" Nov 04 06:09:00.295187 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.294745 5784 cpu_manager.go:414] "containerMap: removing container" podUID="795b3a01-e94b-410a-816a-c040f4ec86e8" containerName="maas-api" Nov 04 06:09:00.295187 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.294751 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="795b3a01-e94b-410a-816a-c040f4ec86e8" containerName="maas-api" Nov 04 06:09:00.295187 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.294853 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="a23da9f7-5ec2-4c17-ab34-ee9d303f2ee4" containerName="maas-api" Nov 04 06:09:00.295187 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.294866 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="969cda36-4b05-4d9b-b695-e3ea82cad956" containerName="istio-proxy" Nov 04 06:09:00.295187 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.294872 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="795b3a01-e94b-410a-816a-c040f4ec86e8" containerName="maas-api" Nov 04 06:09:00.295187 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.294879 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="30ac0e57-a72e-410c-ac43-6ddbc262930c" containerName="istio-proxy" Nov 04 06:09:00.295187 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.294886 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="3041ac2c-1f12-4e2c-b8fc-a387938b7ead" containerName="maas-api" Nov 04 06:09:00.299618 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.299601 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.400754 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.400718 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd"] Nov 04 06:09:00.417893 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.417858 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.417893 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.417893 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.418173 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.417926 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f400444-178f-4421-80f9-c8c9288651a7-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.418173 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.418084 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f400444-178f-4421-80f9-c8c9288651a7-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.418256 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.418192 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42v7b\" (UniqueName: \"kubernetes.io/projected/7f400444-178f-4421-80f9-c8c9288651a7-kube-api-access-42v7b\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.418303 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.418258 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.418359 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.418339 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.418417 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.418400 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f400444-178f-4421-80f9-c8c9288651a7-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.418508 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.418492 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.519447 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.519417 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.519651 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.519456 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.519651 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.519474 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.519651 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.519515 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f400444-178f-4421-80f9-c8c9288651a7-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.519651 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.519533 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f400444-178f-4421-80f9-c8c9288651a7-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.519651 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.519577 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42v7b\" (UniqueName: \"kubernetes.io/projected/7f400444-178f-4421-80f9-c8c9288651a7-kube-api-access-42v7b\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.519651 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.519629 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.519969 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.519683 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.519969 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.519712 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f400444-178f-4421-80f9-c8c9288651a7-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.519969 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.519896 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.519969 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.519935 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.520147 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.520003 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.520238 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.520213 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.520300 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.520280 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f400444-178f-4421-80f9-c8c9288651a7-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.521924 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.521902 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.522164 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.522142 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f400444-178f-4421-80f9-c8c9288651a7-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.585936 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.585909 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f400444-178f-4421-80f9-c8c9288651a7-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.586122 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.586085 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42v7b\" (UniqueName: \"kubernetes.io/projected/7f400444-178f-4421-80f9-c8c9288651a7-kube-api-access-42v7b\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:00.612483 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:00.612460 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:01.051304 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:01.051282 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd"] Nov 04 06:09:01.053165 ip-10-0-134-45 kubenswrapper[5784]: W1104 06:09:01.053127 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f400444_178f_4421_80f9_c8c9288651a7.slice/crio-cac9c6c093b91f617920c095cbd85e292c643b99ce0020bf735eb99e23c1403d WatchSource:0}: Error finding container cac9c6c093b91f617920c095cbd85e292c643b99ce0020bf735eb99e23c1403d: Status 404 returned error can't find the container with id cac9c6c093b91f617920c095cbd85e292c643b99ce0020bf735eb99e23c1403d Nov 04 06:09:01.059822 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:01.059670 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:09:01.059822 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:01.059817 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:09:01.059940 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:01.059893 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:09:01.540040 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:01.539999 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" event={"ID":"7f400444-178f-4421-80f9-c8c9288651a7","Type":"ContainerStarted","Data":"3ef4988593a4d87ed03c4c527b1205aa48ce74abd79e9ffd2c1c65ec223f0f7b"} Nov 04 06:09:01.540454 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:01.540123 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" event={"ID":"7f400444-178f-4421-80f9-c8c9288651a7","Type":"ContainerStarted","Data":"cac9c6c093b91f617920c095cbd85e292c643b99ce0020bf735eb99e23c1403d"} Nov 04 06:09:01.613379 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:01.613335 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:01.676751 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:01.676686 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" podStartSLOduration=1.676667624 podStartE2EDuration="1.676667624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:09:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:09:01.67574939 +0000 UTC m=+1140.812445788" watchObservedRunningTime="2026-11-04 06:09:01.676667624 +0000 UTC m=+1140.813364023" Nov 04 06:09:02.614893 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:02.614856 5784 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Nov 04 06:09:02.615314 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:02.614911 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" podUID="7f400444-178f-4421-80f9-c8c9288651a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Nov 04 06:09:03.487805 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:03.487768 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75"] Nov 04 06:09:03.613162 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:03.613125 5784 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Nov 04 06:09:03.613335 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:03.613173 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" podUID="7f400444-178f-4421-80f9-c8c9288651a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Nov 04 06:09:04.613366 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:04.613330 5784 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Nov 04 06:09:04.613751 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:04.613398 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" podUID="7f400444-178f-4421-80f9-c8c9288651a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Nov 04 06:09:05.613433 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:05.613398 5784 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Nov 04 06:09:05.613846 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:05.613454 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" podUID="7f400444-178f-4421-80f9-c8c9288651a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Nov 04 06:09:06.613912 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:06.613880 5784 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Nov 04 06:09:06.614424 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:06.613937 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" podUID="7f400444-178f-4421-80f9-c8c9288651a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Nov 04 06:09:07.613071 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:07.613029 5784 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Nov 04 06:09:07.613243 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:07.613095 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" podUID="7f400444-178f-4421-80f9-c8c9288651a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Nov 04 06:09:08.617355 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:08.617324 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:08.617851 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:08.617697 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:08.618533 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:08.618494 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:08.988773 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:08.988691 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:09:15.418152 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:09:15.418112 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:09:18.507944 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:18.507875 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" podUID="dba3c05a-be4e-49c8-b02e-f7024af3da05" containerName="main" containerID="cri-o://fc648b341aae789d4f4f00b8259b3e83eccf2a544a80f692bcee0e07910502a7" gracePeriod=45 Nov 04 06:09:18.660906 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:18.660848 5784 generic.go:356] "Generic (PLEG): container finished" podID="dba3c05a-be4e-49c8-b02e-f7024af3da05" containerID="fc648b341aae789d4f4f00b8259b3e83eccf2a544a80f692bcee0e07910502a7" exitCode=0 Nov 04 06:09:18.660906 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:18.660899 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" event={"ID":"dba3c05a-be4e-49c8-b02e-f7024af3da05","Type":"ContainerDied","Data":"fc648b341aae789d4f4f00b8259b3e83eccf2a544a80f692bcee0e07910502a7"} Nov 04 06:09:18.692850 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:18.692500 5784 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" podUID="dba3c05a-be4e-49c8-b02e-f7024af3da05" containerName="main" probeResult="failure" output="Get \"https://10.134.0.44:8000/ready\": dial tcp 10.134.0.44:8000: connect: connection refused" Nov 04 06:09:18.856646 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:18.856612 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:09:18.945976 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:18.945941 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-tmp-dir\") pod \"dba3c05a-be4e-49c8-b02e-f7024af3da05\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " Nov 04 06:09:18.946141 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:18.946002 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-home\" (UniqueName: \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-home\") pod \"dba3c05a-be4e-49c8-b02e-f7024af3da05\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " Nov 04 06:09:18.946141 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:18.946053 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-dshm\" (UniqueName: \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-dshm\") pod \"dba3c05a-be4e-49c8-b02e-f7024af3da05\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " Nov 04 06:09:18.946141 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:18.946101 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dba3c05a-be4e-49c8-b02e-f7024af3da05-kube-api-access-q5tfv\" (UniqueName: \"kubernetes.io/projected/dba3c05a-be4e-49c8-b02e-f7024af3da05-kube-api-access-q5tfv\") pod \"dba3c05a-be4e-49c8-b02e-f7024af3da05\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " Nov 04 06:09:18.946141 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:18.946135 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dba3c05a-be4e-49c8-b02e-f7024af3da05-tls-certs\" (UniqueName: \"kubernetes.io/secret/dba3c05a-be4e-49c8-b02e-f7024af3da05-tls-certs\") pod \"dba3c05a-be4e-49c8-b02e-f7024af3da05\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " Nov 04 06:09:18.946315 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:18.946247 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-model-cache\") pod \"dba3c05a-be4e-49c8-b02e-f7024af3da05\" (UID: \"dba3c05a-be4e-49c8-b02e-f7024af3da05\") " Nov 04 06:09:18.946884 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:18.946861 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-model-cache" pod "dba3c05a-be4e-49c8-b02e-f7024af3da05" (UID: "dba3c05a-be4e-49c8-b02e-f7024af3da05"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:18.947101 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:18.947049 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-tmp-dir" pod "dba3c05a-be4e-49c8-b02e-f7024af3da05" (UID: "dba3c05a-be4e-49c8-b02e-f7024af3da05"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:18.947353 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:18.947333 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-home" pod "dba3c05a-be4e-49c8-b02e-f7024af3da05" (UID: "dba3c05a-be4e-49c8-b02e-f7024af3da05"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:18.953335 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:18.953280 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-dshm" pod "dba3c05a-be4e-49c8-b02e-f7024af3da05" (UID: "dba3c05a-be4e-49c8-b02e-f7024af3da05"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:18.953335 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:18.953294 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dba3c05a-be4e-49c8-b02e-f7024af3da05-kube-api-access-q5tfv" pod "dba3c05a-be4e-49c8-b02e-f7024af3da05" (UID: "dba3c05a-be4e-49c8-b02e-f7024af3da05"). InnerVolumeSpecName "kube-api-access-q5tfv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:09:18.953670 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:18.953643 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dba3c05a-be4e-49c8-b02e-f7024af3da05-tls-certs" pod "dba3c05a-be4e-49c8-b02e-f7024af3da05" (UID: "dba3c05a-be4e-49c8-b02e-f7024af3da05"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:09:19.047403 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:19.047373 5784 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-tmp-dir\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:19.047403 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:19.047401 5784 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-home\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:19.047607 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:19.047413 5784 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-dshm\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:19.047607 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:19.047426 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5tfv\" (UniqueName: \"kubernetes.io/projected/dba3c05a-be4e-49c8-b02e-f7024af3da05-kube-api-access-q5tfv\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:19.047607 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:19.047439 5784 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dba3c05a-be4e-49c8-b02e-f7024af3da05-tls-certs\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:19.047607 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:19.047451 5784 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dba3c05a-be4e-49c8-b02e-f7024af3da05-model-cache\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:19.678094 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:19.676851 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" event={"ID":"dba3c05a-be4e-49c8-b02e-f7024af3da05","Type":"ContainerDied","Data":"e5b20989886f5b776265c59bae0220d961e9c5267ea2cf1ae83430a0ff5a4d0d"} Nov 04 06:09:19.678094 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:19.676922 5784 scope.go:122] "RemoveContainer" containerID="fc648b341aae789d4f4f00b8259b3e83eccf2a544a80f692bcee0e07910502a7" Nov 04 06:09:19.684236 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:19.684202 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75" Nov 04 06:09:19.867626 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:19.867594 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75"] Nov 04 06:09:19.925240 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:19.925205 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-856c68/simulator-w4-856c68-kserve-c9d965b45-phb75"] Nov 04 06:09:21.030127 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:21.030094 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dba3c05a-be4e-49c8-b02e-f7024af3da05" path="/var/lib/kubelet/pods/dba3c05a-be4e-49c8-b02e-f7024af3da05/volumes" Nov 04 06:09:30.953966 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:30.953930 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9"] Nov 04 06:09:30.954431 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:30.954413 5784 cpu_manager.go:414] "containerMap: removing container" podUID="dba3c05a-be4e-49c8-b02e-f7024af3da05" containerName="main" Nov 04 06:09:30.954487 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:30.954433 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dba3c05a-be4e-49c8-b02e-f7024af3da05" containerName="main" Nov 04 06:09:30.954546 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:30.954532 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="dba3c05a-be4e-49c8-b02e-f7024af3da05" containerName="main" Nov 04 06:09:30.959262 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:30.959242 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.015235 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.015210 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47"] Nov 04 06:09:31.018898 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.018875 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.065688 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.065663 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9"] Nov 04 06:09:31.104784 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.104755 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.105002 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.104976 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.105170 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.105031 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.105170 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.105057 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.105291 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.105244 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.105291 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.105285 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/526e23b8-8dee-42ad-a67e-049baee60a2e-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.105393 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.105316 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.105393 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.105347 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.105498 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.105391 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.105498 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.105437 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj8sr\" (UniqueName: \"kubernetes.io/projected/526e23b8-8dee-42ad-a67e-049baee60a2e-kube-api-access-zj8sr\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.105498 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.105473 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.105648 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.105504 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj8cp\" (UniqueName: \"kubernetes.io/projected/a81368fd-b377-47da-87cf-42f4d5af0c11-kube-api-access-mj8cp\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.105648 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.105538 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.105648 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.105593 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.105648 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.105618 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.105648 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.105643 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a81368fd-b377-47da-87cf-42f4d5af0c11-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.105886 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.105674 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.105886 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.105736 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.128044 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.128017 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47"] Nov 04 06:09:31.203302 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.203273 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:09:31.206894 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.206824 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.206894 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.206854 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.206894 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.206878 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.207190 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.206991 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.207190 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.207037 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.207190 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.207079 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/526e23b8-8dee-42ad-a67e-049baee60a2e-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.207190 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.207110 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.207190 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.207137 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.207190 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.207175 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.207516 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.207435 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.207516 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.207493 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj8sr\" (UniqueName: \"kubernetes.io/projected/526e23b8-8dee-42ad-a67e-049baee60a2e-kube-api-access-zj8sr\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.207630 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.207540 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.207630 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.207579 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj8cp\" (UniqueName: \"kubernetes.io/projected/a81368fd-b377-47da-87cf-42f4d5af0c11-kube-api-access-mj8cp\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.207630 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.207614 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.207795 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.207669 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.207795 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.207695 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.207795 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.207695 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.207795 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.207720 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a81368fd-b377-47da-87cf-42f4d5af0c11-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.207795 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.207763 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.208018 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.207823 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.208090 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.208007 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.208090 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.208041 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-workload-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.208239 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.208219 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.208565 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.208540 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-credential-socket\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.208906 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.208878 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a81368fd-b377-47da-87cf-42f4d5af0c11-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.208992 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.208882 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/526e23b8-8dee-42ad-a67e-049baee60a2e-istiod-ca-cert\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.208992 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.208949 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-data\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.209246 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.209221 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-workload-certs\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.209888 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.209863 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.210042 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.210021 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.210559 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.210538 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-podinfo\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.210787 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.210763 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-envoy\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.274934 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.274905 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj8sr\" (UniqueName: \"kubernetes.io/projected/526e23b8-8dee-42ad-a67e-049baee60a2e-kube-api-access-zj8sr\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.274934 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.274921 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.275162 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.274906 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-token\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.275162 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.275031 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj8cp\" (UniqueName: \"kubernetes.io/projected/a81368fd-b377-47da-87cf-42f4d5af0c11-kube-api-access-mj8cp\") pod \"e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.330960 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.330930 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:31.573170 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.573136 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:31.772738 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.772710 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47"] Nov 04 06:09:31.775032 ip-10-0-134-45 kubenswrapper[5784]: W1104 06:09:31.775008 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod526e23b8_8dee_42ad_a67e_049baee60a2e.slice/crio-5ab0356064540833f7a8dc7508737d794dc579e4ab21b8ebb7c319297c307e27 WatchSource:0}: Error finding container 5ab0356064540833f7a8dc7508737d794dc579e4ab21b8ebb7c319297c307e27: Status 404 returned error can't find the container with id 5ab0356064540833f7a8dc7508737d794dc579e4ab21b8ebb7c319297c307e27 Nov 04 06:09:31.777261 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.777228 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:09:31.777363 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.777291 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:09:31.777363 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.777320 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:09:31.782153 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.782129 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" event={"ID":"526e23b8-8dee-42ad-a67e-049baee60a2e","Type":"ContainerStarted","Data":"5ab0356064540833f7a8dc7508737d794dc579e4ab21b8ebb7c319297c307e27"} Nov 04 06:09:31.967677 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.967568 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9"] Nov 04 06:09:31.969922 ip-10-0-134-45 kubenswrapper[5784]: W1104 06:09:31.969897 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda81368fd_b377_47da_87cf_42f4d5af0c11.slice/crio-403b2b48c77a865635df20f76a18da7aba3253bb3d46aab39f3a043882d1133c WatchSource:0}: Error finding container 403b2b48c77a865635df20f76a18da7aba3253bb3d46aab39f3a043882d1133c: Status 404 returned error can't find the container with id 403b2b48c77a865635df20f76a18da7aba3253bb3d46aab39f3a043882d1133c Nov 04 06:09:31.972234 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.972201 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:09:31.972326 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.972264 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:09:31.972326 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:31.972316 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:09:32.900088 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:32.897328 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" event={"ID":"526e23b8-8dee-42ad-a67e-049baee60a2e","Type":"ContainerStarted","Data":"c0e8ce2b2ef4ba953f4747d5e6e728744e572a9a91a8a22c9463e9a08bbd6877"} Nov 04 06:09:32.900299 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:32.900235 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" event={"ID":"a81368fd-b377-47da-87cf-42f4d5af0c11","Type":"ContainerStarted","Data":"f989280d3fa181c65c90d7ef95215f8c81ba6b4742972d6ad98a68a048feaa46"} Nov 04 06:09:32.900299 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:32.900284 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" event={"ID":"a81368fd-b377-47da-87cf-42f4d5af0c11","Type":"ContainerStarted","Data":"403b2b48c77a865635df20f76a18da7aba3253bb3d46aab39f3a043882d1133c"} Nov 04 06:09:33.109427 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:33.109363 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" podStartSLOduration=3.109345064 podStartE2EDuration="3.109345064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:09:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:09:33.106670135 +0000 UTC m=+1172.243366535" watchObservedRunningTime="2026-11-04 06:09:33.109345064 +0000 UTC m=+1172.246041462" Nov 04 06:09:33.241703 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:33.241576 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" podStartSLOduration=3.241555986 podStartE2EDuration="3.241555986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:09:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:09:33.239506192 +0000 UTC m=+1172.376202597" watchObservedRunningTime="2026-11-04 06:09:33.241555986 +0000 UTC m=+1172.378252385" Nov 04 06:09:33.331673 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:33.331635 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:33.332587 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:33.332565 5784 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Nov 04 06:09:33.332646 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:33.332610 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" podUID="526e23b8-8dee-42ad-a67e-049baee60a2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Nov 04 06:09:33.577146 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:33.576111 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:33.580245 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:33.580190 5784 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Nov 04 06:09:33.580480 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:33.580435 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" podUID="a81368fd-b377-47da-87cf-42f4d5af0c11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Nov 04 06:09:34.331479 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:34.331448 5784 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Nov 04 06:09:34.331890 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:34.331503 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" podUID="526e23b8-8dee-42ad-a67e-049baee60a2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Nov 04 06:09:34.578087 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:34.577627 5784 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Nov 04 06:09:34.578087 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:34.577703 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" podUID="a81368fd-b377-47da-87cf-42f4d5af0c11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Nov 04 06:09:35.331358 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:35.331317 5784 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Nov 04 06:09:35.331880 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:35.331371 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" podUID="526e23b8-8dee-42ad-a67e-049baee60a2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Nov 04 06:09:35.579090 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:35.576627 5784 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Nov 04 06:09:35.579090 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:35.576711 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" podUID="a81368fd-b377-47da-87cf-42f4d5af0c11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Nov 04 06:09:36.331340 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:36.331305 5784 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Nov 04 06:09:36.331526 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:36.331379 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" podUID="526e23b8-8dee-42ad-a67e-049baee60a2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Nov 04 06:09:36.577088 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:36.576512 5784 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Nov 04 06:09:36.577088 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:36.576590 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" podUID="a81368fd-b377-47da-87cf-42f4d5af0c11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Nov 04 06:09:37.331302 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:37.331263 5784 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Nov 04 06:09:37.331473 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:37.331335 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" podUID="526e23b8-8dee-42ad-a67e-049baee60a2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Nov 04 06:09:37.579085 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:37.578578 5784 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Nov 04 06:09:37.579085 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:37.578676 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" podUID="a81368fd-b377-47da-87cf-42f4d5af0c11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Nov 04 06:09:38.332265 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:38.332218 5784 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Nov 04 06:09:38.332632 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:38.332289 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" podUID="526e23b8-8dee-42ad-a67e-049baee60a2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Nov 04 06:09:38.574279 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:38.574237 5784 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Nov 04 06:09:38.574488 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:38.574304 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" podUID="a81368fd-b377-47da-87cf-42f4d5af0c11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Nov 04 06:09:39.337010 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:39.336978 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:39.337416 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:39.337398 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:39.338178 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:39.338160 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:09:39.641797 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:39.641678 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:39.642289 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:39.642263 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:39.644214 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:39.644191 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:09:45.417079 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:09:45.417027 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:09:45.720075 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.719976 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt"] Nov 04 06:09:45.724128 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.724105 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.842574 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.842535 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.842767 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.842581 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.842767 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.842699 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpds8\" (UniqueName: \"kubernetes.io/projected/2c57f68b-83f0-4f3a-88df-ab9f6082804b-kube-api-access-fpds8\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.842767 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.842752 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.842904 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.842839 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.842950 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.842922 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.842998 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.842956 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.843056 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.843025 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.843182 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.843166 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.944627 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.944585 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.944846 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.944640 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.944846 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.944675 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.944846 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.944734 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.951262 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.944833 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.951429 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.951401 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.951504 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.951485 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.951563 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.951516 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-credential-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.951563 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.951540 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.951672 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.951658 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpds8\" (UniqueName: \"kubernetes.io/projected/2c57f68b-83f0-4f3a-88df-ab9f6082804b-kube-api-access-fpds8\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.952225 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.952196 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istiod-ca-cert\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.952353 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.952330 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-workload-socket\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.952422 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.952383 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-workload-certs\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.953983 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.953953 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-envoy\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.954382 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.954359 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-podinfo\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.960374 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.960298 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-data\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:45.962994 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:45.962971 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt"] Nov 04 06:09:46.017957 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:46.017892 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-token\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:46.020893 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:46.020857 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpds8\" (UniqueName: \"kubernetes.io/projected/2c57f68b-83f0-4f3a-88df-ab9f6082804b-kube-api-access-fpds8\") pod \"e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:46.038218 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:46.038190 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:46.482195 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:46.482142 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt"] Nov 04 06:09:46.484101 ip-10-0-134-45 kubenswrapper[5784]: W1104 06:09:46.484056 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c57f68b_83f0_4f3a_88df_ab9f6082804b.slice/crio-1fe1716b439197ebf4493ccb478d81ce1de149ef05e435cb26d54baafb0739ed WatchSource:0}: Error finding container 1fe1716b439197ebf4493ccb478d81ce1de149ef05e435cb26d54baafb0739ed: Status 404 returned error can't find the container with id 1fe1716b439197ebf4493ccb478d81ce1de149ef05e435cb26d54baafb0739ed Nov 04 06:09:46.486430 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:46.486395 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:09:46.486580 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:46.486475 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:09:46.486580 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:46.486545 5784 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 06:09:46.985957 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:46.985919 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" event={"ID":"2c57f68b-83f0-4f3a-88df-ab9f6082804b","Type":"ContainerStarted","Data":"0c7557fc758da482c63b9d711eaf62fb2d18782609529065e4a71a5498bd8112"} Nov 04 06:09:46.986174 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:46.985979 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" event={"ID":"2c57f68b-83f0-4f3a-88df-ab9f6082804b","Type":"ContainerStarted","Data":"1fe1716b439197ebf4493ccb478d81ce1de149ef05e435cb26d54baafb0739ed"} Nov 04 06:09:47.042246 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:47.042204 5784 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:09:47.044653 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:47.044190 5784 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Nov 04 06:09:47.044653 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:47.044249 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" podUID="2c57f68b-83f0-4f3a-88df-ab9f6082804b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Nov 04 06:09:47.224742 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:47.224673 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" podStartSLOduration=2.224657998 podStartE2EDuration="2.224657998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 06:09:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:09:47.173253968 +0000 UTC m=+1186.309950379" watchObservedRunningTime="2026-11-04 06:09:47.224657998 +0000 UTC m=+1186.361354395" Nov 04 06:09:48.038759 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:48.038724 5784 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Nov 04 06:09:48.039237 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:48.038784 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" podUID="2c57f68b-83f0-4f3a-88df-ab9f6082804b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Nov 04 06:09:49.039346 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:49.039316 5784 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Nov 04 06:09:49.039712 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:49.039371 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" podUID="2c57f68b-83f0-4f3a-88df-ab9f6082804b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Nov 04 06:09:50.038813 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:50.038785 5784 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Nov 04 06:09:50.039088 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:50.039048 5784 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" podUID="2c57f68b-83f0-4f3a-88df-ab9f6082804b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Nov 04 06:09:50.927121 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:50.927057 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb"] Nov 04 06:09:50.927506 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:50.927290 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" podUID="b91f7014-bca4-4179-b042-a02f6a7f3ea1" containerName="istio-proxy" containerID="cri-o://9554655ac1916faabf8de83185475cdbe62c41a685ff16d85a3e4af2faeac65e" gracePeriod=30 Nov 04 06:09:50.940882 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:50.940847 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt"] Nov 04 06:09:50.941091 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:50.941053 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" podUID="2c57f68b-83f0-4f3a-88df-ab9f6082804b" containerName="istio-proxy" containerID="cri-o://0c7557fc758da482c63b9d711eaf62fb2d18782609529065e4a71a5498bd8112" gracePeriod=30 Nov 04 06:09:50.978285 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:50.978098 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd"] Nov 04 06:09:50.979111 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:50.978966 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" podUID="7f400444-178f-4421-80f9-c8c9288651a7" containerName="istio-proxy" containerID="cri-o://3ef4988593a4d87ed03c4c527b1205aa48ce74abd79e9ffd2c1c65ec223f0f7b" gracePeriod=30 Nov 04 06:09:52.182700 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:52.182662 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb"] Nov 04 06:09:52.202289 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:52.202255 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc"] Nov 04 06:09:52.986074 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:52.986030 5784 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 06:09:52.986246 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:52.986115 5784 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" podUID="b91f7014-bca4-4179-b042-a02f6a7f3ea1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 06:09:53.620913 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:53.620874 5784 patch_prober.go:29] interesting pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 06:09:53.621427 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:53.620934 5784 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" podUID="7f400444-178f-4421-80f9-c8c9288651a7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 06:09:56.231109 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.231083 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:09:56.263205 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.263179 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:56.378926 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.378889 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-workload-socket\") pod \"7f400444-178f-4421-80f9-c8c9288651a7\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " Nov 04 06:09:56.379114 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.378960 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-token\" (UniqueName: \"kubernetes.io/projected/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-token\") pod \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " Nov 04 06:09:56.379114 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.378992 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-workload-certs\") pod \"7f400444-178f-4421-80f9-c8c9288651a7\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " Nov 04 06:09:56.379114 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.379026 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-credential-socket\") pod \"7f400444-178f-4421-80f9-c8c9288651a7\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " Nov 04 06:09:56.379114 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.379096 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-envoy\") pod \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " Nov 04 06:09:56.379482 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.379125 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7f400444-178f-4421-80f9-c8c9288651a7-kube-api-access-42v7b\" (UniqueName: \"kubernetes.io/projected/7f400444-178f-4421-80f9-c8c9288651a7-kube-api-access-42v7b\") pod \"7f400444-178f-4421-80f9-c8c9288651a7\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " Nov 04 06:09:56.379482 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.379157 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b91f7014-bca4-4179-b042-a02f6a7f3ea1-kube-api-access-rscwl\" (UniqueName: \"kubernetes.io/projected/b91f7014-bca4-4179-b042-a02f6a7f3ea1-kube-api-access-rscwl\") pod \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " Nov 04 06:09:56.379482 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.379207 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-workload-socket\") pod \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " Nov 04 06:09:56.379482 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.379287 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istiod-ca-cert\") pod \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " Nov 04 06:09:56.379482 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.379320 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-workload-certs\") pod \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " Nov 04 06:09:56.379482 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.379332 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-workload-certs" pod "7f400444-178f-4421-80f9-c8c9288651a7" (UID: "7f400444-178f-4421-80f9-c8c9288651a7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:56.379482 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.379364 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-data\") pod \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " Nov 04 06:09:56.379482 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.379399 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-podinfo\") pod \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " Nov 04 06:09:56.379482 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.379435 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7f400444-178f-4421-80f9-c8c9288651a7-istio-token\" (UniqueName: \"kubernetes.io/projected/7f400444-178f-4421-80f9-c8c9288651a7-istio-token\") pod \"7f400444-178f-4421-80f9-c8c9288651a7\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " Nov 04 06:09:56.380058 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.379492 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-istio-envoy\") pod \"7f400444-178f-4421-80f9-c8c9288651a7\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " Nov 04 06:09:56.380058 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.379529 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7f400444-178f-4421-80f9-c8c9288651a7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f400444-178f-4421-80f9-c8c9288651a7-istio-podinfo\") pod \"7f400444-178f-4421-80f9-c8c9288651a7\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " Nov 04 06:09:56.380058 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.379550 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-workload-socket" pod "b91f7014-bca4-4179-b042-a02f6a7f3ea1" (UID: "b91f7014-bca4-4179-b042-a02f6a7f3ea1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:56.380058 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.379571 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7f400444-178f-4421-80f9-c8c9288651a7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f400444-178f-4421-80f9-c8c9288651a7-istiod-ca-cert\") pod \"7f400444-178f-4421-80f9-c8c9288651a7\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " Nov 04 06:09:56.380058 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.379622 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-credential-socket\") pod \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\" (UID: \"b91f7014-bca4-4179-b042-a02f6a7f3ea1\") " Nov 04 06:09:56.380058 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.379659 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-istio-data\") pod \"7f400444-178f-4421-80f9-c8c9288651a7\" (UID: \"7f400444-178f-4421-80f9-c8c9288651a7\") " Nov 04 06:09:56.380058 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.379999 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-credential-socket" pod "7f400444-178f-4421-80f9-c8c9288651a7" (UID: "7f400444-178f-4421-80f9-c8c9288651a7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:56.380477 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.380124 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-workload-socket" pod "7f400444-178f-4421-80f9-c8c9288651a7" (UID: "7f400444-178f-4421-80f9-c8c9288651a7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:56.380477 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.380203 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-istio-data" pod "7f400444-178f-4421-80f9-c8c9288651a7" (UID: "7f400444-178f-4421-80f9-c8c9288651a7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:56.380477 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.380311 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-workload-certs" pod "b91f7014-bca4-4179-b042-a02f6a7f3ea1" (UID: "b91f7014-bca4-4179-b042-a02f6a7f3ea1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:56.380627 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.380590 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istiod-ca-cert" pod "b91f7014-bca4-4179-b042-a02f6a7f3ea1" (UID: "b91f7014-bca4-4179-b042-a02f6a7f3ea1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:09:56.380948 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.380926 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f400444-178f-4421-80f9-c8c9288651a7-istiod-ca-cert" pod "7f400444-178f-4421-80f9-c8c9288651a7" (UID: "7f400444-178f-4421-80f9-c8c9288651a7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:09:56.381922 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.380217 5784 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-workload-certs\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.381922 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.381287 5784 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-credential-socket\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.381922 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.381304 5784 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-workload-socket\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.381922 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.381506 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-credential-socket" pod "b91f7014-bca4-4179-b042-a02f6a7f3ea1" (UID: "b91f7014-bca4-4179-b042-a02f6a7f3ea1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:56.381922 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.381687 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-data" pod "b91f7014-bca4-4179-b042-a02f6a7f3ea1" (UID: "b91f7014-bca4-4179-b042-a02f6a7f3ea1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:56.382448 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.382423 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-istio-envoy" pod "7f400444-178f-4421-80f9-c8c9288651a7" (UID: "7f400444-178f-4421-80f9-c8c9288651a7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:56.382448 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.382421 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b91f7014-bca4-4179-b042-a02f6a7f3ea1-kube-api-access-rscwl" pod "b91f7014-bca4-4179-b042-a02f6a7f3ea1" (UID: "b91f7014-bca4-4179-b042-a02f6a7f3ea1"). InnerVolumeSpecName "kube-api-access-rscwl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:09:56.382796 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.382773 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-token" pod "b91f7014-bca4-4179-b042-a02f6a7f3ea1" (UID: "b91f7014-bca4-4179-b042-a02f6a7f3ea1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:09:56.383591 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.383556 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f400444-178f-4421-80f9-c8c9288651a7-istio-token" pod "7f400444-178f-4421-80f9-c8c9288651a7" (UID: "7f400444-178f-4421-80f9-c8c9288651a7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:09:56.383764 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.383734 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f400444-178f-4421-80f9-c8c9288651a7-istio-podinfo" pod "7f400444-178f-4421-80f9-c8c9288651a7" (UID: "7f400444-178f-4421-80f9-c8c9288651a7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:09:56.384176 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.384147 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-envoy" pod "b91f7014-bca4-4179-b042-a02f6a7f3ea1" (UID: "b91f7014-bca4-4179-b042-a02f6a7f3ea1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:09:56.384378 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.384351 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-podinfo" pod "b91f7014-bca4-4179-b042-a02f6a7f3ea1" (UID: "b91f7014-bca4-4179-b042-a02f6a7f3ea1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:09:56.384662 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.384640 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f400444-178f-4421-80f9-c8c9288651a7-kube-api-access-42v7b" pod "7f400444-178f-4421-80f9-c8c9288651a7" (UID: "7f400444-178f-4421-80f9-c8c9288651a7"). InnerVolumeSpecName "kube-api-access-42v7b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:09:56.482387 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.482315 5784 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-data\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.482387 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.482342 5784 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-podinfo\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.482387 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.482354 5784 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f400444-178f-4421-80f9-c8c9288651a7-istio-token\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.482387 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.482364 5784 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-istio-envoy\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.482387 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.482373 5784 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f400444-178f-4421-80f9-c8c9288651a7-istio-podinfo\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.482387 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.482382 5784 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f400444-178f-4421-80f9-c8c9288651a7-istiod-ca-cert\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.482387 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.482390 5784 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-credential-socket\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.482738 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.482398 5784 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-istio-data\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.482738 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.482407 5784 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f400444-178f-4421-80f9-c8c9288651a7-workload-socket\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.482738 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.482415 5784 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-token\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.482738 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.482424 5784 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istio-envoy\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.482738 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.482432 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42v7b\" (UniqueName: \"kubernetes.io/projected/7f400444-178f-4421-80f9-c8c9288651a7-kube-api-access-42v7b\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.482738 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.482441 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rscwl\" (UniqueName: \"kubernetes.io/projected/b91f7014-bca4-4179-b042-a02f6a7f3ea1-kube-api-access-rscwl\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.482738 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.482450 5784 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b91f7014-bca4-4179-b042-a02f6a7f3ea1-istiod-ca-cert\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:56.482738 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:56.482464 5784 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b91f7014-bca4-4179-b042-a02f6a7f3ea1-workload-certs\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:09:57.040023 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:57.039995 5784 generic.go:356] "Generic (PLEG): container finished" podID="b91f7014-bca4-4179-b042-a02f6a7f3ea1" containerID="9554655ac1916faabf8de83185475cdbe62c41a685ff16d85a3e4af2faeac65e" exitCode=0 Nov 04 06:09:57.040173 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:57.040044 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" Nov 04 06:09:57.040173 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:57.040083 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" event={"ID":"b91f7014-bca4-4179-b042-a02f6a7f3ea1","Type":"ContainerDied","Data":"9554655ac1916faabf8de83185475cdbe62c41a685ff16d85a3e4af2faeac65e"} Nov 04 06:09:57.040173 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:57.040136 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb" event={"ID":"b91f7014-bca4-4179-b042-a02f6a7f3ea1","Type":"ContainerDied","Data":"0cb61aa13500c1398333406806cb0161d20c2d9d9cfd80a1beb9ee11e1d91a3c"} Nov 04 06:09:57.040173 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:57.040162 5784 scope.go:122] "RemoveContainer" containerID="9554655ac1916faabf8de83185475cdbe62c41a685ff16d85a3e4af2faeac65e" Nov 04 06:09:57.041623 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:57.041600 5784 generic.go:356] "Generic (PLEG): container finished" podID="7f400444-178f-4421-80f9-c8c9288651a7" containerID="3ef4988593a4d87ed03c4c527b1205aa48ce74abd79e9ffd2c1c65ec223f0f7b" exitCode=0 Nov 04 06:09:57.041753 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:57.041646 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" Nov 04 06:09:57.041753 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:57.041669 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" event={"ID":"7f400444-178f-4421-80f9-c8c9288651a7","Type":"ContainerDied","Data":"3ef4988593a4d87ed03c4c527b1205aa48ce74abd79e9ffd2c1c65ec223f0f7b"} Nov 04 06:09:57.041753 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:57.041726 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd" event={"ID":"7f400444-178f-4421-80f9-c8c9288651a7","Type":"ContainerDied","Data":"cac9c6c093b91f617920c095cbd85e292c643b99ce0020bf735eb99e23c1403d"} Nov 04 06:09:57.049215 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:57.049196 5784 scope.go:122] "RemoveContainer" containerID="9554655ac1916faabf8de83185475cdbe62c41a685ff16d85a3e4af2faeac65e" Nov 04 06:09:57.049477 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:09:57.049459 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9554655ac1916faabf8de83185475cdbe62c41a685ff16d85a3e4af2faeac65e\": container with ID starting with 9554655ac1916faabf8de83185475cdbe62c41a685ff16d85a3e4af2faeac65e not found: ID does not exist" containerID="9554655ac1916faabf8de83185475cdbe62c41a685ff16d85a3e4af2faeac65e" Nov 04 06:09:57.049532 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:57.049485 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9554655ac1916faabf8de83185475cdbe62c41a685ff16d85a3e4af2faeac65e"} err="failed to get container status \"9554655ac1916faabf8de83185475cdbe62c41a685ff16d85a3e4af2faeac65e\": rpc error: code = NotFound desc = could not find container \"9554655ac1916faabf8de83185475cdbe62c41a685ff16d85a3e4af2faeac65e\": container with ID starting with 9554655ac1916faabf8de83185475cdbe62c41a685ff16d85a3e4af2faeac65e not found: ID does not exist" Nov 04 06:09:57.049532 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:57.049501 5784 scope.go:122] "RemoveContainer" containerID="3ef4988593a4d87ed03c4c527b1205aa48ce74abd79e9ffd2c1c65ec223f0f7b" Nov 04 06:09:57.057759 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:57.057737 5784 scope.go:122] "RemoveContainer" containerID="3ef4988593a4d87ed03c4c527b1205aa48ce74abd79e9ffd2c1c65ec223f0f7b" Nov 04 06:09:57.058027 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:09:57.058009 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ef4988593a4d87ed03c4c527b1205aa48ce74abd79e9ffd2c1c65ec223f0f7b\": container with ID starting with 3ef4988593a4d87ed03c4c527b1205aa48ce74abd79e9ffd2c1c65ec223f0f7b not found: ID does not exist" containerID="3ef4988593a4d87ed03c4c527b1205aa48ce74abd79e9ffd2c1c65ec223f0f7b" Nov 04 06:09:57.058097 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:57.058036 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ef4988593a4d87ed03c4c527b1205aa48ce74abd79e9ffd2c1c65ec223f0f7b"} err="failed to get container status \"3ef4988593a4d87ed03c4c527b1205aa48ce74abd79e9ffd2c1c65ec223f0f7b\": rpc error: code = NotFound desc = could not find container \"3ef4988593a4d87ed03c4c527b1205aa48ce74abd79e9ffd2c1c65ec223f0f7b\": container with ID starting with 3ef4988593a4d87ed03c4c527b1205aa48ce74abd79e9ffd2c1c65ec223f0f7b not found: ID does not exist" Nov 04 06:09:57.278478 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:57.278391 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb"] Nov 04 06:09:57.334120 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:57.334079 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb"] Nov 04 06:09:57.404860 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:57.404828 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd"] Nov 04 06:09:57.410252 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:57.410224 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd"] Nov 04 06:09:59.015577 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:59.015545 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7f400444-178f-4421-80f9-c8c9288651a7" path="/var/lib/kubelet/pods/7f400444-178f-4421-80f9-c8c9288651a7/volumes" Nov 04 06:09:59.015998 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:09:59.015948 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b91f7014-bca4-4179-b042-a02f6a7f3ea1" path="/var/lib/kubelet/pods/b91f7014-bca4-4179-b042-a02f6a7f3ea1/volumes" Nov 04 06:10:00.196811 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.196782 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd"] Nov 04 06:10:00.297580 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.297558 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:10:00.422419 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.422334 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2c57f68b-83f0-4f3a-88df-ab9f6082804b-kube-api-access-fpds8\" (UniqueName: \"kubernetes.io/projected/2c57f68b-83f0-4f3a-88df-ab9f6082804b-kube-api-access-fpds8\") pod \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " Nov 04 06:10:00.422419 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.422403 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-envoy\") pod \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " Nov 04 06:10:00.422685 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.422435 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-credential-socket\") pod \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " Nov 04 06:10:00.422685 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.422494 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-workload-certs\") pod \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " Nov 04 06:10:00.422685 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.422525 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istiod-ca-cert\") pod \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " Nov 04 06:10:00.422685 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.422570 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-token\" (UniqueName: \"kubernetes.io/projected/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-token\") pod \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " Nov 04 06:10:00.422685 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.422601 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-workload-socket\") pod \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " Nov 04 06:10:00.422685 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.422630 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-podinfo\") pod \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " Nov 04 06:10:00.422996 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.422691 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-data\") pod \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\" (UID: \"2c57f68b-83f0-4f3a-88df-ab9f6082804b\") " Nov 04 06:10:00.422996 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.422862 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-credential-socket" pod "2c57f68b-83f0-4f3a-88df-ab9f6082804b" (UID: "2c57f68b-83f0-4f3a-88df-ab9f6082804b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:00.422996 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.422903 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-workload-socket" pod "2c57f68b-83f0-4f3a-88df-ab9f6082804b" (UID: "2c57f68b-83f0-4f3a-88df-ab9f6082804b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:00.423287 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.422994 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istiod-ca-cert" pod "2c57f68b-83f0-4f3a-88df-ab9f6082804b" (UID: "2c57f68b-83f0-4f3a-88df-ab9f6082804b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:10:00.423287 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.423169 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-data" pod "2c57f68b-83f0-4f3a-88df-ab9f6082804b" (UID: "2c57f68b-83f0-4f3a-88df-ab9f6082804b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:00.423287 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.423279 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-workload-certs" pod "2c57f68b-83f0-4f3a-88df-ab9f6082804b" (UID: "2c57f68b-83f0-4f3a-88df-ab9f6082804b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:00.423471 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.423341 5784 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-workload-socket\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:00.423471 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.423364 5784 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-data\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:00.423471 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.423379 5784 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-credential-socket\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:00.423471 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.423395 5784 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istiod-ca-cert\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:00.424866 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.424839 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c57f68b-83f0-4f3a-88df-ab9f6082804b-kube-api-access-fpds8" pod "2c57f68b-83f0-4f3a-88df-ab9f6082804b" (UID: "2c57f68b-83f0-4f3a-88df-ab9f6082804b"). InnerVolumeSpecName "kube-api-access-fpds8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:00.424967 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.424864 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-envoy" pod "2c57f68b-83f0-4f3a-88df-ab9f6082804b" (UID: "2c57f68b-83f0-4f3a-88df-ab9f6082804b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:00.425017 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.424980 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-podinfo" pod "2c57f68b-83f0-4f3a-88df-ab9f6082804b" (UID: "2c57f68b-83f0-4f3a-88df-ab9f6082804b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:10:00.425134 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.425117 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-token" pod "2c57f68b-83f0-4f3a-88df-ab9f6082804b" (UID: "2c57f68b-83f0-4f3a-88df-ab9f6082804b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:00.524876 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.524840 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpds8\" (UniqueName: \"kubernetes.io/projected/2c57f68b-83f0-4f3a-88df-ab9f6082804b-kube-api-access-fpds8\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:00.524876 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.524872 5784 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-envoy\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:00.524876 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.524882 5784 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c57f68b-83f0-4f3a-88df-ab9f6082804b-workload-certs\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:00.525162 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.524892 5784 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-token\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:00.525162 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:00.524901 5784 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c57f68b-83f0-4f3a-88df-ab9f6082804b-istio-podinfo\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:01.066245 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:01.066208 5784 generic.go:356] "Generic (PLEG): container finished" podID="2c57f68b-83f0-4f3a-88df-ab9f6082804b" containerID="0c7557fc758da482c63b9d711eaf62fb2d18782609529065e4a71a5498bd8112" exitCode=0 Nov 04 06:10:01.066393 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:01.066277 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" Nov 04 06:10:01.066393 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:01.066284 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" event={"ID":"2c57f68b-83f0-4f3a-88df-ab9f6082804b","Type":"ContainerDied","Data":"0c7557fc758da482c63b9d711eaf62fb2d18782609529065e4a71a5498bd8112"} Nov 04 06:10:01.066393 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:01.066335 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt" event={"ID":"2c57f68b-83f0-4f3a-88df-ab9f6082804b","Type":"ContainerDied","Data":"1fe1716b439197ebf4493ccb478d81ce1de149ef05e435cb26d54baafb0739ed"} Nov 04 06:10:01.066393 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:01.066358 5784 scope.go:122] "RemoveContainer" containerID="0c7557fc758da482c63b9d711eaf62fb2d18782609529065e4a71a5498bd8112" Nov 04 06:10:01.074886 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:01.074870 5784 scope.go:122] "RemoveContainer" containerID="0c7557fc758da482c63b9d711eaf62fb2d18782609529065e4a71a5498bd8112" Nov 04 06:10:01.075161 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:10:01.075139 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c7557fc758da482c63b9d711eaf62fb2d18782609529065e4a71a5498bd8112\": container with ID starting with 0c7557fc758da482c63b9d711eaf62fb2d18782609529065e4a71a5498bd8112 not found: ID does not exist" containerID="0c7557fc758da482c63b9d711eaf62fb2d18782609529065e4a71a5498bd8112" Nov 04 06:10:01.075208 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:01.075170 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c7557fc758da482c63b9d711eaf62fb2d18782609529065e4a71a5498bd8112"} err="failed to get container status \"0c7557fc758da482c63b9d711eaf62fb2d18782609529065e4a71a5498bd8112\": rpc error: code = NotFound desc = could not find container \"0c7557fc758da482c63b9d711eaf62fb2d18782609529065e4a71a5498bd8112\": container with ID starting with 0c7557fc758da482c63b9d711eaf62fb2d18782609529065e4a71a5498bd8112 not found: ID does not exist" Nov 04 06:10:01.138562 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:01.138534 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvgv2_206b2e75-0735-49df-a53c-bdd17aab8ae6/ovn-acl-logging/0.log" Nov 04 06:10:01.143264 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:01.143236 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvgv2_206b2e75-0735-49df-a53c-bdd17aab8ae6/ovn-acl-logging/0.log" Nov 04 06:10:01.248176 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:01.248145 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt"] Nov 04 06:10:01.304040 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:01.303967 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt"] Nov 04 06:10:03.014490 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:03.014432 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2c57f68b-83f0-4f3a-88df-ab9f6082804b" path="/var/lib/kubelet/pods/2c57f68b-83f0-4f3a-88df-ab9f6082804b/volumes" Nov 04 06:10:07.203383 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.203323 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" podUID="11451a43-a404-4f2a-817d-47eacf3f50c1" containerName="main" containerID="cri-o://c365bd8066b8630ba907b6e50d6194024c87703aaf7dacd150d678c19f1c2da0" gracePeriod=45 Nov 04 06:10:07.224456 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.224427 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" podUID="3adae990-c59e-42e0-98bc-a76106ad9448" containerName="main" containerID="cri-o://02c6ca151fcb0d1bf3a4f4bd6e34257b6c19bd0b2d9e0c58608466da44797bdc" gracePeriod=45 Nov 04 06:10:07.478101 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.478045 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:10:07.505717 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.505695 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:10:07.584872 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.584840 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/11451a43-a404-4f2a-817d-47eacf3f50c1-tls-certs\" (UniqueName: \"kubernetes.io/secret/11451a43-a404-4f2a-817d-47eacf3f50c1-tls-certs\") pod \"11451a43-a404-4f2a-817d-47eacf3f50c1\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " Nov 04 06:10:07.585047 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.584924 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-model-cache\") pod \"3adae990-c59e-42e0-98bc-a76106ad9448\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " Nov 04 06:10:07.585047 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.584955 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3adae990-c59e-42e0-98bc-a76106ad9448-tls-certs\" (UniqueName: \"kubernetes.io/secret/3adae990-c59e-42e0-98bc-a76106ad9448-tls-certs\") pod \"3adae990-c59e-42e0-98bc-a76106ad9448\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " Nov 04 06:10:07.585047 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.584984 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-dshm\" (UniqueName: \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-dshm\") pod \"11451a43-a404-4f2a-817d-47eacf3f50c1\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " Nov 04 06:10:07.585047 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.585035 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-dshm\" (UniqueName: \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-dshm\") pod \"3adae990-c59e-42e0-98bc-a76106ad9448\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " Nov 04 06:10:07.585274 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.585118 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/11451a43-a404-4f2a-817d-47eacf3f50c1-kube-api-access-rnmr7\" (UniqueName: \"kubernetes.io/projected/11451a43-a404-4f2a-817d-47eacf3f50c1-kube-api-access-rnmr7\") pod \"11451a43-a404-4f2a-817d-47eacf3f50c1\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " Nov 04 06:10:07.585274 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.585155 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3adae990-c59e-42e0-98bc-a76106ad9448-kube-api-access-jxrtm\" (UniqueName: \"kubernetes.io/projected/3adae990-c59e-42e0-98bc-a76106ad9448-kube-api-access-jxrtm\") pod \"3adae990-c59e-42e0-98bc-a76106ad9448\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " Nov 04 06:10:07.585274 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.585212 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-tmp-dir\") pod \"3adae990-c59e-42e0-98bc-a76106ad9448\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " Nov 04 06:10:07.585274 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.585243 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-model-cache\") pod \"11451a43-a404-4f2a-817d-47eacf3f50c1\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " Nov 04 06:10:07.585500 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.585279 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-home\" (UniqueName: \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-home\") pod \"3adae990-c59e-42e0-98bc-a76106ad9448\" (UID: \"3adae990-c59e-42e0-98bc-a76106ad9448\") " Nov 04 06:10:07.585500 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.585487 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-home" pod "3adae990-c59e-42e0-98bc-a76106ad9448" (UID: "3adae990-c59e-42e0-98bc-a76106ad9448"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:07.585779 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.585645 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-tmp-dir" pod "3adae990-c59e-42e0-98bc-a76106ad9448" (UID: "3adae990-c59e-42e0-98bc-a76106ad9448"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:07.585779 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.585696 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-model-cache" pod "11451a43-a404-4f2a-817d-47eacf3f50c1" (UID: "11451a43-a404-4f2a-817d-47eacf3f50c1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:07.585779 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.585702 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-model-cache" pod "3adae990-c59e-42e0-98bc-a76106ad9448" (UID: "3adae990-c59e-42e0-98bc-a76106ad9448"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:07.585779 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.585751 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-tmp-dir\") pod \"11451a43-a404-4f2a-817d-47eacf3f50c1\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " Nov 04 06:10:07.586043 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.585806 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-home\" (UniqueName: \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-home\") pod \"11451a43-a404-4f2a-817d-47eacf3f50c1\" (UID: \"11451a43-a404-4f2a-817d-47eacf3f50c1\") " Nov 04 06:10:07.586255 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.586228 5784 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-tmp-dir\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:07.586367 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.586259 5784 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-model-cache\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:07.586367 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.586274 5784 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-home\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:07.586367 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.586289 5784 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-model-cache\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:07.586726 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.586671 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-tmp-dir" pod "11451a43-a404-4f2a-817d-47eacf3f50c1" (UID: "11451a43-a404-4f2a-817d-47eacf3f50c1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:07.586804 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.586756 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-home" pod "11451a43-a404-4f2a-817d-47eacf3f50c1" (UID: "11451a43-a404-4f2a-817d-47eacf3f50c1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:07.587629 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.587601 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11451a43-a404-4f2a-817d-47eacf3f50c1-tls-certs" pod "11451a43-a404-4f2a-817d-47eacf3f50c1" (UID: "11451a43-a404-4f2a-817d-47eacf3f50c1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:10:07.588172 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.587682 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-dshm" pod "11451a43-a404-4f2a-817d-47eacf3f50c1" (UID: "11451a43-a404-4f2a-817d-47eacf3f50c1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:07.588172 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.587759 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3adae990-c59e-42e0-98bc-a76106ad9448-kube-api-access-jxrtm" pod "3adae990-c59e-42e0-98bc-a76106ad9448" (UID: "3adae990-c59e-42e0-98bc-a76106ad9448"). InnerVolumeSpecName "kube-api-access-jxrtm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:07.588341 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.588314 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-dshm" pod "3adae990-c59e-42e0-98bc-a76106ad9448" (UID: "3adae990-c59e-42e0-98bc-a76106ad9448"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:07.588434 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.588417 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11451a43-a404-4f2a-817d-47eacf3f50c1-kube-api-access-rnmr7" pod "11451a43-a404-4f2a-817d-47eacf3f50c1" (UID: "11451a43-a404-4f2a-817d-47eacf3f50c1"). InnerVolumeSpecName "kube-api-access-rnmr7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:07.588471 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.588431 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3adae990-c59e-42e0-98bc-a76106ad9448-tls-certs" pod "3adae990-c59e-42e0-98bc-a76106ad9448" (UID: "3adae990-c59e-42e0-98bc-a76106ad9448"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:10:07.687737 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.687691 5784 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3adae990-c59e-42e0-98bc-a76106ad9448-dshm\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:07.687737 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.687735 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnmr7\" (UniqueName: \"kubernetes.io/projected/11451a43-a404-4f2a-817d-47eacf3f50c1-kube-api-access-rnmr7\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:07.687932 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.687750 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxrtm\" (UniqueName: \"kubernetes.io/projected/3adae990-c59e-42e0-98bc-a76106ad9448-kube-api-access-jxrtm\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:07.687932 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.687762 5784 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-tmp-dir\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:07.687932 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.687774 5784 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-home\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:07.687932 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.687784 5784 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11451a43-a404-4f2a-817d-47eacf3f50c1-tls-certs\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:07.687932 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.687794 5784 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3adae990-c59e-42e0-98bc-a76106ad9448-tls-certs\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:07.687932 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:07.687805 5784 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11451a43-a404-4f2a-817d-47eacf3f50c1-dshm\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:08.103737 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:08.103702 5784 generic.go:356] "Generic (PLEG): container finished" podID="3adae990-c59e-42e0-98bc-a76106ad9448" containerID="02c6ca151fcb0d1bf3a4f4bd6e34257b6c19bd0b2d9e0c58608466da44797bdc" exitCode=0 Nov 04 06:10:08.103912 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:08.103743 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" Nov 04 06:10:08.103912 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:08.103788 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" event={"ID":"3adae990-c59e-42e0-98bc-a76106ad9448","Type":"ContainerDied","Data":"02c6ca151fcb0d1bf3a4f4bd6e34257b6c19bd0b2d9e0c58608466da44797bdc"} Nov 04 06:10:08.103912 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:08.103826 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc" event={"ID":"3adae990-c59e-42e0-98bc-a76106ad9448","Type":"ContainerDied","Data":"eaf80d1d70233f5b1bb3931384b637f937af1a07d9e059808f86ada9a68e43c3"} Nov 04 06:10:08.103912 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:08.103842 5784 scope.go:122] "RemoveContainer" containerID="02c6ca151fcb0d1bf3a4f4bd6e34257b6c19bd0b2d9e0c58608466da44797bdc" Nov 04 06:10:08.105203 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:08.105180 5784 generic.go:356] "Generic (PLEG): container finished" podID="11451a43-a404-4f2a-817d-47eacf3f50c1" containerID="c365bd8066b8630ba907b6e50d6194024c87703aaf7dacd150d678c19f1c2da0" exitCode=0 Nov 04 06:10:08.105306 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:08.105218 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" Nov 04 06:10:08.105306 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:08.105265 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" event={"ID":"11451a43-a404-4f2a-817d-47eacf3f50c1","Type":"ContainerDied","Data":"c365bd8066b8630ba907b6e50d6194024c87703aaf7dacd150d678c19f1c2da0"} Nov 04 06:10:08.105425 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:08.105303 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb" event={"ID":"11451a43-a404-4f2a-817d-47eacf3f50c1","Type":"ContainerDied","Data":"e2c76818d7bfaa9cab28f0b4fedef1c48ee7810129ab77a4aad4f07bdf2ce231"} Nov 04 06:10:08.121798 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:08.121781 5784 scope.go:122] "RemoveContainer" containerID="02c6ca151fcb0d1bf3a4f4bd6e34257b6c19bd0b2d9e0c58608466da44797bdc" Nov 04 06:10:08.122053 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:10:08.122035 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02c6ca151fcb0d1bf3a4f4bd6e34257b6c19bd0b2d9e0c58608466da44797bdc\": container with ID starting with 02c6ca151fcb0d1bf3a4f4bd6e34257b6c19bd0b2d9e0c58608466da44797bdc not found: ID does not exist" containerID="02c6ca151fcb0d1bf3a4f4bd6e34257b6c19bd0b2d9e0c58608466da44797bdc" Nov 04 06:10:08.122139 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:08.122074 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02c6ca151fcb0d1bf3a4f4bd6e34257b6c19bd0b2d9e0c58608466da44797bdc"} err="failed to get container status \"02c6ca151fcb0d1bf3a4f4bd6e34257b6c19bd0b2d9e0c58608466da44797bdc\": rpc error: code = NotFound desc = could not find container \"02c6ca151fcb0d1bf3a4f4bd6e34257b6c19bd0b2d9e0c58608466da44797bdc\": container with ID starting with 02c6ca151fcb0d1bf3a4f4bd6e34257b6c19bd0b2d9e0c58608466da44797bdc not found: ID does not exist" Nov 04 06:10:08.122139 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:08.122092 5784 scope.go:122] "RemoveContainer" containerID="c365bd8066b8630ba907b6e50d6194024c87703aaf7dacd150d678c19f1c2da0" Nov 04 06:10:08.129895 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:08.129872 5784 scope.go:122] "RemoveContainer" containerID="c365bd8066b8630ba907b6e50d6194024c87703aaf7dacd150d678c19f1c2da0" Nov 04 06:10:08.130141 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:10:08.130124 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c365bd8066b8630ba907b6e50d6194024c87703aaf7dacd150d678c19f1c2da0\": container with ID starting with c365bd8066b8630ba907b6e50d6194024c87703aaf7dacd150d678c19f1c2da0 not found: ID does not exist" containerID="c365bd8066b8630ba907b6e50d6194024c87703aaf7dacd150d678c19f1c2da0" Nov 04 06:10:08.130201 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:08.130146 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c365bd8066b8630ba907b6e50d6194024c87703aaf7dacd150d678c19f1c2da0"} err="failed to get container status \"c365bd8066b8630ba907b6e50d6194024c87703aaf7dacd150d678c19f1c2da0\": rpc error: code = NotFound desc = could not find container \"c365bd8066b8630ba907b6e50d6194024c87703aaf7dacd150d678c19f1c2da0\": container with ID starting with c365bd8066b8630ba907b6e50d6194024c87703aaf7dacd150d678c19f1c2da0 not found: ID does not exist" Nov 04 06:10:08.283920 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:08.283884 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb"] Nov 04 06:10:08.340397 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:08.340362 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/distinct-w0-f38f69-kserve-6b87889557-4vbfb"] Nov 04 06:10:08.407886 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:08.407810 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc"] Nov 04 06:10:08.413898 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:08.413875 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-f38f69/simulator-w0-f38f69-kserve-6d4b454675-94xgc"] Nov 04 06:10:09.015167 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:09.015135 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="11451a43-a404-4f2a-817d-47eacf3f50c1" path="/var/lib/kubelet/pods/11451a43-a404-4f2a-817d-47eacf3f50c1/volumes" Nov 04 06:10:09.015540 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:09.015526 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3adae990-c59e-42e0-98bc-a76106ad9448" path="/var/lib/kubelet/pods/3adae990-c59e-42e0-98bc-a76106ad9448/volumes" Nov 04 06:10:14.180786 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:14.180758 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:10:15.220429 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:15.220341 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" podUID="19be279e-8cc8-4d9c-baf1-72f119e0c509" containerName="main" containerID="cri-o://5256492efe5b802a1d7c475b6771bec4ceaaf3c71637efc7efa2f2bde33d2487" gracePeriod=45 Nov 04 06:10:15.361878 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:15.361577 5784 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" podUID="19be279e-8cc8-4d9c-baf1-72f119e0c509" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": dial tcp 10.134.0.48:8000: connect: connection refused" Nov 04 06:10:15.695085 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:10:15.685703 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:10:15.943073 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:15.943027 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:10:16.045882 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.045787 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-tmp-dir\") pod \"19be279e-8cc8-4d9c-baf1-72f119e0c509\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " Nov 04 06:10:16.045882 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.045827 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/19be279e-8cc8-4d9c-baf1-72f119e0c509-kube-api-access-4g94p\" (UniqueName: \"kubernetes.io/projected/19be279e-8cc8-4d9c-baf1-72f119e0c509-kube-api-access-4g94p\") pod \"19be279e-8cc8-4d9c-baf1-72f119e0c509\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " Nov 04 06:10:16.045882 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.045885 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/19be279e-8cc8-4d9c-baf1-72f119e0c509-tls-certs\" (UniqueName: \"kubernetes.io/secret/19be279e-8cc8-4d9c-baf1-72f119e0c509-tls-certs\") pod \"19be279e-8cc8-4d9c-baf1-72f119e0c509\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " Nov 04 06:10:16.046224 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.045953 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-model-cache\") pod \"19be279e-8cc8-4d9c-baf1-72f119e0c509\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " Nov 04 06:10:16.046224 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.045992 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-home\" (UniqueName: \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-home\") pod \"19be279e-8cc8-4d9c-baf1-72f119e0c509\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " Nov 04 06:10:16.046224 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.046020 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-dshm\" (UniqueName: \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-dshm\") pod \"19be279e-8cc8-4d9c-baf1-72f119e0c509\" (UID: \"19be279e-8cc8-4d9c-baf1-72f119e0c509\") " Nov 04 06:10:16.046224 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.046172 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-tmp-dir" pod "19be279e-8cc8-4d9c-baf1-72f119e0c509" (UID: "19be279e-8cc8-4d9c-baf1-72f119e0c509"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:16.046458 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.046400 5784 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-tmp-dir\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:16.046645 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.046620 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-model-cache" pod "19be279e-8cc8-4d9c-baf1-72f119e0c509" (UID: "19be279e-8cc8-4d9c-baf1-72f119e0c509"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:16.046848 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.046828 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-home" pod "19be279e-8cc8-4d9c-baf1-72f119e0c509" (UID: "19be279e-8cc8-4d9c-baf1-72f119e0c509"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:16.048793 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.048758 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-dshm" pod "19be279e-8cc8-4d9c-baf1-72f119e0c509" (UID: "19be279e-8cc8-4d9c-baf1-72f119e0c509"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:16.048793 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.048786 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19be279e-8cc8-4d9c-baf1-72f119e0c509-kube-api-access-4g94p" pod "19be279e-8cc8-4d9c-baf1-72f119e0c509" (UID: "19be279e-8cc8-4d9c-baf1-72f119e0c509"). InnerVolumeSpecName "kube-api-access-4g94p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:16.049138 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.049118 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19be279e-8cc8-4d9c-baf1-72f119e0c509-tls-certs" pod "19be279e-8cc8-4d9c-baf1-72f119e0c509" (UID: "19be279e-8cc8-4d9c-baf1-72f119e0c509"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 06:10:16.147633 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.146979 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g94p\" (UniqueName: \"kubernetes.io/projected/19be279e-8cc8-4d9c-baf1-72f119e0c509-kube-api-access-4g94p\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:16.147633 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.147010 5784 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19be279e-8cc8-4d9c-baf1-72f119e0c509-tls-certs\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:16.147633 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.147020 5784 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-model-cache\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:16.147633 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.147030 5784 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-home\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:16.147633 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.147038 5784 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19be279e-8cc8-4d9c-baf1-72f119e0c509-dshm\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:16.149872 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.149847 5784 generic.go:356] "Generic (PLEG): container finished" podID="19be279e-8cc8-4d9c-baf1-72f119e0c509" containerID="5256492efe5b802a1d7c475b6771bec4ceaaf3c71637efc7efa2f2bde33d2487" exitCode=0 Nov 04 06:10:16.150012 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.149934 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" event={"ID":"19be279e-8cc8-4d9c-baf1-72f119e0c509","Type":"ContainerDied","Data":"5256492efe5b802a1d7c475b6771bec4ceaaf3c71637efc7efa2f2bde33d2487"} Nov 04 06:10:16.150012 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.149969 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" event={"ID":"19be279e-8cc8-4d9c-baf1-72f119e0c509","Type":"ContainerDied","Data":"20c3460751576afdb39ba2b86294a8be4e67527a6fa8f29e7cf3951972b19ce0"} Nov 04 06:10:16.150012 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.149997 5784 scope.go:122] "RemoveContainer" containerID="5256492efe5b802a1d7c475b6771bec4ceaaf3c71637efc7efa2f2bde33d2487" Nov 04 06:10:16.150212 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.150160 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd" Nov 04 06:10:16.240730 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.240599 5784 scope.go:122] "RemoveContainer" containerID="5256492efe5b802a1d7c475b6771bec4ceaaf3c71637efc7efa2f2bde33d2487" Nov 04 06:10:16.241690 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:10:16.241082 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5256492efe5b802a1d7c475b6771bec4ceaaf3c71637efc7efa2f2bde33d2487\": container with ID starting with 5256492efe5b802a1d7c475b6771bec4ceaaf3c71637efc7efa2f2bde33d2487 not found: ID does not exist" containerID="5256492efe5b802a1d7c475b6771bec4ceaaf3c71637efc7efa2f2bde33d2487" Nov 04 06:10:16.241690 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.241111 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5256492efe5b802a1d7c475b6771bec4ceaaf3c71637efc7efa2f2bde33d2487"} err="failed to get container status \"5256492efe5b802a1d7c475b6771bec4ceaaf3c71637efc7efa2f2bde33d2487\": rpc error: code = NotFound desc = could not find container \"5256492efe5b802a1d7c475b6771bec4ceaaf3c71637efc7efa2f2bde33d2487\": container with ID starting with 5256492efe5b802a1d7c475b6771bec4ceaaf3c71637efc7efa2f2bde33d2487 not found: ID does not exist" Nov 04 06:10:16.378213 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.377879 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd"] Nov 04 06:10:16.378213 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:16.377943 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-db31ef/premium-w2-db31ef-kserve-86976d47b7-bdmmd"] Nov 04 06:10:17.021916 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:17.021873 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="19be279e-8cc8-4d9c-baf1-72f119e0c509" path="/var/lib/kubelet/pods/19be279e-8cc8-4d9c-baf1-72f119e0c509/volumes" Nov 04 06:10:33.536005 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:33.535970 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9"] Nov 04 06:10:33.536431 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:33.536226 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" podUID="a81368fd-b377-47da-87cf-42f4d5af0c11" containerName="istio-proxy" containerID="cri-o://f989280d3fa181c65c90d7ef95215f8c81ba6b4742972d6ad98a68a048feaa46" gracePeriod=30 Nov 04 06:10:33.552123 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:33.552096 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq"] Nov 04 06:10:33.552312 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:33.552276 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" podUID="b2a3b0d0-9798-4e82-99ae-a199e50fe6e8" containerName="istio-proxy" containerID="cri-o://acb6155500d6757504d5133daa1af97d9ae601cecfa1ba87aaa26282f52d5d1d" gracePeriod=30 Nov 04 06:10:33.591604 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:33.591570 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47"] Nov 04 06:10:33.591822 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:33.591800 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" podUID="526e23b8-8dee-42ad-a67e-049baee60a2e" containerName="istio-proxy" containerID="cri-o://c0e8ce2b2ef4ba953f4747d5e6e728744e572a9a91a8a22c9463e9a08bbd6877" gracePeriod=30 Nov 04 06:10:35.129595 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:35.129560 5784 patch_prober.go:29] interesting pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 06:10:35.130052 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:35.129638 5784 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" podUID="b2a3b0d0-9798-4e82-99ae-a199e50fe6e8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 06:10:38.843825 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.843792 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:10:38.893287 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.893257 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:10:38.896313 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896293 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-data\") pod \"a81368fd-b377-47da-87cf-42f4d5af0c11\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " Nov 04 06:10:38.896427 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896330 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-workload-socket\") pod \"a81368fd-b377-47da-87cf-42f4d5af0c11\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " Nov 04 06:10:38.896427 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896353 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-workload-socket\") pod \"526e23b8-8dee-42ad-a67e-049baee60a2e\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " Nov 04 06:10:38.896427 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896375 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-credential-socket\") pod \"526e23b8-8dee-42ad-a67e-049baee60a2e\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " Nov 04 06:10:38.896427 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896407 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-credential-socket\") pod \"a81368fd-b377-47da-87cf-42f4d5af0c11\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " Nov 04 06:10:38.896644 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896450 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-data\") pod \"526e23b8-8dee-42ad-a67e-049baee60a2e\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " Nov 04 06:10:38.896644 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896484 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a81368fd-b377-47da-87cf-42f4d5af0c11-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a81368fd-b377-47da-87cf-42f4d5af0c11-istiod-ca-cert\") pod \"a81368fd-b377-47da-87cf-42f4d5af0c11\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " Nov 04 06:10:38.896644 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896512 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-envoy\") pod \"526e23b8-8dee-42ad-a67e-049baee60a2e\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " Nov 04 06:10:38.896644 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896562 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-token\" (UniqueName: \"kubernetes.io/projected/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-token\") pod \"a81368fd-b377-47da-87cf-42f4d5af0c11\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " Nov 04 06:10:38.896644 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896568 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-data" pod "a81368fd-b377-47da-87cf-42f4d5af0c11" (UID: "a81368fd-b377-47da-87cf-42f4d5af0c11"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.896644 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896579 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-workload-socket" pod "526e23b8-8dee-42ad-a67e-049baee60a2e" (UID: "526e23b8-8dee-42ad-a67e-049baee60a2e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.896644 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896588 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/526e23b8-8dee-42ad-a67e-049baee60a2e-kube-api-access-zj8sr\" (UniqueName: \"kubernetes.io/projected/526e23b8-8dee-42ad-a67e-049baee60a2e-kube-api-access-zj8sr\") pod \"526e23b8-8dee-42ad-a67e-049baee60a2e\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " Nov 04 06:10:38.896644 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896593 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-workload-socket" pod "a81368fd-b377-47da-87cf-42f4d5af0c11" (UID: "a81368fd-b377-47da-87cf-42f4d5af0c11"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.896644 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896632 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-workload-certs\") pod \"a81368fd-b377-47da-87cf-42f4d5af0c11\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " Nov 04 06:10:38.897113 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896667 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-envoy\") pod \"a81368fd-b377-47da-87cf-42f4d5af0c11\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " Nov 04 06:10:38.897113 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896698 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-data" pod "526e23b8-8dee-42ad-a67e-049baee60a2e" (UID: "526e23b8-8dee-42ad-a67e-049baee60a2e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.897113 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896707 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-credential-socket" pod "a81368fd-b377-47da-87cf-42f4d5af0c11" (UID: "a81368fd-b377-47da-87cf-42f4d5af0c11"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.897113 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896719 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/526e23b8-8dee-42ad-a67e-049baee60a2e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/526e23b8-8dee-42ad-a67e-049baee60a2e-istiod-ca-cert\") pod \"526e23b8-8dee-42ad-a67e-049baee60a2e\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " Nov 04 06:10:38.897113 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896722 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-credential-socket" pod "526e23b8-8dee-42ad-a67e-049baee60a2e" (UID: "526e23b8-8dee-42ad-a67e-049baee60a2e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.897113 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896767 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a81368fd-b377-47da-87cf-42f4d5af0c11-kube-api-access-mj8cp\" (UniqueName: \"kubernetes.io/projected/a81368fd-b377-47da-87cf-42f4d5af0c11-kube-api-access-mj8cp\") pod \"a81368fd-b377-47da-87cf-42f4d5af0c11\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " Nov 04 06:10:38.897113 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896794 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-podinfo\") pod \"a81368fd-b377-47da-87cf-42f4d5af0c11\" (UID: \"a81368fd-b377-47da-87cf-42f4d5af0c11\") " Nov 04 06:10:38.897113 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896825 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-podinfo\") pod \"526e23b8-8dee-42ad-a67e-049baee60a2e\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " Nov 04 06:10:38.897113 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896864 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-workload-certs\") pod \"526e23b8-8dee-42ad-a67e-049baee60a2e\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " Nov 04 06:10:38.897113 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896904 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-token\" (UniqueName: \"kubernetes.io/projected/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-token\") pod \"526e23b8-8dee-42ad-a67e-049baee60a2e\" (UID: \"526e23b8-8dee-42ad-a67e-049baee60a2e\") " Nov 04 06:10:38.897113 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896937 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-workload-certs" pod "a81368fd-b377-47da-87cf-42f4d5af0c11" (UID: "a81368fd-b377-47da-87cf-42f4d5af0c11"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.897113 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.896979 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a81368fd-b377-47da-87cf-42f4d5af0c11-istiod-ca-cert" pod "a81368fd-b377-47da-87cf-42f4d5af0c11" (UID: "a81368fd-b377-47da-87cf-42f4d5af0c11"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:10:38.897727 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.897277 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/526e23b8-8dee-42ad-a67e-049baee60a2e-istiod-ca-cert" pod "526e23b8-8dee-42ad-a67e-049baee60a2e" (UID: "526e23b8-8dee-42ad-a67e-049baee60a2e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:10:38.897727 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.897342 5784 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-workload-certs\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.897727 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.897359 5784 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-data\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.897727 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.897373 5784 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-workload-socket\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.897727 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.897387 5784 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-workload-socket\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.897727 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.897401 5784 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-credential-socket\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.897727 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.897412 5784 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-credential-socket\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.897727 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.897425 5784 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-data\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.897727 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.897437 5784 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a81368fd-b377-47da-87cf-42f4d5af0c11-istiod-ca-cert\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.897727 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.897509 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-workload-certs" pod "526e23b8-8dee-42ad-a67e-049baee60a2e" (UID: "526e23b8-8dee-42ad-a67e-049baee60a2e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.897727 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.897626 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:10:38.899092 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.899039 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-token" pod "a81368fd-b377-47da-87cf-42f4d5af0c11" (UID: "a81368fd-b377-47da-87cf-42f4d5af0c11"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:38.899462 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.899431 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-envoy" pod "a81368fd-b377-47da-87cf-42f4d5af0c11" (UID: "a81368fd-b377-47da-87cf-42f4d5af0c11"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.899600 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.899579 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-envoy" pod "526e23b8-8dee-42ad-a67e-049baee60a2e" (UID: "526e23b8-8dee-42ad-a67e-049baee60a2e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.899662 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.899596 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-podinfo" pod "a81368fd-b377-47da-87cf-42f4d5af0c11" (UID: "a81368fd-b377-47da-87cf-42f4d5af0c11"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:10:38.899849 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.899827 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-token" pod "526e23b8-8dee-42ad-a67e-049baee60a2e" (UID: "526e23b8-8dee-42ad-a67e-049baee60a2e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:38.899988 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.899968 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-podinfo" pod "526e23b8-8dee-42ad-a67e-049baee60a2e" (UID: "526e23b8-8dee-42ad-a67e-049baee60a2e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:10:38.900739 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.900721 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a81368fd-b377-47da-87cf-42f4d5af0c11-kube-api-access-mj8cp" pod "a81368fd-b377-47da-87cf-42f4d5af0c11" (UID: "a81368fd-b377-47da-87cf-42f4d5af0c11"). InnerVolumeSpecName "kube-api-access-mj8cp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:38.900894 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.900880 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/526e23b8-8dee-42ad-a67e-049baee60a2e-kube-api-access-zj8sr" pod "526e23b8-8dee-42ad-a67e-049baee60a2e" (UID: "526e23b8-8dee-42ad-a67e-049baee60a2e"). InnerVolumeSpecName "kube-api-access-zj8sr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:38.998396 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.998363 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-envoy\") pod \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " Nov 04 06:10:38.998554 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.998422 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-workload-socket\") pod \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " Nov 04 06:10:38.998554 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.998474 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-data\") pod \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " Nov 04 06:10:38.998554 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.998542 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-credential-socket\") pod \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " Nov 04 06:10:38.998726 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.998581 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-podinfo\") pod \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " Nov 04 06:10:38.998726 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.998628 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-kube-api-access-ztscf\" (UniqueName: \"kubernetes.io/projected/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-kube-api-access-ztscf\") pod \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " Nov 04 06:10:38.998726 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.998705 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-workload-certs\") pod \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " Nov 04 06:10:38.998879 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.998746 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-token\" (UniqueName: \"kubernetes.io/projected/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-token\") pod \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " Nov 04 06:10:38.998879 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.998745 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-workload-socket" pod "b2a3b0d0-9798-4e82-99ae-a199e50fe6e8" (UID: "b2a3b0d0-9798-4e82-99ae-a199e50fe6e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.998879 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.998785 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istiod-ca-cert\") pod \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\" (UID: \"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8\") " Nov 04 06:10:38.998879 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.998821 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-credential-socket" pod "b2a3b0d0-9798-4e82-99ae-a199e50fe6e8" (UID: "b2a3b0d0-9798-4e82-99ae-a199e50fe6e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.999192 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.998962 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-workload-certs" pod "b2a3b0d0-9798-4e82-99ae-a199e50fe6e8" (UID: "b2a3b0d0-9798-4e82-99ae-a199e50fe6e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.999192 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.999130 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-data" pod "b2a3b0d0-9798-4e82-99ae-a199e50fe6e8" (UID: "b2a3b0d0-9798-4e82-99ae-a199e50fe6e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:38.999299 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.999261 5784 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-credential-socket\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.999299 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.999282 5784 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/526e23b8-8dee-42ad-a67e-049baee60a2e-istiod-ca-cert\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.999410 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.999298 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mj8cp\" (UniqueName: \"kubernetes.io/projected/a81368fd-b377-47da-87cf-42f4d5af0c11-kube-api-access-mj8cp\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.999410 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.999315 5784 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-podinfo\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.999410 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.999319 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istiod-ca-cert" pod "b2a3b0d0-9798-4e82-99ae-a199e50fe6e8" (UID: "b2a3b0d0-9798-4e82-99ae-a199e50fe6e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:10:38.999410 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.999329 5784 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-podinfo\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.999410 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.999363 5784 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-workload-certs\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.999410 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.999381 5784 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-token\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.999410 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.999396 5784 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-workload-certs\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.999410 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.999410 5784 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/526e23b8-8dee-42ad-a67e-049baee60a2e-istio-envoy\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.999822 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.999425 5784 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-workload-socket\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.999822 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.999439 5784 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-token\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.999822 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.999455 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zj8sr\" (UniqueName: \"kubernetes.io/projected/526e23b8-8dee-42ad-a67e-049baee60a2e-kube-api-access-zj8sr\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:38.999822 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:38.999471 5784 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a81368fd-b377-47da-87cf-42f4d5af0c11-istio-envoy\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.000777 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.000751 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-podinfo" pod "b2a3b0d0-9798-4e82-99ae-a199e50fe6e8" (UID: "b2a3b0d0-9798-4e82-99ae-a199e50fe6e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:10:39.000915 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.000900 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-token" pod "b2a3b0d0-9798-4e82-99ae-a199e50fe6e8" (UID: "b2a3b0d0-9798-4e82-99ae-a199e50fe6e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:39.001088 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.001044 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-envoy" pod "b2a3b0d0-9798-4e82-99ae-a199e50fe6e8" (UID: "b2a3b0d0-9798-4e82-99ae-a199e50fe6e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:39.001177 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.001085 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-kube-api-access-ztscf" pod "b2a3b0d0-9798-4e82-99ae-a199e50fe6e8" (UID: "b2a3b0d0-9798-4e82-99ae-a199e50fe6e8"). InnerVolumeSpecName "kube-api-access-ztscf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:39.100641 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.100613 5784 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-envoy\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.100641 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.100636 5784 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-data\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.100641 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.100645 5784 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-podinfo\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.100860 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.100655 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztscf\" (UniqueName: \"kubernetes.io/projected/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-kube-api-access-ztscf\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.100860 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.100664 5784 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istio-token\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.100860 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.100673 5784 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8-istiod-ca-cert\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:39.267230 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.267196 5784 generic.go:356] "Generic (PLEG): container finished" podID="b2a3b0d0-9798-4e82-99ae-a199e50fe6e8" containerID="acb6155500d6757504d5133daa1af97d9ae601cecfa1ba87aaa26282f52d5d1d" exitCode=0 Nov 04 06:10:39.267395 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.267247 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" Nov 04 06:10:39.267395 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.267280 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" event={"ID":"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8","Type":"ContainerDied","Data":"acb6155500d6757504d5133daa1af97d9ae601cecfa1ba87aaa26282f52d5d1d"} Nov 04 06:10:39.267395 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.267332 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq" event={"ID":"b2a3b0d0-9798-4e82-99ae-a199e50fe6e8","Type":"ContainerDied","Data":"f7900615b442937feb8be9eef6980289fbc49461ba39955387c1c85c865b1ffc"} Nov 04 06:10:39.267395 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.267354 5784 scope.go:122] "RemoveContainer" containerID="acb6155500d6757504d5133daa1af97d9ae601cecfa1ba87aaa26282f52d5d1d" Nov 04 06:10:39.268655 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.268633 5784 generic.go:356] "Generic (PLEG): container finished" podID="a81368fd-b377-47da-87cf-42f4d5af0c11" containerID="f989280d3fa181c65c90d7ef95215f8c81ba6b4742972d6ad98a68a048feaa46" exitCode=0 Nov 04 06:10:39.268792 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.268691 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" Nov 04 06:10:39.268792 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.268725 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" event={"ID":"a81368fd-b377-47da-87cf-42f4d5af0c11","Type":"ContainerDied","Data":"f989280d3fa181c65c90d7ef95215f8c81ba6b4742972d6ad98a68a048feaa46"} Nov 04 06:10:39.268792 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.268773 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9" event={"ID":"a81368fd-b377-47da-87cf-42f4d5af0c11","Type":"ContainerDied","Data":"403b2b48c77a865635df20f76a18da7aba3253bb3d46aab39f3a043882d1133c"} Nov 04 06:10:39.270224 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.270204 5784 generic.go:356] "Generic (PLEG): container finished" podID="526e23b8-8dee-42ad-a67e-049baee60a2e" containerID="c0e8ce2b2ef4ba953f4747d5e6e728744e572a9a91a8a22c9463e9a08bbd6877" exitCode=0 Nov 04 06:10:39.270224 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.270230 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" event={"ID":"526e23b8-8dee-42ad-a67e-049baee60a2e","Type":"ContainerDied","Data":"c0e8ce2b2ef4ba953f4747d5e6e728744e572a9a91a8a22c9463e9a08bbd6877"} Nov 04 06:10:39.270396 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.270260 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" event={"ID":"526e23b8-8dee-42ad-a67e-049baee60a2e","Type":"ContainerDied","Data":"5ab0356064540833f7a8dc7508737d794dc579e4ab21b8ebb7c319297c307e27"} Nov 04 06:10:39.270396 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.270257 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47" Nov 04 06:10:39.277145 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.277126 5784 scope.go:122] "RemoveContainer" containerID="acb6155500d6757504d5133daa1af97d9ae601cecfa1ba87aaa26282f52d5d1d" Nov 04 06:10:39.277413 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:10:39.277395 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acb6155500d6757504d5133daa1af97d9ae601cecfa1ba87aaa26282f52d5d1d\": container with ID starting with acb6155500d6757504d5133daa1af97d9ae601cecfa1ba87aaa26282f52d5d1d not found: ID does not exist" containerID="acb6155500d6757504d5133daa1af97d9ae601cecfa1ba87aaa26282f52d5d1d" Nov 04 06:10:39.277458 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.277427 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acb6155500d6757504d5133daa1af97d9ae601cecfa1ba87aaa26282f52d5d1d"} err="failed to get container status \"acb6155500d6757504d5133daa1af97d9ae601cecfa1ba87aaa26282f52d5d1d\": rpc error: code = NotFound desc = could not find container \"acb6155500d6757504d5133daa1af97d9ae601cecfa1ba87aaa26282f52d5d1d\": container with ID starting with acb6155500d6757504d5133daa1af97d9ae601cecfa1ba87aaa26282f52d5d1d not found: ID does not exist" Nov 04 06:10:39.277458 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.277445 5784 scope.go:122] "RemoveContainer" containerID="f989280d3fa181c65c90d7ef95215f8c81ba6b4742972d6ad98a68a048feaa46" Nov 04 06:10:39.284962 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.284949 5784 scope.go:122] "RemoveContainer" containerID="f989280d3fa181c65c90d7ef95215f8c81ba6b4742972d6ad98a68a048feaa46" Nov 04 06:10:39.285210 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:10:39.285193 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f989280d3fa181c65c90d7ef95215f8c81ba6b4742972d6ad98a68a048feaa46\": container with ID starting with f989280d3fa181c65c90d7ef95215f8c81ba6b4742972d6ad98a68a048feaa46 not found: ID does not exist" containerID="f989280d3fa181c65c90d7ef95215f8c81ba6b4742972d6ad98a68a048feaa46" Nov 04 06:10:39.285265 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.285216 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f989280d3fa181c65c90d7ef95215f8c81ba6b4742972d6ad98a68a048feaa46"} err="failed to get container status \"f989280d3fa181c65c90d7ef95215f8c81ba6b4742972d6ad98a68a048feaa46\": rpc error: code = NotFound desc = could not find container \"f989280d3fa181c65c90d7ef95215f8c81ba6b4742972d6ad98a68a048feaa46\": container with ID starting with f989280d3fa181c65c90d7ef95215f8c81ba6b4742972d6ad98a68a048feaa46 not found: ID does not exist" Nov 04 06:10:39.285265 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.285233 5784 scope.go:122] "RemoveContainer" containerID="c0e8ce2b2ef4ba953f4747d5e6e728744e572a9a91a8a22c9463e9a08bbd6877" Nov 04 06:10:39.292717 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.292695 5784 scope.go:122] "RemoveContainer" containerID="c0e8ce2b2ef4ba953f4747d5e6e728744e572a9a91a8a22c9463e9a08bbd6877" Nov 04 06:10:39.293008 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:10:39.292986 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0e8ce2b2ef4ba953f4747d5e6e728744e572a9a91a8a22c9463e9a08bbd6877\": container with ID starting with c0e8ce2b2ef4ba953f4747d5e6e728744e572a9a91a8a22c9463e9a08bbd6877 not found: ID does not exist" containerID="c0e8ce2b2ef4ba953f4747d5e6e728744e572a9a91a8a22c9463e9a08bbd6877" Nov 04 06:10:39.293114 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.293016 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0e8ce2b2ef4ba953f4747d5e6e728744e572a9a91a8a22c9463e9a08bbd6877"} err="failed to get container status \"c0e8ce2b2ef4ba953f4747d5e6e728744e572a9a91a8a22c9463e9a08bbd6877\": rpc error: code = NotFound desc = could not find container \"c0e8ce2b2ef4ba953f4747d5e6e728744e572a9a91a8a22c9463e9a08bbd6877\": container with ID starting with c0e8ce2b2ef4ba953f4747d5e6e728744e572a9a91a8a22c9463e9a08bbd6877 not found: ID does not exist" Nov 04 06:10:39.418945 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.418866 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq"] Nov 04 06:10:39.424995 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.424919 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq"] Nov 04 06:10:39.547297 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.547267 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47"] Nov 04 06:10:39.551544 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.551522 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47"] Nov 04 06:10:39.672187 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.672107 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9"] Nov 04 06:10:39.676652 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:39.676626 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9"] Nov 04 06:10:41.014587 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:41.014550 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="526e23b8-8dee-42ad-a67e-049baee60a2e" path="/var/lib/kubelet/pods/526e23b8-8dee-42ad-a67e-049baee60a2e/volumes" Nov 04 06:10:41.015003 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:41.014989 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a81368fd-b377-47da-87cf-42f4d5af0c11" path="/var/lib/kubelet/pods/a81368fd-b377-47da-87cf-42f4d5af0c11/volumes" Nov 04 06:10:41.015446 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:41.015429 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b2a3b0d0-9798-4e82-99ae-a199e50fe6e8" path="/var/lib/kubelet/pods/b2a3b0d0-9798-4e82-99ae-a199e50fe6e8/volumes" Nov 04 06:10:42.953991 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:42.953952 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj"] Nov 04 06:10:42.954393 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:42.954158 5784 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" podUID="20e6f162-67a7-4f5a-9cba-280835f9e9eb" containerName="istio-proxy" containerID="cri-o://5269fd6a91516ad0b62784c13008214277548d37ba9e7fefbf9da8280081bf5a" gracePeriod=30 Nov 04 06:10:45.417752 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:10:45.417718 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:10:48.199128 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.199101 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:10:48.286676 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.286608 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-token\" (UniqueName: \"kubernetes.io/projected/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-token\") pod \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " Nov 04 06:10:48.286676 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.286651 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-envoy\") pod \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " Nov 04 06:10:48.286850 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.286779 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-data\") pod \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " Nov 04 06:10:48.286850 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.286824 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-credential-socket\") pod \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " Nov 04 06:10:48.286936 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.286864 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-workload-socket\") pod \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " Nov 04 06:10:48.286936 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.286902 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-workload-certs\") pod \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " Nov 04 06:10:48.287034 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.286955 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istiod-ca-cert\") pod \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " Nov 04 06:10:48.287034 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.286988 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-podinfo\") pod \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " Nov 04 06:10:48.287180 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.287042 5784 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/20e6f162-67a7-4f5a-9cba-280835f9e9eb-kube-api-access-b67cz\" (UniqueName: \"kubernetes.io/projected/20e6f162-67a7-4f5a-9cba-280835f9e9eb-kube-api-access-b67cz\") pod \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\" (UID: \"20e6f162-67a7-4f5a-9cba-280835f9e9eb\") " Nov 04 06:10:48.287317 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.287042 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-data" pod "20e6f162-67a7-4f5a-9cba-280835f9e9eb" (UID: "20e6f162-67a7-4f5a-9cba-280835f9e9eb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:48.287317 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.287179 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-credential-socket" pod "20e6f162-67a7-4f5a-9cba-280835f9e9eb" (UID: "20e6f162-67a7-4f5a-9cba-280835f9e9eb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:48.287317 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.287200 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-workload-socket" pod "20e6f162-67a7-4f5a-9cba-280835f9e9eb" (UID: "20e6f162-67a7-4f5a-9cba-280835f9e9eb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:48.287508 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.287226 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-workload-certs" pod "20e6f162-67a7-4f5a-9cba-280835f9e9eb" (UID: "20e6f162-67a7-4f5a-9cba-280835f9e9eb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:48.287508 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.287338 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istiod-ca-cert" pod "20e6f162-67a7-4f5a-9cba-280835f9e9eb" (UID: "20e6f162-67a7-4f5a-9cba-280835f9e9eb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 06:10:48.287508 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.287454 5784 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-credential-socket\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.287508 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.287479 5784 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-workload-socket\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.287508 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.287494 5784 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-workload-certs\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.287713 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.287508 5784 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istiod-ca-cert\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.287713 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.287522 5784 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-data\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.288823 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.288793 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-envoy" pod "20e6f162-67a7-4f5a-9cba-280835f9e9eb" (UID: "20e6f162-67a7-4f5a-9cba-280835f9e9eb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 06:10:48.289049 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.289027 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-podinfo" pod "20e6f162-67a7-4f5a-9cba-280835f9e9eb" (UID: "20e6f162-67a7-4f5a-9cba-280835f9e9eb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 06:10:48.289157 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.289134 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20e6f162-67a7-4f5a-9cba-280835f9e9eb-kube-api-access-b67cz" pod "20e6f162-67a7-4f5a-9cba-280835f9e9eb" (UID: "20e6f162-67a7-4f5a-9cba-280835f9e9eb"). InnerVolumeSpecName "kube-api-access-b67cz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:48.289365 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.289345 5784 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-token" pod "20e6f162-67a7-4f5a-9cba-280835f9e9eb" (UID: "20e6f162-67a7-4f5a-9cba-280835f9e9eb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 06:10:48.315638 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.315607 5784 generic.go:356] "Generic (PLEG): container finished" podID="20e6f162-67a7-4f5a-9cba-280835f9e9eb" containerID="5269fd6a91516ad0b62784c13008214277548d37ba9e7fefbf9da8280081bf5a" exitCode=0 Nov 04 06:10:48.315774 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.315662 5784 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" Nov 04 06:10:48.315774 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.315689 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" event={"ID":"20e6f162-67a7-4f5a-9cba-280835f9e9eb","Type":"ContainerDied","Data":"5269fd6a91516ad0b62784c13008214277548d37ba9e7fefbf9da8280081bf5a"} Nov 04 06:10:48.315774 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.315754 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj" event={"ID":"20e6f162-67a7-4f5a-9cba-280835f9e9eb","Type":"ContainerDied","Data":"c2e1b5eeae32b96a636c72cecfc853999b92aa6e49616fbcfdce1e63f79cfcec"} Nov 04 06:10:48.315921 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.315776 5784 scope.go:122] "RemoveContainer" containerID="5269fd6a91516ad0b62784c13008214277548d37ba9e7fefbf9da8280081bf5a" Nov 04 06:10:48.324501 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.324488 5784 scope.go:122] "RemoveContainer" containerID="5269fd6a91516ad0b62784c13008214277548d37ba9e7fefbf9da8280081bf5a" Nov 04 06:10:48.324739 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:10:48.324722 5784 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5269fd6a91516ad0b62784c13008214277548d37ba9e7fefbf9da8280081bf5a\": container with ID starting with 5269fd6a91516ad0b62784c13008214277548d37ba9e7fefbf9da8280081bf5a not found: ID does not exist" containerID="5269fd6a91516ad0b62784c13008214277548d37ba9e7fefbf9da8280081bf5a" Nov 04 06:10:48.324778 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.324748 5784 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5269fd6a91516ad0b62784c13008214277548d37ba9e7fefbf9da8280081bf5a"} err="failed to get container status \"5269fd6a91516ad0b62784c13008214277548d37ba9e7fefbf9da8280081bf5a\": rpc error: code = NotFound desc = could not find container \"5269fd6a91516ad0b62784c13008214277548d37ba9e7fefbf9da8280081bf5a\": container with ID starting with 5269fd6a91516ad0b62784c13008214277548d37ba9e7fefbf9da8280081bf5a not found: ID does not exist" Nov 04 06:10:48.389008 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.388967 5784 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-token\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.389008 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.389007 5784 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-envoy\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.389317 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.389028 5784 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20e6f162-67a7-4f5a-9cba-280835f9e9eb-istio-podinfo\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.389317 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.389042 5784 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b67cz\" (UniqueName: \"kubernetes.io/projected/20e6f162-67a7-4f5a-9cba-280835f9e9eb-kube-api-access-b67cz\") on node \"ip-10-0-134-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 06:10:48.510810 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.510770 5784 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj"] Nov 04 06:10:48.521864 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:48.521836 5784 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj"] Nov 04 06:10:49.019014 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:49.018983 5784 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="20e6f162-67a7-4f5a-9cba-280835f9e9eb" path="/var/lib/kubelet/pods/20e6f162-67a7-4f5a-9cba-280835f9e9eb/volumes" Nov 04 06:10:55.748227 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:55.748190 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-bnt6v"] Nov 04 06:10:57.122843 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:57.122815 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-5sp6z_070d92df-00ba-41ef-869f-574bbc71f8e3/manager/0.log" Nov 04 06:10:57.675382 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:57.675330 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-ddvq8_bf5526b8-c8a9-44f4-8127-fd8d3c9ab780/manager/0.log" Nov 04 06:10:58.012328 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:58.012256 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6684d95577-2m9xk_3a430fb7-e8ae-4f64-8f57-e5ea2b808725/manager/1.log" Nov 04 06:10:58.308138 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:58.308059 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-jvh5s_a7b48a8d-23bd-4e46-bfb5-27b2e2cf5098/server/0.log" Nov 04 06:10:58.541210 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:58.541184 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-j2scg_ab61e4c5-9f11-4bf8-a885-bc10fdf4d3b1/manager/0.log" Nov 04 06:10:58.783869 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:58.783843 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-f9tvh_8bb2009e-1695-4992-b637-3fb00b7aa0b7/proxy/0.log" Nov 04 06:10:59.417158 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:10:59.417129 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6684d95577-2m9xk_3a430fb7-e8ae-4f64-8f57-e5ea2b808725/manager/0.log" Nov 04 06:11:06.224083 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:11:06.224036 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-gh6pq_83cd6675-926e-41ef-b6d0-fb0f0cc89df9/kuadrant-console-plugin/0.log" Nov 04 06:11:07.111761 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:11:07.111725 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-bnt6v_17c10873-db3c-4006-a13c-88ccf9f70604/limitador/0.log" Nov 04 06:11:08.820172 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:11:08.820143 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c8546cb5f-2lpkm_8ca38de8-70a7-4e51-8f3e-e7dabd425d24/kube-auth-proxy/0.log" Nov 04 06:11:15.417752 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:11:15.417679 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:11:23.340353 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:11:23.340321 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-5sp6z_070d92df-00ba-41ef-869f-574bbc71f8e3/manager/0.log" Nov 04 06:11:23.859211 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:11:23.859183 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-ddvq8_bf5526b8-c8a9-44f4-8127-fd8d3c9ab780/manager/0.log" Nov 04 06:11:24.134305 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:11:24.134233 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6684d95577-2m9xk_3a430fb7-e8ae-4f64-8f57-e5ea2b808725/manager/1.log" Nov 04 06:11:24.404572 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:11:24.404491 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-jvh5s_a7b48a8d-23bd-4e46-bfb5-27b2e2cf5098/server/0.log" Nov 04 06:11:24.626983 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:11:24.626954 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-j2scg_ab61e4c5-9f11-4bf8-a885-bc10fdf4d3b1/manager/0.log" Nov 04 06:11:24.893221 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:11:24.893191 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-f9tvh_8bb2009e-1695-4992-b637-3fb00b7aa0b7/proxy/0.log" Nov 04 06:11:30.660018 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:11:30.659989 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-gh6pq_83cd6675-926e-41ef-b6d0-fb0f0cc89df9/kuadrant-console-plugin/0.log" Nov 04 06:11:31.246299 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:11:31.246266 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-bnt6v_17c10873-db3c-4006-a13c-88ccf9f70604/limitador/0.log" Nov 04 06:11:32.502472 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:11:32.502448 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c8546cb5f-2lpkm_8ca38de8-70a7-4e51-8f3e-e7dabd425d24/kube-auth-proxy/0.log" Nov 04 06:11:45.418833 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:11:45.418792 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:11:58.310601 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:11:58.310570 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6684d95577-2m9xk_3a430fb7-e8ae-4f64-8f57-e5ea2b808725/manager/1.log" Nov 04 06:11:58.867041 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:11:58.867006 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6684d95577-2m9xk_3a430fb7-e8ae-4f64-8f57-e5ea2b808725/manager/1.log" Nov 04 06:12:14.703378 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:14.703343 5784 generic.go:356] "Generic (PLEG): container finished" podID="3a430fb7-e8ae-4f64-8f57-e5ea2b808725" containerID="54288469650a9e9096e8142e0832dfd7e6dcfa7c4c811c1f3b172de80b8f344e" exitCode=1 Nov 04 06:12:14.703819 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:14.703423 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6684d95577-2m9xk" event={"ID":"3a430fb7-e8ae-4f64-8f57-e5ea2b808725","Type":"ContainerDied","Data":"54288469650a9e9096e8142e0832dfd7e6dcfa7c4c811c1f3b172de80b8f344e"} Nov 04 06:12:14.703819 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:14.703516 5784 scope.go:122] "RemoveContainer" containerID="c070aab727e08f06150b70400fba7b01f75a41e1005f58d5f465342d23274118" Nov 04 06:12:14.703944 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:14.703828 5784 scope.go:122] "RemoveContainer" containerID="54288469650a9e9096e8142e0832dfd7e6dcfa7c4c811c1f3b172de80b8f344e" Nov 04 06:12:15.417804 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:12:15.417755 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:12:15.617715 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:15.617685 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Nov 04 06:12:15.710887 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:15.710853 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6684d95577-2m9xk" event={"ID":"3a430fb7-e8ae-4f64-8f57-e5ea2b808725","Type":"ContainerStarted","Data":"993e65a6b7057cfa3d12111198eb2db96968a11913d794f122ef21987efae208"} Nov 04 06:12:15.711291 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:15.711050 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6684d95577-2m9xk" Nov 04 06:12:16.717726 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:16.717695 5784 generic.go:356] "Generic (PLEG): container finished" podID="070d92df-00ba-41ef-869f-574bbc71f8e3" containerID="8e17a8c9f9e02b1d69b9840e25a7737e8bff277098f224c03c648e07ff663464" exitCode=1 Nov 04 06:12:16.718184 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:16.717767 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-5sp6z" event={"ID":"070d92df-00ba-41ef-869f-574bbc71f8e3","Type":"ContainerDied","Data":"8e17a8c9f9e02b1d69b9840e25a7737e8bff277098f224c03c648e07ff663464"} Nov 04 06:12:16.718249 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:16.718232 5784 scope.go:122] "RemoveContainer" containerID="8e17a8c9f9e02b1d69b9840e25a7737e8bff277098f224c03c648e07ff663464" Nov 04 06:12:17.724416 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:17.724384 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-5sp6z" event={"ID":"070d92df-00ba-41ef-869f-574bbc71f8e3","Type":"ContainerStarted","Data":"01507376029b1eff757ca076556b471fb75eccbad684cb0703b2bd85376cf197"} Nov 04 06:12:17.724806 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:17.724587 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-5sp6z" Nov 04 06:12:26.720152 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:26.720108 5784 prober.go:122] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-6684d95577-2m9xk" podUID="3a430fb7-e8ae-4f64-8f57-e5ea2b808725" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.31:8081/readyz\": dial tcp 10.134.0.31:8081: connect: connection refused" Nov 04 06:12:26.768217 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:26.768182 5784 generic.go:356] "Generic (PLEG): container finished" podID="3a430fb7-e8ae-4f64-8f57-e5ea2b808725" containerID="993e65a6b7057cfa3d12111198eb2db96968a11913d794f122ef21987efae208" exitCode=1 Nov 04 06:12:26.768415 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:26.768264 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6684d95577-2m9xk" event={"ID":"3a430fb7-e8ae-4f64-8f57-e5ea2b808725","Type":"ContainerDied","Data":"993e65a6b7057cfa3d12111198eb2db96968a11913d794f122ef21987efae208"} Nov 04 06:12:26.768415 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:26.768372 5784 scope.go:122] "RemoveContainer" containerID="54288469650a9e9096e8142e0832dfd7e6dcfa7c4c811c1f3b172de80b8f344e" Nov 04 06:12:26.768773 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:26.768754 5784 scope.go:122] "RemoveContainer" containerID="993e65a6b7057cfa3d12111198eb2db96968a11913d794f122ef21987efae208" Nov 04 06:12:26.768981 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:12:26.768963 5784 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-6684d95577-2m9xk_opendatahub(3a430fb7-e8ae-4f64-8f57-e5ea2b808725)\"" pod="opendatahub/maas-controller-6684d95577-2m9xk" podUID="3a430fb7-e8ae-4f64-8f57-e5ea2b808725" Nov 04 06:12:28.251133 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:28.251092 5784 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-6684d95577-2m9xk" Nov 04 06:12:28.251547 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:28.251479 5784 scope.go:122] "RemoveContainer" containerID="993e65a6b7057cfa3d12111198eb2db96968a11913d794f122ef21987efae208" Nov 04 06:12:28.251705 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:12:28.251685 5784 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-6684d95577-2m9xk_opendatahub(3a430fb7-e8ae-4f64-8f57-e5ea2b808725)\"" pod="opendatahub/maas-controller-6684d95577-2m9xk" podUID="3a430fb7-e8ae-4f64-8f57-e5ea2b808725" Nov 04 06:12:30.238833 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:30.238803 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6684d95577-2m9xk_3a430fb7-e8ae-4f64-8f57-e5ea2b808725/manager/2.log" Nov 04 06:12:30.465279 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:30.465245 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6684d95577-2m9xk_3a430fb7-e8ae-4f64-8f57-e5ea2b808725/manager/2.log" Nov 04 06:12:37.009133 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:37.009104 5784 scope.go:122] "RemoveContainer" containerID="993e65a6b7057cfa3d12111198eb2db96968a11913d794f122ef21987efae208" Nov 04 06:12:37.009594 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:37.009549 5784 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 06:12:38.831011 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:38.830969 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6684d95577-2m9xk" event={"ID":"3a430fb7-e8ae-4f64-8f57-e5ea2b808725","Type":"ContainerStarted","Data":"eebfd5f24c03de733707e571ab81c03097f5c25e53af39ccdebfb305c95e4bc8"} Nov 04 06:12:38.831419 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:38.831250 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6684d95577-2m9xk" Nov 04 06:12:41.646307 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:41.646192 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9vrcj_635418a3-d2fd-4dcc-8893-8488f45988c0/global-pull-secret-syncer/0.log" Nov 04 06:12:44.730307 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:44.730279 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-plf2w_59bf3884-8cc8-4a80-a064-470c85186dda/konnectivity-agent/0.log" Nov 04 06:12:45.417741 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:12:45.417701 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:12:46.062622 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:46.062563 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-45.us-west-1.compute.internal_cac56becdfbf016c3dc7fcb0c6060f7b/haproxy/0.log" Nov 04 06:12:48.733455 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:48.733426 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-5sp6z" Nov 04 06:12:49.838226 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:12:49.838197 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6684d95577-2m9xk" Nov 04 06:13:01.390412 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:01.390384 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-gh6pq_83cd6675-926e-41ef-b6d0-fb0f0cc89df9/kuadrant-console-plugin/0.log" Nov 04 06:13:02.435760 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:02.435727 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-bnt6v_17c10873-db3c-4006-a13c-88ccf9f70604/limitador/0.log" Nov 04 06:13:03.709412 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709381 5784 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t"] Nov 04 06:13:03.709779 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709750 5784 cpu_manager.go:414] "containerMap: removing container" podUID="7f400444-178f-4421-80f9-c8c9288651a7" containerName="istio-proxy" Nov 04 06:13:03.709779 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709761 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7f400444-178f-4421-80f9-c8c9288651a7" containerName="istio-proxy" Nov 04 06:13:03.709853 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709783 5784 cpu_manager.go:414] "containerMap: removing container" podUID="b2a3b0d0-9798-4e82-99ae-a199e50fe6e8" containerName="istio-proxy" Nov 04 06:13:03.709853 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709789 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b2a3b0d0-9798-4e82-99ae-a199e50fe6e8" containerName="istio-proxy" Nov 04 06:13:03.709853 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709795 5784 cpu_manager.go:414] "containerMap: removing container" podUID="b91f7014-bca4-4179-b042-a02f6a7f3ea1" containerName="istio-proxy" Nov 04 06:13:03.709853 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709801 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b91f7014-bca4-4179-b042-a02f6a7f3ea1" containerName="istio-proxy" Nov 04 06:13:03.709853 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709807 5784 cpu_manager.go:414] "containerMap: removing container" podUID="526e23b8-8dee-42ad-a67e-049baee60a2e" containerName="istio-proxy" Nov 04 06:13:03.709853 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709812 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="526e23b8-8dee-42ad-a67e-049baee60a2e" containerName="istio-proxy" Nov 04 06:13:03.709853 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709820 5784 cpu_manager.go:414] "containerMap: removing container" podUID="a81368fd-b377-47da-87cf-42f4d5af0c11" containerName="istio-proxy" Nov 04 06:13:03.709853 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709824 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a81368fd-b377-47da-87cf-42f4d5af0c11" containerName="istio-proxy" Nov 04 06:13:03.709853 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709842 5784 cpu_manager.go:414] "containerMap: removing container" podUID="3adae990-c59e-42e0-98bc-a76106ad9448" containerName="main" Nov 04 06:13:03.709853 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709848 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3adae990-c59e-42e0-98bc-a76106ad9448" containerName="main" Nov 04 06:13:03.710203 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709859 5784 cpu_manager.go:414] "containerMap: removing container" podUID="11451a43-a404-4f2a-817d-47eacf3f50c1" containerName="main" Nov 04 06:13:03.710203 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709867 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="11451a43-a404-4f2a-817d-47eacf3f50c1" containerName="main" Nov 04 06:13:03.710203 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709878 5784 cpu_manager.go:414] "containerMap: removing container" podUID="2c57f68b-83f0-4f3a-88df-ab9f6082804b" containerName="istio-proxy" Nov 04 06:13:03.710203 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709883 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2c57f68b-83f0-4f3a-88df-ab9f6082804b" containerName="istio-proxy" Nov 04 06:13:03.710203 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709889 5784 cpu_manager.go:414] "containerMap: removing container" podUID="19be279e-8cc8-4d9c-baf1-72f119e0c509" containerName="main" Nov 04 06:13:03.710203 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709894 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="19be279e-8cc8-4d9c-baf1-72f119e0c509" containerName="main" Nov 04 06:13:03.710203 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709901 5784 cpu_manager.go:414] "containerMap: removing container" podUID="20e6f162-67a7-4f5a-9cba-280835f9e9eb" containerName="istio-proxy" Nov 04 06:13:03.710203 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709907 5784 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="20e6f162-67a7-4f5a-9cba-280835f9e9eb" containerName="istio-proxy" Nov 04 06:13:03.710203 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709969 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="11451a43-a404-4f2a-817d-47eacf3f50c1" containerName="main" Nov 04 06:13:03.710203 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709977 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="3adae990-c59e-42e0-98bc-a76106ad9448" containerName="main" Nov 04 06:13:03.710203 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709983 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="2c57f68b-83f0-4f3a-88df-ab9f6082804b" containerName="istio-proxy" Nov 04 06:13:03.710203 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709990 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="19be279e-8cc8-4d9c-baf1-72f119e0c509" containerName="main" Nov 04 06:13:03.710203 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.709995 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="20e6f162-67a7-4f5a-9cba-280835f9e9eb" containerName="istio-proxy" Nov 04 06:13:03.710203 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.710002 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="7f400444-178f-4421-80f9-c8c9288651a7" containerName="istio-proxy" Nov 04 06:13:03.710203 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.710009 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="b2a3b0d0-9798-4e82-99ae-a199e50fe6e8" containerName="istio-proxy" Nov 04 06:13:03.710203 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.710014 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="b91f7014-bca4-4179-b042-a02f6a7f3ea1" containerName="istio-proxy" Nov 04 06:13:03.710203 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.710019 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="526e23b8-8dee-42ad-a67e-049baee60a2e" containerName="istio-proxy" Nov 04 06:13:03.710203 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.710023 5784 memory_manager.go:365] "RemoveStaleState removing state" podUID="a81368fd-b377-47da-87cf-42f4d5af0c11" containerName="istio-proxy" Nov 04 06:13:03.713778 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.713746 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t" Nov 04 06:13:03.771689 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.771659 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ntc6w\"/\"openshift-service-ca.crt\"" Nov 04 06:13:03.809488 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.809455 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9ee52a1b-95e8-42ba-9de8-815cb02e338a-proc\") pod \"perf-node-gather-daemonset-6sf2t\" (UID: \"9ee52a1b-95e8-42ba-9de8-815cb02e338a\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t" Nov 04 06:13:03.809654 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.809512 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmm5n\" (UniqueName: \"kubernetes.io/projected/9ee52a1b-95e8-42ba-9de8-815cb02e338a-kube-api-access-lmm5n\") pod \"perf-node-gather-daemonset-6sf2t\" (UID: \"9ee52a1b-95e8-42ba-9de8-815cb02e338a\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t" Nov 04 06:13:03.809654 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.809622 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9ee52a1b-95e8-42ba-9de8-815cb02e338a-podres\") pod \"perf-node-gather-daemonset-6sf2t\" (UID: \"9ee52a1b-95e8-42ba-9de8-815cb02e338a\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t" Nov 04 06:13:03.809746 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.809664 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ee52a1b-95e8-42ba-9de8-815cb02e338a-sys\") pod \"perf-node-gather-daemonset-6sf2t\" (UID: \"9ee52a1b-95e8-42ba-9de8-815cb02e338a\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t" Nov 04 06:13:03.809746 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.809691 5784 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ee52a1b-95e8-42ba-9de8-815cb02e338a-lib-modules\") pod \"perf-node-gather-daemonset-6sf2t\" (UID: \"9ee52a1b-95e8-42ba-9de8-815cb02e338a\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t" Nov 04 06:13:03.827396 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.827366 5784 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ntc6w\"/\"kube-root-ca.crt\"" Nov 04 06:13:03.827396 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.827368 5784 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ntc6w\"/\"default-dockercfg-pqhfh\"" Nov 04 06:13:03.828736 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.828716 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t"] Nov 04 06:13:03.911163 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.911133 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9ee52a1b-95e8-42ba-9de8-815cb02e338a-podres\") pod \"perf-node-gather-daemonset-6sf2t\" (UID: \"9ee52a1b-95e8-42ba-9de8-815cb02e338a\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t" Nov 04 06:13:03.911163 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.911167 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ee52a1b-95e8-42ba-9de8-815cb02e338a-sys\") pod \"perf-node-gather-daemonset-6sf2t\" (UID: \"9ee52a1b-95e8-42ba-9de8-815cb02e338a\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t" Nov 04 06:13:03.911383 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.911185 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ee52a1b-95e8-42ba-9de8-815cb02e338a-lib-modules\") pod \"perf-node-gather-daemonset-6sf2t\" (UID: \"9ee52a1b-95e8-42ba-9de8-815cb02e338a\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t" Nov 04 06:13:03.911383 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.911257 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9ee52a1b-95e8-42ba-9de8-815cb02e338a-proc\") pod \"perf-node-gather-daemonset-6sf2t\" (UID: \"9ee52a1b-95e8-42ba-9de8-815cb02e338a\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t" Nov 04 06:13:03.911383 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.911266 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ee52a1b-95e8-42ba-9de8-815cb02e338a-sys\") pod \"perf-node-gather-daemonset-6sf2t\" (UID: \"9ee52a1b-95e8-42ba-9de8-815cb02e338a\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t" Nov 04 06:13:03.911383 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.911265 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9ee52a1b-95e8-42ba-9de8-815cb02e338a-podres\") pod \"perf-node-gather-daemonset-6sf2t\" (UID: \"9ee52a1b-95e8-42ba-9de8-815cb02e338a\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t" Nov 04 06:13:03.911383 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.911291 5784 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmm5n\" (UniqueName: \"kubernetes.io/projected/9ee52a1b-95e8-42ba-9de8-815cb02e338a-kube-api-access-lmm5n\") pod \"perf-node-gather-daemonset-6sf2t\" (UID: \"9ee52a1b-95e8-42ba-9de8-815cb02e338a\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t" Nov 04 06:13:03.911383 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.911312 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ee52a1b-95e8-42ba-9de8-815cb02e338a-lib-modules\") pod \"perf-node-gather-daemonset-6sf2t\" (UID: \"9ee52a1b-95e8-42ba-9de8-815cb02e338a\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t" Nov 04 06:13:03.911383 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.911370 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9ee52a1b-95e8-42ba-9de8-815cb02e338a-proc\") pod \"perf-node-gather-daemonset-6sf2t\" (UID: \"9ee52a1b-95e8-42ba-9de8-815cb02e338a\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t" Nov 04 06:13:03.977913 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:03.977840 5784 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmm5n\" (UniqueName: \"kubernetes.io/projected/9ee52a1b-95e8-42ba-9de8-815cb02e338a-kube-api-access-lmm5n\") pod \"perf-node-gather-daemonset-6sf2t\" (UID: \"9ee52a1b-95e8-42ba-9de8-815cb02e338a\") " pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t" Nov 04 06:13:04.026157 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:04.026126 5784 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t" Nov 04 06:13:04.406365 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:04.406133 5784 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t"] Nov 04 06:13:04.409022 ip-10-0-134-45 kubenswrapper[5784]: W1104 06:13:04.408993 5784 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9ee52a1b_95e8_42ba_9de8_815cb02e338a.slice/crio-29714dbf0c382ea0c56b2060e9d061bddba98baeb036d3af98dc52b144f02515 WatchSource:0}: Error finding container 29714dbf0c382ea0c56b2060e9d061bddba98baeb036d3af98dc52b144f02515: Status 404 returned error can't find the container with id 29714dbf0c382ea0c56b2060e9d061bddba98baeb036d3af98dc52b144f02515 Nov 04 06:13:04.950362 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:04.950328 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t" event={"ID":"9ee52a1b-95e8-42ba-9de8-815cb02e338a","Type":"ContainerStarted","Data":"64520a84f65dcd3efe42b9bcc7ce0d77f9712e1bedac1745d305104f65584c09"} Nov 04 06:13:04.950787 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:04.950387 5784 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t" event={"ID":"9ee52a1b-95e8-42ba-9de8-815cb02e338a","Type":"ContainerStarted","Data":"29714dbf0c382ea0c56b2060e9d061bddba98baeb036d3af98dc52b144f02515"} Nov 04 06:13:04.950787 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:04.950427 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t" Nov 04 06:13:05.077800 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:05.077743 5784 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t" podStartSLOduration=2.07772989 podStartE2EDuration="2.07772989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 06:13:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 06:13:05.07669959 +0000 UTC m=+1384.213395988" watchObservedRunningTime="2026-11-04 06:13:05.07772989 +0000 UTC m=+1384.214426291" Nov 04 06:13:05.688900 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:05.688869 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec709b2f-fdd8-4370-b3ab-a53fc2f9902c/alertmanager/0.log" Nov 04 06:13:06.133344 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:06.133317 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec709b2f-fdd8-4370-b3ab-a53fc2f9902c/config-reloader/0.log" Nov 04 06:13:06.578445 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:06.578409 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec709b2f-fdd8-4370-b3ab-a53fc2f9902c/kube-rbac-proxy-web/0.log" Nov 04 06:13:07.023147 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:07.023029 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec709b2f-fdd8-4370-b3ab-a53fc2f9902c/kube-rbac-proxy/0.log" Nov 04 06:13:07.467038 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:07.467009 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec709b2f-fdd8-4370-b3ab-a53fc2f9902c/kube-rbac-proxy-metric/0.log" Nov 04 06:13:07.911350 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:07.911319 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec709b2f-fdd8-4370-b3ab-a53fc2f9902c/prom-label-proxy/0.log" Nov 04 06:13:08.355780 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:08.355750 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec709b2f-fdd8-4370-b3ab-a53fc2f9902c/init-config-reloader/0.log" Nov 04 06:13:09.253992 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:09.253962 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-fffzx_807edbb8-055e-4796-b4dd-b254a93313f6/kube-state-metrics/0.log" Nov 04 06:13:09.696228 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:09.696199 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-fffzx_807edbb8-055e-4796-b4dd-b254a93313f6/kube-rbac-proxy-main/0.log" Nov 04 06:13:10.141012 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:10.140978 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-fffzx_807edbb8-055e-4796-b4dd-b254a93313f6/kube-rbac-proxy-self/0.log" Nov 04 06:13:10.590661 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:10.590636 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-f6b6d94bc-bxlj7_e8cce0a3-8ffd-465e-8b77-d386fba907b5/metrics-server/0.log" Nov 04 06:13:10.965461 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:10.965391 5784 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ntc6w/perf-node-gather-daemonset-6sf2t" Nov 04 06:13:11.038463 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:11.038434 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-hpqtm_a9525137-701e-46b7-8582-322cd59aaf48/monitoring-plugin/0.log" Nov 04 06:13:12.829222 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:12.829190 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lzjh2_3b41e530-bd50-4905-8887-32286cfdedbf/node-exporter/0.log" Nov 04 06:13:13.273536 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:13.273459 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lzjh2_3b41e530-bd50-4905-8887-32286cfdedbf/kube-rbac-proxy/0.log" Nov 04 06:13:13.715573 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:13.715549 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lzjh2_3b41e530-bd50-4905-8887-32286cfdedbf/init-textfile/0.log" Nov 04 06:13:15.416928 ip-10-0-134-45 kubenswrapper[5784]: E1104 06:13:15.416893 5784 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-flcbl" containerName="extractor" Nov 04 06:13:15.501963 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:15.501935 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-dmklg_124a28d1-9d05-42d1-99d4-721942b23062/kube-rbac-proxy-main/0.log" Nov 04 06:13:15.946088 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:15.946034 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-dmklg_124a28d1-9d05-42d1-99d4-721942b23062/kube-rbac-proxy-self/0.log" Nov 04 06:13:16.395429 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:16.395404 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-dmklg_124a28d1-9d05-42d1-99d4-721942b23062/openshift-state-metrics/0.log" Nov 04 06:13:16.863282 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:16.863254 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7487de69-9b55-4363-a985-8c80366c2ae0/prometheus/0.log" Nov 04 06:13:17.315670 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:17.315600 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7487de69-9b55-4363-a985-8c80366c2ae0/config-reloader/0.log" Nov 04 06:13:17.763357 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:17.763327 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7487de69-9b55-4363-a985-8c80366c2ae0/thanos-sidecar/0.log" Nov 04 06:13:18.209105 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:18.209056 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7487de69-9b55-4363-a985-8c80366c2ae0/kube-rbac-proxy-web/0.log" Nov 04 06:13:18.655011 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:18.654971 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7487de69-9b55-4363-a985-8c80366c2ae0/kube-rbac-proxy/0.log" Nov 04 06:13:19.098957 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:19.098929 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7487de69-9b55-4363-a985-8c80366c2ae0/kube-rbac-proxy-thanos/0.log" Nov 04 06:13:19.543030 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:19.542928 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7487de69-9b55-4363-a985-8c80366c2ae0/init-config-reloader/0.log" Nov 04 06:13:19.996036 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:19.996005 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-d4p9r_ccf93b8e-80a1-4ae6-9d4e-643760607116/prometheus-operator/0.log" Nov 04 06:13:20.437642 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:20.437613 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-d4p9r_ccf93b8e-80a1-4ae6-9d4e-643760607116/kube-rbac-proxy/0.log" Nov 04 06:13:20.886510 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:20.886484 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-sj64z_8c71ae38-62e0-4de3-9cf9-c4ee58edd96a/prometheus-operator-admission-webhook/0.log" Nov 04 06:13:21.337795 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:21.337765 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-669d89855b-2q25b_afa6738b-bf5a-4935-872a-beeb48a57617/telemeter-client/0.log" Nov 04 06:13:21.789411 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:21.789327 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-669d89855b-2q25b_afa6738b-bf5a-4935-872a-beeb48a57617/reload/0.log" Nov 04 06:13:22.232659 ip-10-0-134-45 kubenswrapper[5784]: I1104 06:13:22.232633 5784 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-669d89855b-2q25b_afa6738b-bf5a-4935-872a-beeb48a57617/kube-rbac-proxy/0.log"