Oct 29 23:12:40.993151 ip-10-0-138-163 systemd[1]: Starting Kubernetes Kubelet... Oct 29 23:12:41.369397 ip-10-0-138-163 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 29 23:12:41.369397 ip-10-0-138-163 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 29 23:12:41.369397 ip-10-0-138-163 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 29 23:12:41.370437 ip-10-0-138-163 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 29 23:12:41.374163 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374069 2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:41.374163 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374164 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:41.374235 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374168 2581 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:41.374235 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374171 2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:41.374235 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374174 2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:41.374235 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374177 2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:41.374235 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374180 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:41.374235 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374183 2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:41.374235 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374186 2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:41.374235 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374188 2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:41.374235 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374191 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:41.374235 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374195 2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:41.374235 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374198 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:41.374235 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374200 2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:41.374235 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374210 2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:41.374235 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374213 2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:41.374235 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374216 2581 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:41.374235 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374219 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:41.374235 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374221 2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:41.374235 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374224 2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:41.374235 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374226 2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:41.374235 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374229 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:41.374704 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374231 2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:41.374704 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374234 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:41.374704 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374239 2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:41.374704 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374243 2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:41.374704 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374246 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:41.374704 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374250 2581 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:41.374704 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374253 2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:41.374704 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374257 2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:41.374704 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374260 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:41.374704 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374262 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:41.374704 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374265 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:41.374704 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374268 2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:41.374704 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374271 2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:41.374704 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374274 2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:41.374704 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374277 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:41.374704 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374279 2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:41.374704 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374282 2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:41.374704 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374284 2581 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:41.374704 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374287 2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:41.375173 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374289 2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:41.375173 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374292 2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:41.375173 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374294 2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:41.375173 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374297 2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:41.375173 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374299 2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:41.375173 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374302 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:41.375173 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374305 2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:41.375173 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374308 2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:41.375173 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374311 2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:41.375173 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374313 2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:41.375173 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374316 2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:41.375173 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374318 2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:41.375173 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374321 2581 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:41.375173 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374323 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:41.375173 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374327 2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:41.375173 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374330 2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:41.375173 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374332 2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:41.375173 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374336 2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:41.375173 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374341 2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:41.375615 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374344 2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:41.375615 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374346 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:41.375615 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374349 2581 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:41.375615 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374352 2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:41.375615 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374354 2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:41.375615 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374357 2581 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:41.375615 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374360 2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:41.375615 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374363 2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:41.375615 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374365 2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:41.375615 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374368 2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:41.375615 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374371 2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:41.375615 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374373 2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:41.375615 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374376 2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:41.375615 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374378 2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:41.375615 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374381 2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:41.375615 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374384 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:41.375615 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374387 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:41.375615 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374390 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:41.375615 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374392 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:41.375615 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374395 2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:41.376164 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374398 2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:41.376164 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374401 2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:41.376164 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374403 2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:41.376164 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374406 2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:41.376164 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374408 2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:41.376164 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374411 2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:41.376164 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374413 2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:41.376164 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374416 2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:41.376164 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374419 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:41.376164 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374421 2581 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:41.376164 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374424 2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:41.376164 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374427 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:41.376164 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374430 2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:41.376164 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374432 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:41.376164 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374435 2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:41.376164 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374438 2581 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:41.376164 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374440 2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:41.376164 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374443 2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:41.376164 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374445 2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:41.376164 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374448 2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:41.376935 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374451 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:41.376935 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374454 2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:41.376935 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374457 2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:41.376935 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374459 2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:41.376935 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374462 2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:41.376935 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.374464 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:41.376935 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375254 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:41.376935 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375260 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:41.376935 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375264 2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:41.376935 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375266 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:41.376935 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375269 2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:41.376935 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375272 2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:41.376935 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375275 2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:41.376935 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375278 2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:41.376935 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375280 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:41.376935 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375283 2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:41.376935 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375286 2581 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:41.376935 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375288 2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:41.376935 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375292 2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:41.376935 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375295 2581 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:41.377574 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375298 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:41.377574 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375301 2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:41.377574 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375303 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:41.377574 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375306 2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:41.377574 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375309 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:41.377574 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375311 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:41.377574 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375316 2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:41.377574 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375321 2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:41.377574 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375324 2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:41.377574 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375326 2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:41.377574 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375329 2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:41.377574 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375331 2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:41.377574 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375334 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:41.377574 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375337 2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:41.377574 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375340 2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:41.377574 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375342 2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:41.377574 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375345 2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:41.377574 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375347 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:41.377574 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375350 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:41.378070 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375353 2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:41.378070 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375356 2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:41.378070 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375359 2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:41.378070 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375363 2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:41.378070 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375366 2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:41.378070 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375369 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:41.378070 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375372 2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:41.378070 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375376 2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:41.378070 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375379 2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:41.378070 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375382 2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:41.378070 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375385 2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:41.378070 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375388 2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:41.378070 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375391 2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:41.378070 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375394 2581 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:41.378070 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375396 2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:41.378070 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375399 2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:41.378070 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375402 2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:41.378070 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375404 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:41.378070 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375407 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:41.378539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375409 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:41.378539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375412 2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:41.378539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375415 2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:41.378539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375418 2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:41.378539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375420 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:41.378539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375423 2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:41.378539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375425 2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:41.378539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375428 2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:41.378539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375431 2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:41.378539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375433 2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:41.378539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375436 2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:41.378539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375438 2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:41.378539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375441 2581 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:41.378539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375443 2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:41.378539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375447 2581 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:41.378539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375450 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:41.378539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375453 2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:41.378539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375455 2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:41.378539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375458 2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:41.378539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375460 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:41.379045 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375463 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:41.379045 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375467 2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:41.379045 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375469 2581 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:41.379045 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375472 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:41.379045 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375475 2581 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:41.379045 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375477 2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:41.379045 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375480 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:41.379045 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375483 2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:41.379045 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375485 2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:41.379045 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375488 2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:41.379045 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375490 2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:41.379045 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375493 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:41.379045 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375495 2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:41.379045 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375498 2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:41.379045 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375501 2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:41.379045 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375503 2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:41.379045 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375506 2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:41.379045 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375508 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:41.379045 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375511 2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:41.379045 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375513 2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:41.379529 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375516 2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:41.379529 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375518 2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:41.379529 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375521 2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:41.379529 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375523 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:41.379529 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375526 2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:41.379529 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375528 2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:41.379529 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375531 2581 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:41.379529 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375534 2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:41.379529 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375537 2581 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:41.379529 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375539 2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:41.379529 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375542 2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:41.379529 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375544 2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:41.379529 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375547 2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:41.379529 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.375549 2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:41.379529 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377403 2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:41.379529 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377420 2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:41.379529 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377425 2581 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:41.379529 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377428 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:41.379529 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377431 2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:41.379529 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377433 2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:41.380033 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377436 2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:41.380033 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377439 2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:41.380033 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377442 2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:41.380033 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377445 2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:41.380033 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377448 2581 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:41.380033 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377450 2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:41.380033 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377453 2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:41.380033 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377456 2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:41.380033 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377458 2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:41.380033 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377461 2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:41.380033 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377463 2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:41.380033 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377466 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:41.380033 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377468 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:41.380033 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377471 2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:41.380033 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377474 2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:41.380033 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377477 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:41.380033 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377479 2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:41.380033 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377482 2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:41.380033 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377484 2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:41.380033 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377487 2581 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:41.380522 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377493 2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:41.380522 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377496 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:41.380522 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377498 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:41.380522 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377501 2581 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:41.380522 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377503 2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:41.380522 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377506 2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:41.380522 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377509 2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:41.380522 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377512 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:41.380522 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377514 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:41.380522 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377517 2581 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:41.380522 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377519 2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:41.380522 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377522 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:41.380522 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377525 2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:41.380522 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377527 2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:41.380522 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377530 2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:41.380522 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377533 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:41.380522 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377536 2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:41.380522 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377538 2581 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:41.380522 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377541 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:41.380522 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377544 2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:41.380996 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377546 2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:41.380996 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377549 2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:41.380996 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377552 2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:41.380996 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377554 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:41.380996 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377557 2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:41.380996 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377559 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:41.380996 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377562 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:41.380996 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377564 2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:41.380996 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377567 2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:41.380996 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377570 2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:41.380996 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377572 2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:41.380996 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377575 2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:41.380996 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377578 2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:41.380996 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377581 2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:41.380996 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377584 2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:41.380996 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377586 2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:41.380996 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377589 2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:41.380996 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377592 2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:41.380996 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377595 2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:41.380996 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377599 2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:41.381501 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377601 2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:41.381501 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377604 2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:41.381501 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377607 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:41.381501 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377609 2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:41.381501 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377612 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:41.381501 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377615 2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:41.381501 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377618 2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:41.381501 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377621 2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:41.381501 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377624 2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:41.381501 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377627 2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:41.381501 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377629 2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:41.381501 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377632 2581 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:41.381501 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377636 2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:41.381501 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377640 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:41.381501 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377643 2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:41.381501 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377646 2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:41.381501 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377649 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:41.381501 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377655 2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:41.381501 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377658 2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:41.381957 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377660 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:41.381957 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377663 2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:41.381957 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377667 2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:41.381957 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377671 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:41.381957 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377674 2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:41.381957 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377677 2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:41.381957 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377679 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:41.381957 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377682 2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:41.381957 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377684 2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:41.381957 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377687 2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:41.381957 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377690 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:41.381957 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377693 2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:41.381957 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377696 2581 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:41.381957 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377698 2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:41.381957 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377703 2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:41.381957 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377706 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:41.381957 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377708 2581 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:41.381957 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377711 2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:41.381957 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377714 2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:41.382420 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377716 2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:41.382420 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.377719 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:41.382420 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377837 2581 flags.go:64] FLAG: --address="0.0.0.0" Oct 29 23:12:41.382420 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377845 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 29 23:12:41.382420 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377856 2581 flags.go:64] FLAG: --anonymous-auth="true" Oct 29 23:12:41.382420 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377860 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 29 23:12:41.382420 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377865 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 29 23:12:41.382420 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377869 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 29 23:12:41.382420 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377874 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 29 23:12:41.382420 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377878 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 29 23:12:41.382420 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377881 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 29 23:12:41.382420 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377884 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 29 23:12:41.382420 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377889 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 29 23:12:41.382420 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377892 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 29 23:12:41.382420 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377895 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 29 23:12:41.382420 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377898 2581 flags.go:64] FLAG: --cgroup-root="" Oct 29 23:12:41.382420 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377902 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 29 23:12:41.382420 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377905 2581 flags.go:64] FLAG: --client-ca-file="" Oct 29 23:12:41.382420 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377908 2581 flags.go:64] FLAG: --cloud-provider="external" Oct 29 23:12:41.382420 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377911 2581 flags.go:64] FLAG: --cluster-dns="[]" Oct 29 23:12:41.382420 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377916 2581 flags.go:64] FLAG: --cluster-domain="" Oct 29 23:12:41.382420 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377919 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 29 23:12:41.382420 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377923 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377926 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377930 2581 flags.go:64] FLAG: --container-log-max-files="5" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377934 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377937 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377941 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377945 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377948 2581 flags.go:64] FLAG: --contention-profiling="false" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377951 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377954 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377957 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377960 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377965 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377969 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377971 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377974 2581 flags.go:64] FLAG: --enable-load-reader="false" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377978 2581 flags.go:64] FLAG: --enable-server="true" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377981 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377986 2581 flags.go:64] FLAG: --event-burst="100" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377990 2581 flags.go:64] FLAG: --event-qps="50" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377993 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377996 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.377999 2581 flags.go:64] FLAG: --eviction-hard="" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378004 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 29 23:12:41.383035 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378010 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 29 23:12:41.383634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378013 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 29 23:12:41.383634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378017 2581 flags.go:64] FLAG: --eviction-soft="" Oct 29 23:12:41.383634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378020 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 29 23:12:41.383634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378023 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 29 23:12:41.383634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378026 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 29 23:12:41.383634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378029 2581 flags.go:64] FLAG: --experimental-mounter-path="" Oct 29 23:12:41.383634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378032 2581 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 29 23:12:41.383634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378035 2581 flags.go:64] FLAG: --fail-swap-on="true" Oct 29 23:12:41.383634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378038 2581 flags.go:64] FLAG: --feature-gates="" Oct 29 23:12:41.383634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378047 2581 flags.go:64] FLAG: --file-check-frequency="20s" Oct 29 23:12:41.383634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378050 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 29 23:12:41.383634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378053 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 29 23:12:41.383634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378056 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 29 23:12:41.383634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378059 2581 flags.go:64] FLAG: --healthz-port="10248" Oct 29 23:12:41.383634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378062 2581 flags.go:64] FLAG: --help="false" Oct 29 23:12:41.383634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378066 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-138-163.ec2.internal" Oct 29 23:12:41.383634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378071 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 29 23:12:41.383634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378081 2581 flags.go:64] FLAG: --http-check-frequency="20s" Oct 29 23:12:41.383634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378085 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 29 23:12:41.383634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378089 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 29 23:12:41.383634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378093 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 29 23:12:41.383634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378096 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 29 23:12:41.383634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378099 2581 flags.go:64] FLAG: --image-service-endpoint="" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378102 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378105 2581 flags.go:64] FLAG: --kube-api-burst="100" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378108 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378111 2581 flags.go:64] FLAG: --kube-api-qps="50" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378114 2581 flags.go:64] FLAG: --kube-reserved="" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378117 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378120 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378124 2581 flags.go:64] FLAG: --kubelet-cgroups="" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378129 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378133 2581 flags.go:64] FLAG: --lock-file="" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378136 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378139 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378142 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378148 2581 flags.go:64] FLAG: --log-json-split-stream="false" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378151 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378154 2581 flags.go:64] FLAG: --log-text-split-stream="false" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378157 2581 flags.go:64] FLAG: --logging-format="text" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378160 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378163 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378166 2581 flags.go:64] FLAG: --manifest-url="" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378169 2581 flags.go:64] FLAG: --manifest-url-header="" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378174 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378178 2581 flags.go:64] FLAG: --max-open-files="1000000" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378181 2581 flags.go:64] FLAG: --max-pods="110" Oct 29 23:12:41.384199 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378202 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378207 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378212 2581 flags.go:64] FLAG: --memory-manager-policy="None" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378215 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378218 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378221 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378224 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378232 2581 flags.go:64] FLAG: --node-status-max-images="50" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378236 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378239 2581 flags.go:64] FLAG: --oom-score-adj="-999" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378242 2581 flags.go:64] FLAG: --pod-cidr="" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378245 2581 flags.go:64] FLAG: --pod-manifest-path="" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378248 2581 flags.go:64] FLAG: --pod-max-pids="-1" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378251 2581 flags.go:64] FLAG: --pods-per-core="0" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378254 2581 flags.go:64] FLAG: --port="10250" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378257 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378260 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0030698b1e5e5f4e2" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378264 2581 flags.go:64] FLAG: --qos-reserved="" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378267 2581 flags.go:64] FLAG: --read-only-port="10255" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378270 2581 flags.go:64] FLAG: --register-node="true" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378273 2581 flags.go:64] FLAG: --register-with-taints="" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378277 2581 flags.go:64] FLAG: --registry-burst="10" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378280 2581 flags.go:64] FLAG: --registry-qps="5" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378283 2581 flags.go:64] FLAG: --reserved-cpus="" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378286 2581 flags.go:64] FLAG: --reserved-memory="" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378290 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 29 23:12:41.385808 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378293 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378296 2581 flags.go:64] FLAG: --rotate-certificates="false" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378299 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378302 2581 flags.go:64] FLAG: --runonce="false" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378306 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378309 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378312 2581 flags.go:64] FLAG: --seccomp-default="false" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378316 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378319 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378322 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378325 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378329 2581 flags.go:64] FLAG: --storage-driver-password="root" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378332 2581 flags.go:64] FLAG: --storage-driver-secure="false" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378335 2581 flags.go:64] FLAG: --storage-driver-table="stats" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378338 2581 flags.go:64] FLAG: --storage-driver-user="root" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378341 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378344 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378347 2581 flags.go:64] FLAG: --system-cgroups="" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378350 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378356 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378359 2581 flags.go:64] FLAG: --tls-cert-file="" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378362 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378367 2581 flags.go:64] FLAG: --tls-min-version="" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378370 2581 flags.go:64] FLAG: --tls-private-key-file="" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378374 2581 flags.go:64] FLAG: --topology-manager-policy="none" Oct 29 23:12:41.386457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378377 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 29 23:12:41.387078 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378380 2581 flags.go:64] FLAG: --topology-manager-scope="container" Oct 29 23:12:41.387078 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378383 2581 flags.go:64] FLAG: --v="2" Oct 29 23:12:41.387078 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378387 2581 flags.go:64] FLAG: --version="false" Oct 29 23:12:41.387078 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378392 2581 flags.go:64] FLAG: --vmodule="" Oct 29 23:12:41.387078 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378396 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 29 23:12:41.387078 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378399 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 29 23:12:41.387078 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378565 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:41.387078 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378570 2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:41.387078 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378574 2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:41.387078 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378577 2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:41.387078 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378580 2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:41.387078 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378583 2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:41.387078 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378585 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:41.387078 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378589 2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:41.387078 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378592 2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:41.387078 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378595 2581 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:41.387078 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378598 2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:41.387078 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378600 2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:41.387078 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378603 2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:41.387078 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378605 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:41.387078 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378608 2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:41.387682 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378611 2581 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:41.387682 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378613 2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:41.387682 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378616 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:41.387682 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378619 2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:41.387682 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378622 2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:41.387682 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378624 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:41.387682 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378627 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:41.387682 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378630 2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:41.387682 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378632 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:41.387682 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378635 2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:41.387682 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378639 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:41.387682 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378642 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:41.387682 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378645 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:41.387682 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378647 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:41.387682 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378650 2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:41.387682 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378653 2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:41.387682 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378655 2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:41.387682 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378658 2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:41.387682 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378661 2581 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:41.388198 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378663 2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:41.388198 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378666 2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:41.388198 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378669 2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:41.388198 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378671 2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:41.388198 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378674 2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:41.388198 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378678 2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:41.388198 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378681 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:41.388198 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378683 2581 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:41.388198 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378686 2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:41.388198 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378690 2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:41.388198 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378693 2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:41.388198 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378695 2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:41.388198 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378698 2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:41.388198 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378701 2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:41.388198 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378705 2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:41.388198 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378708 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:41.388198 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378711 2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:41.388198 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378714 2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:41.388198 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378716 2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:41.388657 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378719 2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:41.388657 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378722 2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:41.388657 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378724 2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:41.388657 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378727 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:41.388657 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378729 2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:41.388657 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378749 2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:41.388657 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378752 2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:41.388657 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378755 2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:41.388657 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378757 2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:41.388657 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378760 2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:41.388657 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378763 2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:41.388657 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378765 2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:41.388657 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378768 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:41.388657 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378770 2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:41.388657 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378773 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:41.388657 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378776 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:41.388657 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378779 2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:41.388657 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378781 2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:41.388657 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378785 2581 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:41.388657 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378788 2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:41.389148 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378790 2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:41.389148 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378793 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:41.389148 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378798 2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:41.389148 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378800 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:41.389148 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378803 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:41.389148 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378806 2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:41.389148 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378808 2581 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:41.389148 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378823 2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:41.389148 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378826 2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:41.389148 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378829 2581 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:41.389148 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378832 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:41.389148 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378835 2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:41.389148 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378837 2581 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:41.389148 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378840 2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:41.389148 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378843 2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:41.389148 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378845 2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:41.389148 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378848 2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:41.389148 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378850 2581 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:41.389148 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378854 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:41.389148 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378856 2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:41.389626 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378859 2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:41.389626 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378861 2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:41.389626 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378864 2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:41.389626 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378866 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:41.389626 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378869 2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:41.389626 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378871 2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:41.389626 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378874 2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:41.389626 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378877 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:41.389626 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378879 2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:41.389626 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378883 2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:41.389626 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378889 2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:41.389626 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378893 2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:41.389626 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378896 2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:41.389626 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.378924 2581 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 29 23:12:41.389626 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378978 2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:41.389626 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378983 2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:41.390027 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378987 2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:41.390027 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378990 2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:41.390027 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378993 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:41.390027 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378996 2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:41.390027 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.378998 2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:41.390027 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379001 2581 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:41.390027 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379004 2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:41.390027 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379006 2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:41.390027 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379009 2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:41.390027 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379011 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:41.390027 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379014 2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:41.390027 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379017 2581 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:41.390027 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379020 2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:41.390027 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379022 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:41.390027 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379025 2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:41.390027 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379030 2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:41.390027 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379033 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:41.390027 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379036 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:41.390027 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379038 2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:41.390495 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379040 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:41.390495 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379044 2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:41.390495 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379046 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:41.390495 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379049 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:41.390495 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379052 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:41.390495 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379054 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:41.390495 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379057 2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:41.390495 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379060 2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:41.390495 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379064 2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:41.390495 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379067 2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:41.390495 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379069 2581 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:41.390495 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379073 2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:41.390495 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379076 2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:41.390495 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379078 2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:41.390495 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379081 2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:41.390495 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379084 2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:41.390495 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379087 2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:41.390495 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379089 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:41.390495 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379092 2581 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:41.390999 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379095 2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:41.390999 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379097 2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:41.390999 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379100 2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:41.390999 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379102 2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:41.390999 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379105 2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:41.390999 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379107 2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:41.390999 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379111 2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:41.390999 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379115 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:41.390999 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379118 2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:41.390999 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379120 2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:41.390999 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379124 2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:41.390999 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379126 2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:41.390999 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379129 2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:41.390999 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379131 2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:41.390999 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379134 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:41.390999 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379136 2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:41.390999 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379139 2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:41.390999 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379141 2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:41.390999 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379144 2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:41.390999 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379146 2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:41.391487 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379149 2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:41.391487 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379152 2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:41.391487 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379155 2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:41.391487 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379158 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:41.391487 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379161 2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:41.391487 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379164 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:41.391487 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379168 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:41.391487 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379170 2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:41.391487 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379173 2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:41.391487 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379176 2581 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:41.391487 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379179 2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:41.391487 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379181 2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:41.391487 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379184 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:41.391487 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379187 2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:41.391487 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379189 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:41.391487 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379192 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:41.391487 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379195 2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:41.391487 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379198 2581 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:41.391487 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379200 2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:41.391487 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379203 2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:41.392098 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379206 2581 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:41.392098 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379208 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:41.392098 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379211 2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:41.392098 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379214 2581 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:41.392098 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379216 2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:41.392098 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379219 2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:41.392098 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379221 2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:41.392098 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379224 2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:41.392098 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379226 2581 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:41.392098 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379229 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:41.392098 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379231 2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:41.392098 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379234 2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:41.392098 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379237 2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:41.392098 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379242 2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:41.392098 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379245 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:41.392098 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379247 2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:41.392098 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379251 2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:41.392098 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379254 2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:41.392098 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379256 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:41.392098 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379259 2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:41.392621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379264 2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:41.392621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379268 2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:41.392621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379271 2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:41.392621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379274 2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:41.392621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379277 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:41.392621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.379280 2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:41.392621 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.386899 2581 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 29 23:12:41.392621 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.386917 2581 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 29 23:12:41.392621 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.386934 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 29 23:12:41.392621 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.386939 2581 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 29 23:12:41.392621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387004 2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:41.392621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387009 2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:41.392621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387013 2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:41.392621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387016 2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:41.392621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387019 2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:41.392621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387023 2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:41.392621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387026 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:41.392621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387028 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:41.393229 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387031 2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:41.393229 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387034 2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:41.393229 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387037 2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:41.393229 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387039 2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:41.393229 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387043 2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:41.393229 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387046 2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:41.393229 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387048 2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:41.393229 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387051 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:41.393229 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387053 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:41.393229 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387056 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:41.393229 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387059 2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:41.393229 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387061 2581 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:41.393229 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387064 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:41.393229 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387067 2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:41.393229 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387069 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:41.393229 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387072 2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:41.393229 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387076 2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:41.393229 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387081 2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:41.393229 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387085 2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:41.394020 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387088 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:41.394020 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387090 2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:41.394020 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387095 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:41.394020 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387098 2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:41.394020 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387101 2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:41.394020 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387103 2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:41.394020 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387106 2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:41.394020 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387109 2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:41.394020 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387112 2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:41.394020 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387114 2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:41.394020 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387117 2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:41.394020 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387119 2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:41.394020 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387122 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:41.394020 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387125 2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:41.394020 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387128 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:41.394020 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387130 2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:41.394020 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387133 2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:41.394020 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387135 2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:41.394020 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387138 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:41.394020 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387141 2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:41.394649 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387144 2581 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:41.394649 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387146 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:41.394649 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387149 2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:41.394649 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387152 2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:41.394649 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387154 2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:41.394649 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387157 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:41.394649 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387160 2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:41.394649 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387162 2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:41.394649 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387165 2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:41.394649 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387168 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:41.394649 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387170 2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:41.394649 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387173 2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:41.394649 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387175 2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:41.394649 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387178 2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:41.394649 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387181 2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:41.394649 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387185 2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:41.394649 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387188 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:41.394649 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387190 2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:41.394649 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387193 2581 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:41.394649 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387195 2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:41.395175 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387198 2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:41.395175 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387201 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:41.395175 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387203 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:41.395175 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387206 2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:41.395175 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387208 2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:41.395175 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387211 2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:41.395175 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387213 2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:41.395175 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387216 2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:41.395175 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387219 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:41.395175 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387221 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:41.395175 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387224 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:41.395175 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387226 2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:41.395175 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387229 2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:41.395175 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387231 2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:41.395175 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387234 2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:41.395175 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387237 2581 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:41.395175 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387239 2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:41.395175 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387243 2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:41.395175 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387247 2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:41.396052 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387251 2581 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:41.396052 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387254 2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:41.396052 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387257 2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:41.396052 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387260 2581 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:41.396052 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387263 2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:41.396052 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387265 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:41.396052 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387268 2581 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:41.396052 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387271 2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:41.396052 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387274 2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:41.396052 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387278 2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:41.396052 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387280 2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:41.396052 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387283 2581 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:41.396052 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387285 2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:41.396052 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387288 2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:41.396052 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387290 2581 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:41.396052 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387293 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:41.396052 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387295 2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:41.396052 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387298 2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:41.396052 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387300 2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:41.396052 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387303 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:41.396621 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.387331 2581 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 29 23:12:41.396621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387477 2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:41.396621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387482 2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:41.396621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387486 2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:41.396621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387489 2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:41.396621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387493 2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:41.396621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387496 2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:41.396621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387498 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:41.396621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387501 2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:41.396621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387503 2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:41.396621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387506 2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:41.396621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387508 2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:41.396621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387512 2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:41.396621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387514 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:41.396621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387517 2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:41.396621 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387520 2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:41.397025 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387522 2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:41.397025 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387525 2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:41.397025 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387528 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:41.397025 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387530 2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:41.397025 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387533 2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:41.397025 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387536 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:41.397025 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387539 2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:41.397025 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387542 2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:41.397025 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387544 2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:41.397025 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387547 2581 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:41.397025 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387550 2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:41.397025 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387552 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:41.397025 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387555 2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:41.397025 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387557 2581 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:41.397025 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387560 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:41.397025 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387563 2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:41.397025 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387565 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:41.397025 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387568 2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:41.397025 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387571 2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:41.397025 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387573 2581 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:41.397547 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387576 2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:41.397547 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387578 2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:41.397547 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387581 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:41.397547 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387584 2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:41.397547 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387586 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:41.397547 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387589 2581 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:41.397547 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387591 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:41.397547 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387594 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:41.397547 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387597 2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:41.397547 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387599 2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:41.397547 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387602 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:41.397547 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387605 2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:41.397547 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387608 2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:41.397547 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387610 2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:41.397547 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387613 2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:41.397547 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387615 2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:41.397547 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387619 2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:41.397547 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387622 2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:41.397547 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387624 2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:41.397547 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387628 2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:41.398063 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387631 2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:41.398063 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387633 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:41.398063 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387636 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:41.398063 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387638 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:41.398063 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387641 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:41.398063 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387643 2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:41.398063 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387646 2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:41.398063 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387648 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:41.398063 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387651 2581 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:41.398063 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387654 2581 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:41.398063 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387656 2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:41.398063 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387659 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:41.398063 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387661 2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:41.398063 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387664 2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:41.398063 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387666 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:41.398063 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387669 2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:41.398063 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387671 2581 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:41.398063 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387674 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:41.398063 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387678 2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:41.398539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387682 2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:41.398539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387685 2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:41.398539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387688 2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:41.398539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387691 2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:41.398539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387694 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:41.398539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387697 2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:41.398539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387700 2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:41.398539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387702 2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:41.398539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387705 2581 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:41.398539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387708 2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:41.398539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387710 2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:41.398539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387713 2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:41.398539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387715 2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:41.398539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387718 2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:41.398539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387721 2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:41.398539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387723 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:41.398539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387726 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:41.398539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387728 2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:41.398539 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387731 2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:41.399011 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387734 2581 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:41.399011 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387736 2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:41.399011 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387739 2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:41.399011 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387741 2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:41.399011 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387744 2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:41.399011 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387746 2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:41.399011 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387749 2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:41.399011 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387751 2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:41.399011 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387755 2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:41.399011 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387759 2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:41.399011 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387762 2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:41.399011 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387765 2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:41.399011 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387768 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:41.399011 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.387790 2581 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 29 23:12:41.399011 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387842 2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:41.399373 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387847 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:41.399373 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387850 2581 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:41.399373 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387853 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:41.399373 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387855 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:41.399373 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387858 2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:41.399373 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387861 2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:41.399373 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387863 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:41.399373 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387866 2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:41.399373 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387869 2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:41.399373 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387872 2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:41.399373 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387874 2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:41.399373 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387877 2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:41.399373 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387881 2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:41.399373 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387883 2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:41.399373 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387886 2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:41.399373 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387888 2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:41.399373 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387891 2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:41.399373 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387894 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:41.399373 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387896 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:41.399373 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387898 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:41.399849 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387901 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:41.399849 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387904 2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:41.399849 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387906 2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:41.399849 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387909 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:41.399849 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387912 2581 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:41.399849 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387915 2581 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:41.399849 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387917 2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:41.399849 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387920 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:41.399849 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387922 2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:41.399849 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387925 2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:41.399849 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387928 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:41.399849 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387930 2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:41.399849 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387933 2581 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:41.399849 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387936 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:41.399849 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387939 2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:41.399849 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387943 2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:41.399849 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387946 2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:41.399849 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387949 2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:41.399849 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387951 2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:41.400306 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387954 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:41.400306 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387956 2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:41.400306 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387959 2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:41.400306 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387962 2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:41.400306 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387965 2581 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:41.400306 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387967 2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:41.400306 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387970 2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:41.400306 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387973 2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:41.400306 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387976 2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:41.400306 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387978 2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:41.400306 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387981 2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:41.400306 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387983 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:41.400306 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387986 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:41.400306 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387988 2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:41.400306 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387991 2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:41.400306 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387993 2581 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:41.400306 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387996 2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:41.400306 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.387998 2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:41.400306 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388001 2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:41.400756 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388004 2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:41.400756 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388007 2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:41.400756 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388009 2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:41.400756 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388011 2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:41.400756 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388016 2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:41.400756 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388020 2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:41.400756 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388023 2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:41.400756 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388026 2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:41.400756 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388028 2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:41.400756 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388031 2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:41.400756 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388034 2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:41.400756 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388037 2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:41.400756 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388039 2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:41.400756 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388042 2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:41.400756 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388045 2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:41.400756 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388047 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:41.400756 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388050 2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:41.400756 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388052 2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:41.400756 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388055 2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:41.401370 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388058 2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:41.401370 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388061 2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:41.401370 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388063 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:41.401370 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388066 2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:41.401370 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388068 2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:41.401370 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388071 2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:41.401370 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388073 2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:41.401370 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388076 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:41.401370 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388078 2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:41.401370 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388081 2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:41.401370 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388083 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:41.401370 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388086 2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:41.401370 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388089 2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:41.401370 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388091 2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:41.401370 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388094 2581 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:41.401370 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388096 2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:41.401370 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388099 2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:41.401370 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388102 2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:41.401370 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388104 2581 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:41.401370 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388107 2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:41.401871 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388111 2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:41.401871 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388114 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:41.401871 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388116 2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:41.401871 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388119 2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:41.401871 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388122 2581 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:41.401871 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388124 2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:41.401871 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388127 2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:41.401871 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:41.388129 2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:41.401871 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.388192 2581 server.go:957] "Client rotation is on, will bootstrap in background" Oct 29 23:12:41.401871 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.390661 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Oct 29 23:12:41.401871 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.391781 2581 server.go:1014] "Starting client certificate rotation" Oct 29 23:12:41.401871 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.391913 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 29 23:12:41.401871 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.391985 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 29 23:12:41.401871 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.394234 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 29 23:12:41.401871 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.395584 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 29 23:12:41.410285 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.410261 2581 log.go:25] "Validated CRI v1 runtime API" Oct 29 23:12:41.414457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.414435 2581 log.go:25] "Validated CRI v1 image API" Oct 29 23:12:41.415529 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.415499 2581 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 29 23:12:41.421587 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.421564 2581 fs.go:135] Filesystem UUIDs: map[1c8c7f94-9768-4c37-a75e-2a2a439e7c86:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c4e30fbe-77ba-45f8-9e80-288301d614da:/dev/nvme0n1p3] Oct 29 23:12:41.421685 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.421585 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Oct 29 23:12:41.428040 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.427912 2581 manager.go:217] Machine: {Timestamp:2026-10-29 23:12:41.425360125 +0000 UTC m=+0.349580427 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097549 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a607c6eb2af6750524a5fa4c1b966 SystemUUID:ec2a607c-6eb2-af67-5052-4a5fa4c1b966 BootID:ff0c9569-20a2-45db-b52a-e32d18d4dba3 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f9:c8:8c:c7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f9:c8:8c:c7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:d0:90:35:40:ae Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 29 23:12:41.428040 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.428035 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 29 23:12:41.428177 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.428128 2581 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 29 23:12:41.430265 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.430235 2581 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 29 23:12:41.430416 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.430268 2581 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-163.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 29 23:12:41.430457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.430419 2581 topology_manager.go:143] "Creating topology manager with none policy" Oct 29 23:12:41.430457 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.430427 2581 container_manager_linux.go:311] "Creating device plugin manager" Oct 29 23:12:41.430513 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.430476 2581 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 29 23:12:41.430513 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.430491 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 29 23:12:41.431795 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.431783 2581 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 29 23:12:41.436523 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.436507 2581 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 29 23:12:41.436659 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.436650 2581 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 29 23:12:41.437531 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.437521 2581 kubelet.go:493] "Attempting to sync node with API server" Oct 29 23:12:41.437568 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.437537 2581 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 29 23:12:41.437568 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.437548 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 29 23:12:41.437568 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.437558 2581 kubelet.go:405] "Adding apiserver pod source" Oct 29 23:12:41.437568 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.437567 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 29 23:12:41.437993 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.437971 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 29 23:12:41.440636 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.440620 2581 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 29 23:12:41.447210 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.447194 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 29 23:12:41.448203 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.448191 2581 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 29 23:12:41.448249 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.448221 2581 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 29 23:12:41.448384 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.448375 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 29 23:12:41.448413 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.448391 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 29 23:12:41.448413 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.448397 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 29 23:12:41.448413 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.448403 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 29 23:12:41.448413 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.448409 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 29 23:12:41.448516 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.448415 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 29 23:12:41.449093 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.449083 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 29 23:12:41.449124 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.449093 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 29 23:12:41.449124 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.449101 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 29 23:12:41.449124 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.449109 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 29 23:12:41.449124 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.449123 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 29 23:12:41.449249 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.449132 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 29 23:12:41.450622 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.450612 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 29 23:12:41.450622 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.450623 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 29 23:12:41.455440 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.455419 2581 server.go:1263] "Started kubelet" Oct 29 23:12:41.455550 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.455500 2581 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 29 23:12:41.455632 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.455585 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 29 23:12:41.455695 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.455655 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 29 23:12:41.456257 ip-10-0-138-163 systemd[1]: Started Kubernetes Kubelet. Oct 29 23:12:41.457518 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.457494 2581 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 29 23:12:41.457906 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.457831 2581 server.go:317] "Adding debug handlers to kubelet server" Oct 29 23:12:41.461532 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:41.461513 2581 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Oct 29 23:12:41.465961 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.465937 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 29 23:12:41.466611 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.466592 2581 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 29 23:12:41.466794 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:41.466763 2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-163.ec2.internal\" not found" Oct 29 23:12:41.467475 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.467459 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 29 23:12:41.467475 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.467461 2581 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 29 23:12:41.467593 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.467483 2581 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 29 23:12:41.467642 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.467607 2581 reconstruct.go:97] "Volume reconstruction finished" Oct 29 23:12:41.467642 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.467616 2581 reconciler.go:29] "Reconciler: start to sync state" Oct 29 23:12:41.467727 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.467714 2581 factory.go:153] Registering CRI-O factory Oct 29 23:12:41.467760 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.467730 2581 factory.go:223] Registration of the crio container factory successfully Oct 29 23:12:41.467794 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.467789 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 29 23:12:41.467840 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.467797 2581 factory.go:55] Registering systemd factory Oct 29 23:12:41.467840 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.467802 2581 factory.go:223] Registration of the systemd container factory successfully Oct 29 23:12:41.467840 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.467828 2581 factory.go:103] Registering Raw factory Oct 29 23:12:41.467929 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.467841 2581 manager.go:1199] Started watching for new ooms in manager Oct 29 23:12:41.468893 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.468871 2581 manager.go:319] Starting recovery of all containers Oct 29 23:12:41.479409 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.479375 2581 manager.go:324] Recovery completed Oct 29 23:12:41.480921 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:41.480894 2581 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-163.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Oct 29 23:12:41.481484 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:41.481437 2581 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Oct 29 23:12:41.481593 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.481570 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-163.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 29 23:12:41.483755 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:41.479205 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-163.ec2.internal.18e3230072ba8165 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-163.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-163.ec2.internal,},FirstTimestamp:2026-10-29 23:12:41.455386981 +0000 UTC m=+0.379607284,LastTimestamp:2026-10-29 23:12:41.455386981 +0000 UTC m=+0.379607284,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-163.ec2.internal,}" Oct 29 23:12:41.485950 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.485933 2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:12:41.488343 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.488324 2581 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 29 23:12:41.488449 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.488422 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fkst6" Oct 29 23:12:41.488486 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.488453 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fkst6" Oct 29 23:12:41.489446 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.489430 2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:12:41.489526 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.489457 2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:12:41.489526 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.489467 2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:12:41.490067 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.490049 2581 cpu_manager.go:226] "Starting" policy="none" Oct 29 23:12:41.490067 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.490063 2581 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 29 23:12:41.490187 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.490086 2581 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 29 23:12:41.490187 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.490100 2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:12:41.491355 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.491339 2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:12:41.491419 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.491365 2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:12:41.491419 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.491375 2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:12:41.492309 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.492298 2581 policy_none.go:50] "Start" Oct 29 23:12:41.492341 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.492313 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 29 23:12:41.492341 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.492330 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 29 23:12:41.494521 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.494511 2581 policy_none.go:44] "Start" Oct 29 23:12:41.496512 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:41.496487 2581 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Oct 29 23:12:41.496639 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:41.496492 2581 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-163.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Oct 29 23:12:41.496639 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:41.496535 2581 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Oct 29 23:12:41.528181 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.528133 2581 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 29 23:12:41.541042 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.540474 2581 manager.go:341] "Starting Device Plugin manager" Oct 29 23:12:41.541042 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:41.540577 2581 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 29 23:12:41.541042 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.540589 2581 server.go:87] "Starting device plugin registration server" Oct 29 23:12:41.541042 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.540884 2581 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 29 23:12:41.541042 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.540896 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 29 23:12:41.541384 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.541122 2581 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 29 23:12:41.541384 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.541215 2581 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 29 23:12:41.541384 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.541223 2581 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 29 23:12:41.542137 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:41.542114 2581 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 29 23:12:41.542281 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:41.542160 2581 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-163.ec2.internal\" not found" Oct 29 23:12:41.597789 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.597757 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 29 23:12:41.600061 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.598951 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 29 23:12:41.600061 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.598975 2581 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 29 23:12:41.600061 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.599000 2581 kubelet.go:2521] "Starting kubelet main sync loop" Oct 29 23:12:41.600061 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:41.599042 2581 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Oct 29 23:12:41.612786 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.612766 2581 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:12:41.642137 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.641910 2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:12:41.643140 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.643114 2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:12:41.643294 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.643158 2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:12:41.643294 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.643194 2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:12:41.643294 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.643226 2581 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-138-163.ec2.internal" Oct 29 23:12:41.661913 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.661886 2581 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-138-163.ec2.internal" Oct 29 23:12:41.661913 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:41.661915 2581 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-163.ec2.internal\": node \"ip-10-0-138-163.ec2.internal\" not found" Oct 29 23:12:41.699493 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.699463 2581 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal"] Oct 29 23:12:41.699627 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.699525 2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:12:41.700446 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.700429 2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:12:41.700520 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.700457 2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:12:41.700520 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.700467 2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:12:41.702767 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.702753 2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:12:41.702938 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.702920 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Oct 29 23:12:41.702977 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.702955 2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:12:41.703472 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.703458 2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:12:41.703472 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.703466 2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:12:41.703569 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.703484 2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:12:41.703569 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.703497 2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:12:41.703569 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.703487 2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:12:41.703569 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.703567 2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:12:41.705665 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.705650 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" Oct 29 23:12:41.705755 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.705673 2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:12:41.706353 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.706337 2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:12:41.706426 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.706364 2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:12:41.706426 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.706374 2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:12:41.722905 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:41.722884 2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-163.ec2.internal\" not found" Oct 29 23:12:41.749722 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:41.749702 2581 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-163.ec2.internal\" not found" node="ip-10-0-138-163.ec2.internal" Oct 29 23:12:41.751832 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:41.751804 2581 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-163.ec2.internal\" not found" node="ip-10-0-138-163.ec2.internal" Oct 29 23:12:41.769658 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.769634 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b0bfae2a96103ad8818ab15e83f094e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal\" (UID: \"b0bfae2a96103ad8818ab15e83f094e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Oct 29 23:12:41.769733 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.769661 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0bfae2a96103ad8818ab15e83f094e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal\" (UID: \"b0bfae2a96103ad8818ab15e83f094e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Oct 29 23:12:41.769733 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.769677 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d854221abd6c4396f6ea6f6c004dea85-config\") pod \"kube-apiserver-proxy-ip-10-0-138-163.ec2.internal\" (UID: \"d854221abd6c4396f6ea6f6c004dea85\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" Oct 29 23:12:41.823114 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:41.823081 2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-163.ec2.internal\" not found" Oct 29 23:12:41.870423 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.870389 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b0bfae2a96103ad8818ab15e83f094e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal\" (UID: \"b0bfae2a96103ad8818ab15e83f094e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Oct 29 23:12:41.870567 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.870386 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b0bfae2a96103ad8818ab15e83f094e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal\" (UID: \"b0bfae2a96103ad8818ab15e83f094e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Oct 29 23:12:41.870567 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.870455 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0bfae2a96103ad8818ab15e83f094e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal\" (UID: \"b0bfae2a96103ad8818ab15e83f094e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Oct 29 23:12:41.870567 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.870471 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d854221abd6c4396f6ea6f6c004dea85-config\") pod \"kube-apiserver-proxy-ip-10-0-138-163.ec2.internal\" (UID: \"d854221abd6c4396f6ea6f6c004dea85\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" Oct 29 23:12:41.870567 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.870490 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d854221abd6c4396f6ea6f6c004dea85-config\") pod \"kube-apiserver-proxy-ip-10-0-138-163.ec2.internal\" (UID: \"d854221abd6c4396f6ea6f6c004dea85\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" Oct 29 23:12:41.870567 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:41.870518 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0bfae2a96103ad8818ab15e83f094e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal\" (UID: \"b0bfae2a96103ad8818ab15e83f094e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Oct 29 23:12:41.923552 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:41.923473 2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-163.ec2.internal\" not found" Oct 29 23:12:42.024085 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:42.024043 2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-163.ec2.internal\" not found" Oct 29 23:12:42.052260 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:42.052235 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Oct 29 23:12:42.054394 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:42.054375 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" Oct 29 23:12:42.126549 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:42.126512 2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-163.ec2.internal\" not found" Oct 29 23:12:42.230893 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:42.230798 2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-163.ec2.internal\" not found" Oct 29 23:12:42.333872 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:42.333831 2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-163.ec2.internal\" not found" Oct 29 23:12:42.391286 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:42.391251 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Oct 29 23:12:42.391791 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:42.391405 2581 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 29 23:12:42.435037 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:42.435000 2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-163.ec2.internal\" not found" Oct 29 23:12:42.495023 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:42.494932 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-28 23:07:42 +0000 UTC" deadline="2028-05-31 10:55:59.303433122 +0000 UTC" Oct 29 23:12:42.495023 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:42.494979 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13907h43m16.808457625s" Oct 29 23:12:42.536048 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:42.536015 2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-163.ec2.internal\" not found" Oct 29 23:12:42.636969 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:42.636939 2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-163.ec2.internal\" not found" Oct 29 23:12:42.661924 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:42.661894 2581 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:12:42.682511 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:42.682461 2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0bfae2a96103ad8818ab15e83f094e2.slice/crio-db6b3223a1a717d9d45a67097fc11687afecdebae32a30f500efb4c08123b93c WatchSource:0}: Error finding container db6b3223a1a717d9d45a67097fc11687afecdebae32a30f500efb4c08123b93c: Status 404 returned error can't find the container with id db6b3223a1a717d9d45a67097fc11687afecdebae32a30f500efb4c08123b93c Oct 29 23:12:42.682723 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:42.682707 2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd854221abd6c4396f6ea6f6c004dea85.slice/crio-0f81a6e97ab7690b909a0f19219b64f62d9f7004b1c1218bbea4f09e584442dd WatchSource:0}: Error finding container 0f81a6e97ab7690b909a0f19219b64f62d9f7004b1c1218bbea4f09e584442dd: Status 404 returned error can't find the container with id 0f81a6e97ab7690b909a0f19219b64f62d9f7004b1c1218bbea4f09e584442dd Oct 29 23:12:42.689098 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:42.689068 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 29 23:12:42.737545 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:42.737515 2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-163.ec2.internal\" not found" Oct 29 23:12:42.750172 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:42.750142 2581 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:12:42.807965 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:42.807935 2581 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:12:42.867888 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:42.867854 2581 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" Oct 29 23:12:42.893758 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:42.893729 2581 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 29 23:12:42.894642 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:42.894627 2581 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Oct 29 23:12:42.920538 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:42.920514 2581 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 29 23:12:43.355405 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.355366 2581 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:12:43.438621 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.438324 2581 apiserver.go:52] "Watching apiserver" Oct 29 23:12:43.466613 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.466578 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Oct 29 23:12:43.473634 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.473608 2581 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 29 23:12:43.473956 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.473927 2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-psb28","openshift-network-operator/iptables-alerter-pdsvg","openshift-ovn-kubernetes/ovnkube-node-zbltb","kube-system/global-pull-secret-syncer-4ctmg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal","openshift-multus/multus-sk9hv","kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal","openshift-multus/network-metrics-daemon-l78hj","openshift-network-diagnostics/network-check-target-xnlbj","kube-system/konnectivity-agent-vnmw9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp","openshift-image-registry/node-ca-l59n4","openshift-cluster-node-tuning-operator/tuned-btfzv","openshift-dns/node-resolver-k9bgk"] Oct 29 23:12:43.476666 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.476643 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vnmw9" Oct 29 23:12:43.479343 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.479319 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:12:43.481969 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.481946 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.484306 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.484284 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:12:43.484413 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:43.484367 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ctmg" podUID="f7add189-cde4-470f-a543-4dc4a91be859" Oct 29 23:12:43.487002 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.486705 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k9bgk" Oct 29 23:12:43.489242 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.489222 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.491733 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.491714 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:12:43.491806 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:43.491782 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnlbj" podUID="f1cc6108-50e3-4a4d-855e-c4884e581e2e" Oct 29 23:12:43.494423 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.494401 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.496396 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.496289 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 29 23:12:43.496500 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.496340 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-t8tv9\"" Oct 29 23:12:43.496602 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.496572 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 29 23:12:43.496867 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.496749 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qbkzf\"" Oct 29 23:12:43.496944 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.496925 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 29 23:12:43.497016 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.497002 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 29 23:12:43.497452 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.497432 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pdsvg" Oct 29 23:12:43.499726 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.499700 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:12:43.500420 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.500387 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 29 23:12:43.501367 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.501348 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 29 23:12:43.502170 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.502134 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 29 23:12:43.502249 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.502183 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 29 23:12:43.502327 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.502309 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 29 23:12:43.502680 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.502661 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 29 23:12:43.503231 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.503210 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:12:43.503333 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:43.503284 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hj" podUID="480d690f-601d-4d63-aaf7-3717d5758230" Oct 29 23:12:43.505784 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.505725 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l59n4" Oct 29 23:12:43.533560 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.533529 2581 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 29 23:12:43.533694 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.533587 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nxw49" Oct 29 23:12:43.540579 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.540554 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nxw49" Oct 29 23:12:43.568881 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.568787 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 29 23:12:43.580745 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.580712 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/286e0f07-4271-46b1-bca0-18ed0b12754e-system-cni-dir\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:12:43.580899 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.580755 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-device-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:12:43.580899 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.580783 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-var-lib-openvswitch\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.580899 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.580866 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e2317d5c-4fcc-4027-82a7-911a28143f1a-env-overrides\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.581082 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.580912 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7add189-cde4-470f-a543-4dc4a91be859-dbus\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:12:43.581082 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.580949 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-sysconfig\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.581082 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.580987 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-kubernetes\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.581082 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581013 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7491f84-75c3-4286-90f9-ec4314ac5bf9-tmp-dir\") pod \"node-resolver-k9bgk\" (UID: \"c7491f84-75c3-4286-90f9-ec4314ac5bf9\") " pod="openshift-dns/node-resolver-k9bgk" Oct 29 23:12:43.581082 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581055 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-systemd-units\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.581329 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581094 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbdwc\" (UniqueName: \"kubernetes.io/projected/7b4b45cd-366a-4e03-8b83-0ad02541bfd6-kube-api-access-qbdwc\") pod \"iptables-alerter-pdsvg\" (UID: \"7b4b45cd-366a-4e03-8b83-0ad02541bfd6\") " pod="openshift-network-operator/iptables-alerter-pdsvg" Oct 29 23:12:43.581329 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581143 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/286e0f07-4271-46b1-bca0-18ed0b12754e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:12:43.581329 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581171 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-socket-dir-parent\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.581329 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581187 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7138ba89-e1c9-4c07-a833-3ba8f9a54445-konnectivity-ca\") pod \"konnectivity-agent-vnmw9\" (UID: \"7138ba89-e1c9-4c07-a833-3ba8f9a54445\") " pod="kube-system/konnectivity-agent-vnmw9" Oct 29 23:12:43.581329 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581206 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-kubelet\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.581329 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581235 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-log-socket\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.581329 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581270 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c7491f84-75c3-4286-90f9-ec4314ac5bf9-hosts-file\") pod \"node-resolver-k9bgk\" (UID: \"c7491f84-75c3-4286-90f9-ec4314ac5bf9\") " pod="openshift-dns/node-resolver-k9bgk" Oct 29 23:12:43.581329 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581302 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2e07092-e461-46b5-a31e-8f2512b34cbd-cni-binary-copy\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.581588 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581333 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-run-netns\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.581588 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581358 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-daemon-config\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.581588 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581384 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6nnh\" (UniqueName: \"kubernetes.io/projected/ec3af7c3-d20a-499e-9cf7-c743da6b8ed1-kube-api-access-k6nnh\") pod \"node-ca-l59n4\" (UID: \"ec3af7c3-d20a-499e-9cf7-c743da6b8ed1\") " pod="openshift-image-registry/node-ca-l59n4" Oct 29 23:12:43.581588 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581410 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e2317d5c-4fcc-4027-82a7-911a28143f1a-ovn-node-metrics-cert\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.581588 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581456 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-socket-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:12:43.581588 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581481 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-etc-selinux\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:12:43.581588 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581505 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-cni-netd\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.581588 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581530 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-lib-modules\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.581588 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581564 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2a9a07d-839b-4f06-af7e-4651164dce3f-tmp\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.581924 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581589 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/286e0f07-4271-46b1-bca0-18ed0b12754e-cni-binary-copy\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:12:43.581924 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581635 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-cni-dir\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.581924 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581663 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-var-lib-cni-bin\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.581924 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581687 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-conf-dir\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.581924 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581711 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-run-systemd\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.581924 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581738 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-sysctl-conf\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.581924 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581763 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw5vc\" (UniqueName: \"kubernetes.io/projected/286e0f07-4271-46b1-bca0-18ed0b12754e-kube-api-access-mw5vc\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:12:43.581924 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581790 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-system-cni-dir\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.581924 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581815 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-var-lib-cni-multus\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.581924 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581838 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec3af7c3-d20a-499e-9cf7-c743da6b8ed1-host\") pod \"node-ca-l59n4\" (UID: \"ec3af7c3-d20a-499e-9cf7-c743da6b8ed1\") " pod="openshift-image-registry/node-ca-l59n4" Oct 29 23:12:43.581924 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581887 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7add189-cde4-470f-a543-4dc4a91be859-kubelet-config\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:12:43.581924 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581915 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b4b45cd-366a-4e03-8b83-0ad02541bfd6-host-slash\") pod \"iptables-alerter-pdsvg\" (UID: \"7b4b45cd-366a-4e03-8b83-0ad02541bfd6\") " pod="openshift-network-operator/iptables-alerter-pdsvg" Oct 29 23:12:43.582459 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.581947 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-cnibin\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.582459 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.582042 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-var-lib-kubelet\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.582459 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.582070 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-run-openvswitch\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.582459 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.582102 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.582459 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.582134 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-modprobe-d\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.582459 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.582176 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-host\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.582459 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.582217 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-run-k8s-cni-cncf-io\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.582459 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.582355 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwkxq\" (UniqueName: \"kubernetes.io/projected/f2e07092-e461-46b5-a31e-8f2512b34cbd-kube-api-access-cwkxq\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.582459 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.582384 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec3af7c3-d20a-499e-9cf7-c743da6b8ed1-serviceca\") pod \"node-ca-l59n4\" (UID: \"ec3af7c3-d20a-499e-9cf7-c743da6b8ed1\") " pod="openshift-image-registry/node-ca-l59n4" Oct 29 23:12:43.582459 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.582410 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-sys-fs\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:12:43.582853 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.582459 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e2317d5c-4fcc-4027-82a7-911a28143f1a-ovnkube-script-lib\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.582853 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.582508 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:12:43.582853 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.582539 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-run\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.582853 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.582570 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-run-multus-certs\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.582853 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.582604 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-etc-kubernetes\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.582853 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.582643 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-etc-openvswitch\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.582853 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.582677 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-systemd\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.582853 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.582718 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-var-lib-kubelet\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.582853 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.582767 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-tuned\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.582853 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.582836 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-run-ovn\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.583253 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.582921 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e2317d5c-4fcc-4027-82a7-911a28143f1a-ovnkube-config\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.583253 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.582968 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-sys\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.583253 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.582993 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvkrk\" (UniqueName: \"kubernetes.io/projected/b2a9a07d-839b-4f06-af7e-4651164dce3f-kube-api-access-wvkrk\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.583253 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.583036 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs\") pod \"network-metrics-daemon-l78hj\" (UID: \"480d690f-601d-4d63-aaf7-3717d5758230\") " pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:12:43.583253 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.583063 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-node-log\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.583253 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.583087 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-run-netns\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.583253 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.583112 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-run-ovn-kubernetes\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.583253 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.583146 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-sysctl-d\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.583253 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.583194 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/286e0f07-4271-46b1-bca0-18ed0b12754e-cnibin\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:12:43.583253 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.583225 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfr6k\" (UniqueName: \"kubernetes.io/projected/c7491f84-75c3-4286-90f9-ec4314ac5bf9-kube-api-access-jfr6k\") pod \"node-resolver-k9bgk\" (UID: \"c7491f84-75c3-4286-90f9-ec4314ac5bf9\") " pod="openshift-dns/node-resolver-k9bgk" Oct 29 23:12:43.583253 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.583250 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-hostroot\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.583631 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.583275 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zsds\" (UniqueName: \"kubernetes.io/projected/480d690f-601d-4d63-aaf7-3717d5758230-kube-api-access-2zsds\") pod \"network-metrics-daemon-l78hj\" (UID: \"480d690f-601d-4d63-aaf7-3717d5758230\") " pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:12:43.583631 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.583300 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w2ls\" (UniqueName: \"kubernetes.io/projected/ffb39d83-b282-4ae6-ada1-8250e3d1273c-kube-api-access-8w2ls\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:12:43.583631 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.583326 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2brg\" (UniqueName: \"kubernetes.io/projected/e2317d5c-4fcc-4027-82a7-911a28143f1a-kube-api-access-r2brg\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.583631 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.583351 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:12:43.583631 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.583402 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b4b45cd-366a-4e03-8b83-0ad02541bfd6-iptables-alerter-script\") pod \"iptables-alerter-pdsvg\" (UID: \"7b4b45cd-366a-4e03-8b83-0ad02541bfd6\") " pod="openshift-network-operator/iptables-alerter-pdsvg" Oct 29 23:12:43.583631 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.583430 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/286e0f07-4271-46b1-bca0-18ed0b12754e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:12:43.583631 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.583461 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/286e0f07-4271-46b1-bca0-18ed0b12754e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:12:43.583631 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.583487 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7138ba89-e1c9-4c07-a833-3ba8f9a54445-agent-certs\") pod \"konnectivity-agent-vnmw9\" (UID: \"7138ba89-e1c9-4c07-a833-3ba8f9a54445\") " pod="kube-system/konnectivity-agent-vnmw9" Oct 29 23:12:43.583631 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.583512 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-registration-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:12:43.583631 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.583536 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-slash\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.583631 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.583560 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-cni-bin\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.583631 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.583587 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75sml\" (UniqueName: \"kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml\") pod \"network-check-target-xnlbj\" (UID: \"f1cc6108-50e3-4a4d-855e-c4884e581e2e\") " pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:12:43.604714 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.604657 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" event={"ID":"b0bfae2a96103ad8818ab15e83f094e2","Type":"ContainerStarted","Data":"db6b3223a1a717d9d45a67097fc11687afecdebae32a30f500efb4c08123b93c"} Oct 29 23:12:43.606029 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.605956 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 29 23:12:43.606229 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.606198 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" event={"ID":"d854221abd6c4396f6ea6f6c004dea85","Type":"ContainerStarted","Data":"0f81a6e97ab7690b909a0f19219b64f62d9f7004b1c1218bbea4f09e584442dd"} Oct 29 23:12:43.606636 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.606589 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jb6zf\"" Oct 29 23:12:43.606636 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.606617 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9w58g\"" Oct 29 23:12:43.606882 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.606711 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-pgvzg\"" Oct 29 23:12:43.606882 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.606742 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8km5l\"" Oct 29 23:12:43.606882 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.606800 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pnrbh\"" Oct 29 23:12:43.607030 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.606927 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7zkzr\"" Oct 29 23:12:43.607030 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.606970 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hwcbb\"" Oct 29 23:12:43.610004 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.609959 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 29 23:12:43.610004 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.609976 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 29 23:12:43.610240 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.610009 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 29 23:12:43.610240 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.610015 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 29 23:12:43.610240 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.610020 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 29 23:12:43.610240 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.610027 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 29 23:12:43.610240 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.610120 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 29 23:12:43.610240 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.610137 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 29 23:12:43.610543 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.610284 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 29 23:12:43.610543 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.610386 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 29 23:12:43.610543 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.610392 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 29 23:12:43.610543 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.610391 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 29 23:12:43.610543 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.610398 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 29 23:12:43.610543 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.610442 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 29 23:12:43.610856 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.610823 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 29 23:12:43.610939 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.610867 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 29 23:12:43.684019 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.683986 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec3af7c3-d20a-499e-9cf7-c743da6b8ed1-host\") pod \"node-ca-l59n4\" (UID: \"ec3af7c3-d20a-499e-9cf7-c743da6b8ed1\") " pod="openshift-image-registry/node-ca-l59n4" Oct 29 23:12:43.684180 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684029 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7add189-cde4-470f-a543-4dc4a91be859-kubelet-config\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:12:43.684180 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684056 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b4b45cd-366a-4e03-8b83-0ad02541bfd6-host-slash\") pod \"iptables-alerter-pdsvg\" (UID: \"7b4b45cd-366a-4e03-8b83-0ad02541bfd6\") " pod="openshift-network-operator/iptables-alerter-pdsvg" Oct 29 23:12:43.684180 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684077 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-cnibin\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.684180 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684096 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec3af7c3-d20a-499e-9cf7-c743da6b8ed1-host\") pod \"node-ca-l59n4\" (UID: \"ec3af7c3-d20a-499e-9cf7-c743da6b8ed1\") " pod="openshift-image-registry/node-ca-l59n4" Oct 29 23:12:43.684180 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684102 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-var-lib-kubelet\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.684180 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684150 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-var-lib-kubelet\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.684180 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684161 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-run-openvswitch\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.684687 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684193 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.684687 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684212 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7add189-cde4-470f-a543-4dc4a91be859-kubelet-config\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:12:43.684687 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684223 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-modprobe-d\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.684687 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684252 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-host\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.684687 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684263 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b4b45cd-366a-4e03-8b83-0ad02541bfd6-host-slash\") pod \"iptables-alerter-pdsvg\" (UID: \"7b4b45cd-366a-4e03-8b83-0ad02541bfd6\") " pod="openshift-network-operator/iptables-alerter-pdsvg" Oct 29 23:12:43.684687 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684279 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-run-k8s-cni-cncf-io\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.684687 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684315 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwkxq\" (UniqueName: \"kubernetes.io/projected/f2e07092-e461-46b5-a31e-8f2512b34cbd-kube-api-access-cwkxq\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.684687 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684340 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec3af7c3-d20a-499e-9cf7-c743da6b8ed1-serviceca\") pod \"node-ca-l59n4\" (UID: \"ec3af7c3-d20a-499e-9cf7-c743da6b8ed1\") " pod="openshift-image-registry/node-ca-l59n4" Oct 29 23:12:43.684687 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684365 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-sys-fs\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:12:43.684687 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684390 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e2317d5c-4fcc-4027-82a7-911a28143f1a-ovnkube-script-lib\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.684687 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684419 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:12:43.684687 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684444 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-run\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.684687 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684468 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-cnibin\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.684687 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684519 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-run-multus-certs\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.684687 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684522 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-run-openvswitch\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.684687 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684470 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-run-multus-certs\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.684687 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684567 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.685555 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684571 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-etc-kubernetes\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.685555 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684600 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-etc-openvswitch\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.685555 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684629 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-systemd\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.685555 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684653 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-var-lib-kubelet\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.685555 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684677 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-tuned\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.685555 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684696 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-modprobe-d\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.685555 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684699 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-run-ovn\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.685555 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684737 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e2317d5c-4fcc-4027-82a7-911a28143f1a-ovnkube-config\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.685555 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684766 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-sys\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.685555 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684777 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-etc-kubernetes\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.685555 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684791 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvkrk\" (UniqueName: \"kubernetes.io/projected/b2a9a07d-839b-4f06-af7e-4651164dce3f-kube-api-access-wvkrk\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.685555 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684816 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-etc-openvswitch\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.685555 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs\") pod \"network-metrics-daemon-l78hj\" (UID: \"480d690f-601d-4d63-aaf7-3717d5758230\") " pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:12:43.685555 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684854 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-node-log\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.685555 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684879 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-run-netns\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.685555 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684925 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-run-ovn-kubernetes\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.685555 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684952 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-sysctl-d\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.685555 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684977 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/286e0f07-4271-46b1-bca0-18ed0b12754e-cnibin\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:12:43.686362 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.685033 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfr6k\" (UniqueName: \"kubernetes.io/projected/c7491f84-75c3-4286-90f9-ec4314ac5bf9-kube-api-access-jfr6k\") pod \"node-resolver-k9bgk\" (UID: \"c7491f84-75c3-4286-90f9-ec4314ac5bf9\") " pod="openshift-dns/node-resolver-k9bgk" Oct 29 23:12:43.686362 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.685087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-hostroot\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.686362 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.685169 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zsds\" (UniqueName: \"kubernetes.io/projected/480d690f-601d-4d63-aaf7-3717d5758230-kube-api-access-2zsds\") pod \"network-metrics-daemon-l78hj\" (UID: \"480d690f-601d-4d63-aaf7-3717d5758230\") " pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:12:43.686362 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.685196 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w2ls\" (UniqueName: \"kubernetes.io/projected/ffb39d83-b282-4ae6-ada1-8250e3d1273c-kube-api-access-8w2ls\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:12:43.686362 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.685486 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-systemd\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.686362 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.685545 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-var-lib-kubelet\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.686362 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.685674 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec3af7c3-d20a-499e-9cf7-c743da6b8ed1-serviceca\") pod \"node-ca-l59n4\" (UID: \"ec3af7c3-d20a-499e-9cf7-c743da6b8ed1\") " pod="openshift-image-registry/node-ca-l59n4" Oct 29 23:12:43.686362 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.685733 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2brg\" (UniqueName: \"kubernetes.io/projected/e2317d5c-4fcc-4027-82a7-911a28143f1a-kube-api-access-r2brg\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.686362 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.685785 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:12:43.686362 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.685813 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b4b45cd-366a-4e03-8b83-0ad02541bfd6-iptables-alerter-script\") pod \"iptables-alerter-pdsvg\" (UID: \"7b4b45cd-366a-4e03-8b83-0ad02541bfd6\") " pod="openshift-network-operator/iptables-alerter-pdsvg" Oct 29 23:12:43.686362 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.685841 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/286e0f07-4271-46b1-bca0-18ed0b12754e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:12:43.686362 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.685868 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-run-ovn-kubernetes\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.686362 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.685871 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/286e0f07-4271-46b1-bca0-18ed0b12754e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:12:43.686362 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.685862 2581 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 29 23:12:43.686362 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.685927 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7138ba89-e1c9-4c07-a833-3ba8f9a54445-agent-certs\") pod \"konnectivity-agent-vnmw9\" (UID: \"7138ba89-e1c9-4c07-a833-3ba8f9a54445\") " pod="kube-system/konnectivity-agent-vnmw9" Oct 29 23:12:43.686362 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.685958 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-registration-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:12:43.686362 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.685991 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-slash\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.686925 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686020 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-cni-bin\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.686925 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686036 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75sml\" (UniqueName: \"kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml\") pod \"network-check-target-xnlbj\" (UID: \"f1cc6108-50e3-4a4d-855e-c4884e581e2e\") " pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:12:43.686925 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686061 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/286e0f07-4271-46b1-bca0-18ed0b12754e-system-cni-dir\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:12:43.686925 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686079 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-device-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:12:43.686925 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686095 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-var-lib-openvswitch\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.686925 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686114 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e2317d5c-4fcc-4027-82a7-911a28143f1a-env-overrides\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.686925 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686135 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7add189-cde4-470f-a543-4dc4a91be859-dbus\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:12:43.686925 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686152 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-sysconfig\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.686925 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686167 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-kubernetes\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.686925 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686187 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7491f84-75c3-4286-90f9-ec4314ac5bf9-tmp-dir\") pod \"node-resolver-k9bgk\" (UID: \"c7491f84-75c3-4286-90f9-ec4314ac5bf9\") " pod="openshift-dns/node-resolver-k9bgk" Oct 29 23:12:43.686925 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686215 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-systemd-units\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.686925 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686245 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbdwc\" (UniqueName: \"kubernetes.io/projected/7b4b45cd-366a-4e03-8b83-0ad02541bfd6-kube-api-access-qbdwc\") pod \"iptables-alerter-pdsvg\" (UID: \"7b4b45cd-366a-4e03-8b83-0ad02541bfd6\") " pod="openshift-network-operator/iptables-alerter-pdsvg" Oct 29 23:12:43.686925 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/286e0f07-4271-46b1-bca0-18ed0b12754e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:12:43.686925 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686294 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-socket-dir-parent\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.686925 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686312 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7138ba89-e1c9-4c07-a833-3ba8f9a54445-konnectivity-ca\") pod \"konnectivity-agent-vnmw9\" (UID: \"7138ba89-e1c9-4c07-a833-3ba8f9a54445\") " pod="kube-system/konnectivity-agent-vnmw9" Oct 29 23:12:43.686925 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686334 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-kubelet\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.686925 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686350 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-log-socket\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.687458 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686367 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c7491f84-75c3-4286-90f9-ec4314ac5bf9-hosts-file\") pod \"node-resolver-k9bgk\" (UID: \"c7491f84-75c3-4286-90f9-ec4314ac5bf9\") " pod="openshift-dns/node-resolver-k9bgk" Oct 29 23:12:43.687458 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686384 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2e07092-e461-46b5-a31e-8f2512b34cbd-cni-binary-copy\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.687458 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686401 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-run-netns\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.687458 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686403 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/286e0f07-4271-46b1-bca0-18ed0b12754e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:12:43.687458 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686422 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-daemon-config\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.687458 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686441 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6nnh\" (UniqueName: \"kubernetes.io/projected/ec3af7c3-d20a-499e-9cf7-c743da6b8ed1-kube-api-access-k6nnh\") pod \"node-ca-l59n4\" (UID: \"ec3af7c3-d20a-499e-9cf7-c743da6b8ed1\") " pod="openshift-image-registry/node-ca-l59n4" Oct 29 23:12:43.687458 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686467 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e2317d5c-4fcc-4027-82a7-911a28143f1a-ovn-node-metrics-cert\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.687458 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686481 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-sys-fs\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:12:43.687458 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686489 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-socket-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:12:43.687458 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686512 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-etc-selinux\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:12:43.687458 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686541 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-cni-netd\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.687458 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686566 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-lib-modules\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.687458 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686587 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2a9a07d-839b-4f06-af7e-4651164dce3f-tmp\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.687458 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686611 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/286e0f07-4271-46b1-bca0-18ed0b12754e-cni-binary-copy\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:12:43.687458 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686630 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-cni-dir\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.687458 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686647 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-var-lib-cni-bin\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.687458 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686662 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-conf-dir\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.688013 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686678 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-run-systemd\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.688013 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686701 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-sysctl-conf\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.688013 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686728 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw5vc\" (UniqueName: \"kubernetes.io/projected/286e0f07-4271-46b1-bca0-18ed0b12754e-kube-api-access-mw5vc\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:12:43.688013 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686761 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-system-cni-dir\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.688013 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686790 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-var-lib-cni-multus\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.688013 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.686868 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-var-lib-cni-multus\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.688013 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:43.686961 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:43.688013 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:43.687028 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs podName:480d690f-601d-4d63-aaf7-3717d5758230 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:44.186996486 +0000 UTC m=+3.111216814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs") pod "network-metrics-daemon-l78hj" (UID: "480d690f-601d-4d63-aaf7-3717d5758230") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:43.688013 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.687036 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e2317d5c-4fcc-4027-82a7-911a28143f1a-ovnkube-script-lib\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.688013 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:43.687134 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:43.688013 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:43.687186 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret podName:f7add189-cde4-470f-a543-4dc4a91be859 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:44.187167711 +0000 UTC m=+3.111388006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret") pod "global-pull-secret-syncer-4ctmg" (UID: "f7add189-cde4-470f-a543-4dc4a91be859") : object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:43.688013 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.687208 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-node-log\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.688013 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.687256 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-run-netns\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.688013 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684898 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-host\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.688013 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.687299 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-run-k8s-cni-cncf-io\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.688013 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.687303 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-run\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.688013 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.687745 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e2317d5c-4fcc-4027-82a7-911a28143f1a-ovnkube-config\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.688540 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.684733 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-run-ovn\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.688540 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.687822 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-sys\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.688540 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.688260 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:12:43.688811 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.688785 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b4b45cd-366a-4e03-8b83-0ad02541bfd6-iptables-alerter-script\") pod \"iptables-alerter-pdsvg\" (UID: \"7b4b45cd-366a-4e03-8b83-0ad02541bfd6\") " pod="openshift-network-operator/iptables-alerter-pdsvg" Oct 29 23:12:43.689281 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.689260 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/286e0f07-4271-46b1-bca0-18ed0b12754e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:12:43.689410 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.689341 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c7491f84-75c3-4286-90f9-ec4314ac5bf9-hosts-file\") pod \"node-resolver-k9bgk\" (UID: \"c7491f84-75c3-4286-90f9-ec4314ac5bf9\") " pod="openshift-dns/node-resolver-k9bgk" Oct 29 23:12:43.689410 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.689402 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-registration-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:12:43.689549 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.689448 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-slash\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.689549 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.689494 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-cni-bin\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.689753 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.689721 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/286e0f07-4271-46b1-bca0-18ed0b12754e-system-cni-dir\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:12:43.689815 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.689784 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-device-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:12:43.689883 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.689832 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-var-lib-openvswitch\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.690083 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.690061 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-tuned\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.690226 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.690205 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7add189-cde4-470f-a543-4dc4a91be859-dbus\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:12:43.690298 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.690258 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-sysctl-d\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.690298 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.690279 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-sysconfig\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.690413 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.690327 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/286e0f07-4271-46b1-bca0-18ed0b12754e-cnibin\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:12:43.690473 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.690404 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7138ba89-e1c9-4c07-a833-3ba8f9a54445-agent-certs\") pod \"konnectivity-agent-vnmw9\" (UID: \"7138ba89-e1c9-4c07-a833-3ba8f9a54445\") " pod="kube-system/konnectivity-agent-vnmw9" Oct 29 23:12:43.690473 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.690417 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-kubernetes\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.690599 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.690587 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-cni-dir\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.690657 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.690643 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-var-lib-cni-bin\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.690723 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.690690 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-conf-dir\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.690787 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.690741 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-systemd-units\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.690843 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.690793 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-run-systemd\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.690843 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.690834 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-hostroot\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.690988 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.690967 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-etc-selinux\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:12:43.691057 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.690990 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-socket-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:12:43.691057 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.690997 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-sysctl-conf\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.691251 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.691230 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/286e0f07-4271-46b1-bca0-18ed0b12754e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:12:43.691313 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.691252 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-system-cni-dir\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.691313 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.691275 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e2317d5c-4fcc-4027-82a7-911a28143f1a-env-overrides\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.691424 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.691324 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-run-netns\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.691424 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.691338 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-socket-dir-parent\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.691424 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.691356 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7491f84-75c3-4286-90f9-ec4314ac5bf9-tmp-dir\") pod \"node-resolver-k9bgk\" (UID: \"c7491f84-75c3-4286-90f9-ec4314ac5bf9\") " pod="openshift-dns/node-resolver-k9bgk" Oct 29 23:12:43.691424 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.691375 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-cni-netd\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.691641 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.691430 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-log-socket\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.691641 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.691430 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-kubelet\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.691641 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.691445 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-lib-modules\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.691795 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.691646 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7138ba89-e1c9-4c07-a833-3ba8f9a54445-konnectivity-ca\") pod \"konnectivity-agent-vnmw9\" (UID: \"7138ba89-e1c9-4c07-a833-3ba8f9a54445\") " pod="kube-system/konnectivity-agent-vnmw9" Oct 29 23:12:43.691946 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.691917 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/286e0f07-4271-46b1-bca0-18ed0b12754e-cni-binary-copy\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:12:43.692914 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.692409 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2e07092-e461-46b5-a31e-8f2512b34cbd-cni-binary-copy\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.692914 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.692849 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-daemon-config\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.694435 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.694392 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2a9a07d-839b-4f06-af7e-4651164dce3f-tmp\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.694955 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.694923 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e2317d5c-4fcc-4027-82a7-911a28143f1a-ovn-node-metrics-cert\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.715601 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:43.715573 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 29 23:12:43.715819 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:43.715802 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 29 23:12:43.716017 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:43.716001 2581 projected.go:196] Error preparing data for projected volume kube-api-access-75sml for pod openshift-network-diagnostics/network-check-target-xnlbj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:43.716344 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:43.716325 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml podName:f1cc6108-50e3-4a4d-855e-c4884e581e2e nodeName:}" failed. No retries permitted until 2026-10-29 23:12:44.216304185 +0000 UTC m=+3.140524498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-75sml" (UniqueName: "kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml") pod "network-check-target-xnlbj" (UID: "f1cc6108-50e3-4a4d-855e-c4884e581e2e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:43.716470 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.716320 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w2ls\" (UniqueName: \"kubernetes.io/projected/ffb39d83-b282-4ae6-ada1-8250e3d1273c-kube-api-access-8w2ls\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:12:43.717211 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.716718 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw5vc\" (UniqueName: \"kubernetes.io/projected/286e0f07-4271-46b1-bca0-18ed0b12754e-kube-api-access-mw5vc\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:12:43.720302 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.720252 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbdwc\" (UniqueName: \"kubernetes.io/projected/7b4b45cd-366a-4e03-8b83-0ad02541bfd6-kube-api-access-qbdwc\") pod \"iptables-alerter-pdsvg\" (UID: \"7b4b45cd-366a-4e03-8b83-0ad02541bfd6\") " pod="openshift-network-operator/iptables-alerter-pdsvg" Oct 29 23:12:43.720302 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.720291 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2brg\" (UniqueName: \"kubernetes.io/projected/e2317d5c-4fcc-4027-82a7-911a28143f1a-kube-api-access-r2brg\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.720538 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.720425 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwkxq\" (UniqueName: \"kubernetes.io/projected/f2e07092-e461-46b5-a31e-8f2512b34cbd-kube-api-access-cwkxq\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.720868 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.720844 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvkrk\" (UniqueName: \"kubernetes.io/projected/b2a9a07d-839b-4f06-af7e-4651164dce3f-kube-api-access-wvkrk\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.721896 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.721855 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfr6k\" (UniqueName: \"kubernetes.io/projected/c7491f84-75c3-4286-90f9-ec4314ac5bf9-kube-api-access-jfr6k\") pod \"node-resolver-k9bgk\" (UID: \"c7491f84-75c3-4286-90f9-ec4314ac5bf9\") " pod="openshift-dns/node-resolver-k9bgk" Oct 29 23:12:43.722387 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.722363 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6nnh\" (UniqueName: \"kubernetes.io/projected/ec3af7c3-d20a-499e-9cf7-c743da6b8ed1-kube-api-access-k6nnh\") pod \"node-ca-l59n4\" (UID: \"ec3af7c3-d20a-499e-9cf7-c743da6b8ed1\") " pod="openshift-image-registry/node-ca-l59n4" Oct 29 23:12:43.722872 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.722849 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zsds\" (UniqueName: \"kubernetes.io/projected/480d690f-601d-4d63-aaf7-3717d5758230-kube-api-access-2zsds\") pod \"network-metrics-daemon-l78hj\" (UID: \"480d690f-601d-4d63-aaf7-3717d5758230\") " pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:12:43.794192 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.793968 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vnmw9" Oct 29 23:12:43.804367 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:43.804337 2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7138ba89_e1c9_4c07_a833_3ba8f9a54445.slice/crio-f0017bc2c60bfc43e54a7237d2b242138809e4da2c89d1f2b5138fda836f19da WatchSource:0}: Error finding container f0017bc2c60bfc43e54a7237d2b242138809e4da2c89d1f2b5138fda836f19da: Status 404 returned error can't find the container with id f0017bc2c60bfc43e54a7237d2b242138809e4da2c89d1f2b5138fda836f19da Oct 29 23:12:43.807329 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.807160 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:12:43.817953 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:43.817916 2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffb39d83_b282_4ae6_ada1_8250e3d1273c.slice/crio-25755c20867e43dee9a0c733805d8732fc83331d524a3218d6ffb8c493e8cc4e WatchSource:0}: Error finding container 25755c20867e43dee9a0c733805d8732fc83331d524a3218d6ffb8c493e8cc4e: Status 404 returned error can't find the container with id 25755c20867e43dee9a0c733805d8732fc83331d524a3218d6ffb8c493e8cc4e Oct 29 23:12:43.831395 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.831369 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:12:43.831514 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.831426 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k9bgk" Oct 29 23:12:43.834227 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.834185 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sk9hv" Oct 29 23:12:43.842592 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.842572 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:12:43.848513 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:43.848455 2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2317d5c_4fcc_4027_82a7_911a28143f1a.slice/crio-82cc95bcb4a5fd542030a9c4381b16b4004e7320696015a86238f18b81570a1a WatchSource:0}: Error finding container 82cc95bcb4a5fd542030a9c4381b16b4004e7320696015a86238f18b81570a1a: Status 404 returned error can't find the container with id 82cc95bcb4a5fd542030a9c4381b16b4004e7320696015a86238f18b81570a1a Oct 29 23:12:43.849246 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:43.849220 2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7491f84_75c3_4286_90f9_ec4314ac5bf9.slice/crio-69e14cc55a0c169ad2e87174f66daa3ea17a581045ab0bf52d3b88b92e257768 WatchSource:0}: Error finding container 69e14cc55a0c169ad2e87174f66daa3ea17a581045ab0bf52d3b88b92e257768: Status 404 returned error can't find the container with id 69e14cc55a0c169ad2e87174f66daa3ea17a581045ab0bf52d3b88b92e257768 Oct 29 23:12:43.855884 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.855690 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pdsvg" Oct 29 23:12:43.858927 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:43.858862 2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2a9a07d_839b_4f06_af7e_4651164dce3f.slice/crio-9d09c1aeddaf8f2de52c655c6c9afcd16cdd656b3bc20234fd0322af946f6490 WatchSource:0}: Error finding container 9d09c1aeddaf8f2de52c655c6c9afcd16cdd656b3bc20234fd0322af946f6490: Status 404 returned error can't find the container with id 9d09c1aeddaf8f2de52c655c6c9afcd16cdd656b3bc20234fd0322af946f6490 Oct 29 23:12:43.867317 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:43.867294 2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b4b45cd_366a_4e03_8b83_0ad02541bfd6.slice/crio-ae2a0c3a0041823cad6a647bb942b967685040749078f098715db9e4cdb4adb7 WatchSource:0}: Error finding container ae2a0c3a0041823cad6a647bb942b967685040749078f098715db9e4cdb4adb7: Status 404 returned error can't find the container with id ae2a0c3a0041823cad6a647bb942b967685040749078f098715db9e4cdb4adb7 Oct 29 23:12:43.877144 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.877118 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l59n4" Oct 29 23:12:43.882260 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:43.882220 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:12:43.889420 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:43.889393 2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec3af7c3_d20a_499e_9cf7_c743da6b8ed1.slice/crio-8c55e8d9b8fafd3455e99b739cd513f81d5c50767e7a907aa1424655fd8787db WatchSource:0}: Error finding container 8c55e8d9b8fafd3455e99b739cd513f81d5c50767e7a907aa1424655fd8787db: Status 404 returned error can't find the container with id 8c55e8d9b8fafd3455e99b739cd513f81d5c50767e7a907aa1424655fd8787db Oct 29 23:12:43.893533 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:12:43.893499 2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod286e0f07_4271_46b1_bca0_18ed0b12754e.slice/crio-04d9d55239382b834b38a6f4c37944238b1509e14a0602fcadeb61fca0508b95 WatchSource:0}: Error finding container 04d9d55239382b834b38a6f4c37944238b1509e14a0602fcadeb61fca0508b95: Status 404 returned error can't find the container with id 04d9d55239382b834b38a6f4c37944238b1509e14a0602fcadeb61fca0508b95 Oct 29 23:12:44.191055 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:44.190986 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:12:44.191055 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:44.191031 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs\") pod \"network-metrics-daemon-l78hj\" (UID: \"480d690f-601d-4d63-aaf7-3717d5758230\") " pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:12:44.191250 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:44.191153 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:44.191250 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:44.191220 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret podName:f7add189-cde4-470f-a543-4dc4a91be859 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:45.191205502 +0000 UTC m=+4.115425812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret") pod "global-pull-secret-syncer-4ctmg" (UID: "f7add189-cde4-470f-a543-4dc4a91be859") : object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:44.191250 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:44.191165 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:44.191428 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:44.191315 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs podName:480d690f-601d-4d63-aaf7-3717d5758230 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:45.191290484 +0000 UTC m=+4.115510777 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs") pod "network-metrics-daemon-l78hj" (UID: "480d690f-601d-4d63-aaf7-3717d5758230") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:44.292566 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:44.292472 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75sml\" (UniqueName: \"kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml\") pod \"network-check-target-xnlbj\" (UID: \"f1cc6108-50e3-4a4d-855e-c4884e581e2e\") " pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:12:44.294362 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:44.292778 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 29 23:12:44.294362 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:44.292839 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 29 23:12:44.294362 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:44.292854 2581 projected.go:196] Error preparing data for projected volume kube-api-access-75sml for pod openshift-network-diagnostics/network-check-target-xnlbj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:44.294362 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:44.292936 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml podName:f1cc6108-50e3-4a4d-855e-c4884e581e2e nodeName:}" failed. No retries permitted until 2026-10-29 23:12:45.292915212 +0000 UTC m=+4.217135518 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-75sml" (UniqueName: "kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml") pod "network-check-target-xnlbj" (UID: "f1cc6108-50e3-4a4d-855e-c4884e581e2e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:44.546488 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:44.546389 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-28 23:07:44 +0000 UTC" deadline="2028-04-25 08:41:13.428166353 +0000 UTC" Oct 29 23:12:44.546488 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:44.546435 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13041h28m28.881736522s" Oct 29 23:12:44.601951 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:44.601361 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:12:44.601951 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:44.601509 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hj" podUID="480d690f-601d-4d63-aaf7-3717d5758230" Oct 29 23:12:44.627538 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:44.627362 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" event={"ID":"e2317d5c-4fcc-4027-82a7-911a28143f1a","Type":"ContainerStarted","Data":"82cc95bcb4a5fd542030a9c4381b16b4004e7320696015a86238f18b81570a1a"} Oct 29 23:12:44.631619 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:44.631536 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" event={"ID":"ffb39d83-b282-4ae6-ada1-8250e3d1273c","Type":"ContainerStarted","Data":"25755c20867e43dee9a0c733805d8732fc83331d524a3218d6ffb8c493e8cc4e"} Oct 29 23:12:44.649596 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:44.649213 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-psb28" event={"ID":"286e0f07-4271-46b1-bca0-18ed0b12754e","Type":"ContainerStarted","Data":"04d9d55239382b834b38a6f4c37944238b1509e14a0602fcadeb61fca0508b95"} Oct 29 23:12:44.652834 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:44.652705 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l59n4" event={"ID":"ec3af7c3-d20a-499e-9cf7-c743da6b8ed1","Type":"ContainerStarted","Data":"8c55e8d9b8fafd3455e99b739cd513f81d5c50767e7a907aa1424655fd8787db"} Oct 29 23:12:44.655324 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:44.655009 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-btfzv" event={"ID":"b2a9a07d-839b-4f06-af7e-4651164dce3f","Type":"ContainerStarted","Data":"9d09c1aeddaf8f2de52c655c6c9afcd16cdd656b3bc20234fd0322af946f6490"} Oct 29 23:12:44.671480 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:44.671443 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sk9hv" event={"ID":"f2e07092-e461-46b5-a31e-8f2512b34cbd","Type":"ContainerStarted","Data":"ceb618a53abf5cc77fff88bf0bc5e0f429e55a66d8902ab495e54503b68a0710"} Oct 29 23:12:44.675610 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:44.675547 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k9bgk" event={"ID":"c7491f84-75c3-4286-90f9-ec4314ac5bf9","Type":"ContainerStarted","Data":"69e14cc55a0c169ad2e87174f66daa3ea17a581045ab0bf52d3b88b92e257768"} Oct 29 23:12:44.686779 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:44.686506 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vnmw9" event={"ID":"7138ba89-e1c9-4c07-a833-3ba8f9a54445","Type":"ContainerStarted","Data":"f0017bc2c60bfc43e54a7237d2b242138809e4da2c89d1f2b5138fda836f19da"} Oct 29 23:12:44.688747 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:44.688725 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pdsvg" event={"ID":"7b4b45cd-366a-4e03-8b83-0ad02541bfd6","Type":"ContainerStarted","Data":"ae2a0c3a0041823cad6a647bb942b967685040749078f098715db9e4cdb4adb7"} Oct 29 23:12:45.206868 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:45.206016 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs\") pod \"network-metrics-daemon-l78hj\" (UID: \"480d690f-601d-4d63-aaf7-3717d5758230\") " pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:12:45.206868 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:45.206128 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:12:45.206868 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:45.206267 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:45.206868 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:45.206333 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret podName:f7add189-cde4-470f-a543-4dc4a91be859 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:47.206314578 +0000 UTC m=+6.130534870 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret") pod "global-pull-secret-syncer-4ctmg" (UID: "f7add189-cde4-470f-a543-4dc4a91be859") : object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:45.206868 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:45.206778 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:45.206868 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:45.206832 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs podName:480d690f-601d-4d63-aaf7-3717d5758230 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:47.206815206 +0000 UTC m=+6.131035498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs") pod "network-metrics-daemon-l78hj" (UID: "480d690f-601d-4d63-aaf7-3717d5758230") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:45.308084 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:45.307384 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75sml\" (UniqueName: \"kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml\") pod \"network-check-target-xnlbj\" (UID: \"f1cc6108-50e3-4a4d-855e-c4884e581e2e\") " pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:12:45.308084 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:45.307556 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 29 23:12:45.308084 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:45.307585 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 29 23:12:45.308084 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:45.307598 2581 projected.go:196] Error preparing data for projected volume kube-api-access-75sml for pod openshift-network-diagnostics/network-check-target-xnlbj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:45.308084 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:45.307661 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml podName:f1cc6108-50e3-4a4d-855e-c4884e581e2e nodeName:}" failed. No retries permitted until 2026-10-29 23:12:47.307642125 +0000 UTC m=+6.231862455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-75sml" (UniqueName: "kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml") pod "network-check-target-xnlbj" (UID: "f1cc6108-50e3-4a4d-855e-c4884e581e2e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:45.546740 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:45.546609 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-28 23:07:44 +0000 UTC" deadline="2028-07-25 13:53:06.924812924 +0000 UTC" Oct 29 23:12:45.546740 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:45.546675 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15230h40m21.378142889s" Oct 29 23:12:45.600580 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:45.599994 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:12:45.600580 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:45.600136 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ctmg" podUID="f7add189-cde4-470f-a543-4dc4a91be859" Oct 29 23:12:45.601097 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:45.600921 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:12:45.601097 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:45.601038 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnlbj" podUID="f1cc6108-50e3-4a4d-855e-c4884e581e2e" Oct 29 23:12:45.701905 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:45.701852 2581 generic.go:356] "Generic (PLEG): container finished" podID="b0bfae2a96103ad8818ab15e83f094e2" containerID="146f82fa852187897bcd3bae9991518dabef2375adaa72067cf0b10bb1369d4c" exitCode=0 Oct 29 23:12:45.702096 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:45.701977 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" event={"ID":"b0bfae2a96103ad8818ab15e83f094e2","Type":"ContainerDied","Data":"146f82fa852187897bcd3bae9991518dabef2375adaa72067cf0b10bb1369d4c"} Oct 29 23:12:45.722847 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:45.722811 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" event={"ID":"d854221abd6c4396f6ea6f6c004dea85","Type":"ContainerStarted","Data":"f1c7a1a453e05e1f9b68ff6409d4043c525a3a0b83c730a44eb2f4ad55467654"} Oct 29 23:12:45.789152 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:45.789083 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" podStartSLOduration=2.789062415 podStartE2EDuration="2.789062415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:45.788295175 +0000 UTC m=+4.712515493" watchObservedRunningTime="2026-10-29 23:12:45.789062415 +0000 UTC m=+4.713282730" Oct 29 23:12:46.599863 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:46.599816 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:12:46.600494 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:46.599982 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hj" podUID="480d690f-601d-4d63-aaf7-3717d5758230" Oct 29 23:12:46.757251 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:46.757202 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" event={"ID":"b0bfae2a96103ad8818ab15e83f094e2","Type":"ContainerStarted","Data":"ef6dd3be7c123efb050edc726b786afcb1aef8d6b87ed74fd9d250895fb9426b"} Oct 29 23:12:47.225836 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:47.225744 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:12:47.225836 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:47.225813 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs\") pod \"network-metrics-daemon-l78hj\" (UID: \"480d690f-601d-4d63-aaf7-3717d5758230\") " pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:12:47.226068 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:47.225990 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:47.226068 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:47.226058 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs podName:480d690f-601d-4d63-aaf7-3717d5758230 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:51.226037151 +0000 UTC m=+10.150257452 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs") pod "network-metrics-daemon-l78hj" (UID: "480d690f-601d-4d63-aaf7-3717d5758230") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:47.226581 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:47.226561 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:47.226671 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:47.226618 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret podName:f7add189-cde4-470f-a543-4dc4a91be859 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:51.226602266 +0000 UTC m=+10.150822592 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret") pod "global-pull-secret-syncer-4ctmg" (UID: "f7add189-cde4-470f-a543-4dc4a91be859") : object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:47.326474 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:47.326433 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75sml\" (UniqueName: \"kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml\") pod \"network-check-target-xnlbj\" (UID: \"f1cc6108-50e3-4a4d-855e-c4884e581e2e\") " pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:12:47.326663 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:47.326633 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 29 23:12:47.326663 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:47.326660 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 29 23:12:47.326801 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:47.326675 2581 projected.go:196] Error preparing data for projected volume kube-api-access-75sml for pod openshift-network-diagnostics/network-check-target-xnlbj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:47.326801 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:47.326743 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml podName:f1cc6108-50e3-4a4d-855e-c4884e581e2e nodeName:}" failed. No retries permitted until 2026-10-29 23:12:51.326720588 +0000 UTC m=+10.250940897 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-75sml" (UniqueName: "kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml") pod "network-check-target-xnlbj" (UID: "f1cc6108-50e3-4a4d-855e-c4884e581e2e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:47.599857 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:47.599791 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:12:47.600036 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:47.599955 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ctmg" podUID="f7add189-cde4-470f-a543-4dc4a91be859" Oct 29 23:12:47.600702 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:47.600523 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:12:47.600702 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:47.600635 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnlbj" podUID="f1cc6108-50e3-4a4d-855e-c4884e581e2e" Oct 29 23:12:47.761727 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:47.761672 2581 generic.go:356] "Generic (PLEG): container finished" podID="286e0f07-4271-46b1-bca0-18ed0b12754e" containerID="333336c07a4b3bbd7cfe7105681ea8f64a663c48d0cf76ae1151abc9e9f403aa" exitCode=0 Oct 29 23:12:47.762932 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:47.762032 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-psb28" event={"ID":"286e0f07-4271-46b1-bca0-18ed0b12754e","Type":"ContainerDied","Data":"333336c07a4b3bbd7cfe7105681ea8f64a663c48d0cf76ae1151abc9e9f403aa"} Oct 29 23:12:47.828961 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:47.828286 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" podStartSLOduration=4.828265956 podStartE2EDuration="4.828265956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:46.813528075 +0000 UTC m=+5.737748386" watchObservedRunningTime="2026-10-29 23:12:47.828265956 +0000 UTC m=+6.752486272" Oct 29 23:12:48.599268 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:48.599234 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:12:48.599475 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:48.599385 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hj" podUID="480d690f-601d-4d63-aaf7-3717d5758230" Oct 29 23:12:48.774621 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:48.774521 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vnmw9" event={"ID":"7138ba89-e1c9-4c07-a833-3ba8f9a54445","Type":"ContainerStarted","Data":"a654f9f8105c7208474f8d7bea9cc023f09192ae2015cdd75300e299bdcf13e0"} Oct 29 23:12:48.808371 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:48.808336 2581 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vnmw9" Oct 29 23:12:48.808686 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:48.808667 2581 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vnmw9" Oct 29 23:12:48.909466 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:48.908922 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vnmw9" podStartSLOduration=2.771124575 podStartE2EDuration="6.908883426s" totalImagesPullingTime="4.137758851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:48.848729229 +0000 UTC m=+7.772949542" watchObservedRunningTime="2026-10-29 23:12:48.908883426 +0000 UTC m=+7.833103731" Oct 29 23:12:49.602707 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:49.601993 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:12:49.602707 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:49.602132 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ctmg" podUID="f7add189-cde4-470f-a543-4dc4a91be859" Oct 29 23:12:49.602707 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:49.602211 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:12:49.602707 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:49.602290 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnlbj" podUID="f1cc6108-50e3-4a4d-855e-c4884e581e2e" Oct 29 23:12:49.779883 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:49.779799 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l59n4" event={"ID":"ec3af7c3-d20a-499e-9cf7-c743da6b8ed1","Type":"ContainerStarted","Data":"63f2d12668b209e842b51702b8fcf22752e1f9ba241d60b57c96b3ba52c0a901"} Oct 29 23:12:49.824918 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:49.823630 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-l59n4" podStartSLOduration=2.694802088 podStartE2EDuration="7.823609715s" totalImagesPullingTime="5.128807627s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:49.823229684 +0000 UTC m=+8.747450000" watchObservedRunningTime="2026-10-29 23:12:49.823609715 +0000 UTC m=+8.747830035" Oct 29 23:12:50.600690 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:50.600156 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:12:50.600690 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:50.600315 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hj" podUID="480d690f-601d-4d63-aaf7-3717d5758230" Oct 29 23:12:50.785303 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:50.784917 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" event={"ID":"ffb39d83-b282-4ae6-ada1-8250e3d1273c","Type":"ContainerStarted","Data":"952092f89d40020cbacd9b60948b397348f29bfe6e8c7fc90e4d7b5755187bd7"} Oct 29 23:12:50.785303 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:50.785047 2581 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 29 23:12:51.261211 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:51.261166 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:12:51.261389 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:51.261233 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs\") pod \"network-metrics-daemon-l78hj\" (UID: \"480d690f-601d-4d63-aaf7-3717d5758230\") " pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:12:51.261439 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:51.261399 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:51.261475 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:51.261466 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs podName:480d690f-601d-4d63-aaf7-3717d5758230 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:59.261447292 +0000 UTC m=+18.185667604 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs") pod "network-metrics-daemon-l78hj" (UID: "480d690f-601d-4d63-aaf7-3717d5758230") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:51.261927 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:51.261906 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:51.262005 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:51.261967 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret podName:f7add189-cde4-470f-a543-4dc4a91be859 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:59.261951452 +0000 UTC m=+18.186171755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret") pod "global-pull-secret-syncer-4ctmg" (UID: "f7add189-cde4-470f-a543-4dc4a91be859") : object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:51.362516 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:51.362474 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75sml\" (UniqueName: \"kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml\") pod \"network-check-target-xnlbj\" (UID: \"f1cc6108-50e3-4a4d-855e-c4884e581e2e\") " pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:12:51.362697 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:51.362647 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 29 23:12:51.362697 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:51.362678 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 29 23:12:51.362697 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:51.362691 2581 projected.go:196] Error preparing data for projected volume kube-api-access-75sml for pod openshift-network-diagnostics/network-check-target-xnlbj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:51.362799 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:51.362747 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml podName:f1cc6108-50e3-4a4d-855e-c4884e581e2e nodeName:}" failed. No retries permitted until 2026-10-29 23:12:59.362730168 +0000 UTC m=+18.286950465 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-75sml" (UniqueName: "kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml") pod "network-check-target-xnlbj" (UID: "f1cc6108-50e3-4a4d-855e-c4884e581e2e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:51.602173 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:51.602143 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:12:51.602349 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:51.602244 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ctmg" podUID="f7add189-cde4-470f-a543-4dc4a91be859" Oct 29 23:12:51.602547 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:51.602529 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:12:51.602612 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:51.602596 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnlbj" podUID="f1cc6108-50e3-4a4d-855e-c4884e581e2e" Oct 29 23:12:51.708276 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:51.708247 2581 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 29 23:12:51.791918 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:51.791845 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" event={"ID":"ffb39d83-b282-4ae6-ada1-8250e3d1273c","Type":"ContainerStarted","Data":"f25049584473d2f180d95ef9148fae24b323e961185e312fab2a0ef23268888b"} Oct 29 23:12:52.548413 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:52.548055 2581 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-29T23:12:51.708282153Z","UUID":"52dcf24d-d91e-46f1-a15a-bdd4aa67d032","Handler":null,"Name":"","Endpoint":""} Oct 29 23:12:52.550160 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:52.549776 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 29 23:12:52.550160 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:52.549806 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 29 23:12:52.599940 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:52.599871 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:12:52.600220 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:52.600028 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hj" podUID="480d690f-601d-4d63-aaf7-3717d5758230" Oct 29 23:12:52.798674 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:52.798641 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" event={"ID":"ffb39d83-b282-4ae6-ada1-8250e3d1273c","Type":"ContainerStarted","Data":"d38201060cceea35f9d4a2b1d2e9f9feb5fcca99910525e30568ba3058dabd46"} Oct 29 23:12:52.802646 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:52.802071 2581 generic.go:356] "Generic (PLEG): container finished" podID="286e0f07-4271-46b1-bca0-18ed0b12754e" containerID="164ef08b6dee5b9ee3e865ed303b995bc223e52b649942b20273d13f7bc3d405" exitCode=0 Oct 29 23:12:52.802646 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:52.802339 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-psb28" event={"ID":"286e0f07-4271-46b1-bca0-18ed0b12754e","Type":"ContainerDied","Data":"164ef08b6dee5b9ee3e865ed303b995bc223e52b649942b20273d13f7bc3d405"} Oct 29 23:12:52.804829 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:52.804791 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sk9hv" event={"ID":"f2e07092-e461-46b5-a31e-8f2512b34cbd","Type":"ContainerStarted","Data":"a20fc40bd3ebd9df8e7eacdc69efbb1ce6ad4cb38bad9b8f6d28ee6b202501ea"} Oct 29 23:12:52.806700 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:52.806679 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k9bgk" event={"ID":"c7491f84-75c3-4286-90f9-ec4314ac5bf9","Type":"ContainerStarted","Data":"9c83b6ff225fba7b75c0ce7c96f198f5efe5a45766269a79270b69123e436bd5"} Oct 29 23:12:52.850271 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:52.850207 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" podStartSLOduration=2.386097934 podStartE2EDuration="10.850194371s" totalImagesPullingTime="8.464096437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:52.849632765 +0000 UTC m=+11.773853082" watchObservedRunningTime="2026-10-29 23:12:52.850194371 +0000 UTC m=+11.774414682" Oct 29 23:12:52.889426 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:52.889366 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-k9bgk" podStartSLOduration=2.475563971 podStartE2EDuration="10.889348829s" totalImagesPullingTime="8.413784858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:52.889152385 +0000 UTC m=+11.813372699" watchObservedRunningTime="2026-10-29 23:12:52.889348829 +0000 UTC m=+11.813569143" Oct 29 23:12:52.931385 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:52.931328 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-sk9hv" podStartSLOduration=2.858267164 podStartE2EDuration="10.931310255s" totalImagesPullingTime="8.073043091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:52.930796798 +0000 UTC m=+11.855017108" watchObservedRunningTime="2026-10-29 23:12:52.931310255 +0000 UTC m=+11.855530569" Oct 29 23:12:53.599648 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:53.599612 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:12:53.599648 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:53.599643 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:12:53.599910 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:53.599752 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ctmg" podUID="f7add189-cde4-470f-a543-4dc4a91be859" Oct 29 23:12:53.599972 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:53.599897 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnlbj" podUID="f1cc6108-50e3-4a4d-855e-c4884e581e2e" Oct 29 23:12:53.811347 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:53.811309 2581 generic.go:356] "Generic (PLEG): container finished" podID="286e0f07-4271-46b1-bca0-18ed0b12754e" containerID="6e6ea7f62bc1e222bb152f09d48442ab02ac27fd0821768b23f07fd6f013e478" exitCode=0 Oct 29 23:12:53.811825 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:53.811625 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-psb28" event={"ID":"286e0f07-4271-46b1-bca0-18ed0b12754e","Type":"ContainerDied","Data":"6e6ea7f62bc1e222bb152f09d48442ab02ac27fd0821768b23f07fd6f013e478"} Oct 29 23:12:53.813429 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:53.813385 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pdsvg" event={"ID":"7b4b45cd-366a-4e03-8b83-0ad02541bfd6","Type":"ContainerStarted","Data":"f3337ffc3f722df61818e2bde4faac04d3f7ce04a55eeefaed9cff5d9eadcf1b"} Oct 29 23:12:53.895924 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:53.895864 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pdsvg" podStartSLOduration=3.640570624 podStartE2EDuration="11.895845196s" totalImagesPullingTime="8.255274572s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:53.895808996 +0000 UTC m=+12.820029309" watchObservedRunningTime="2026-10-29 23:12:53.895845196 +0000 UTC m=+12.820065509" Oct 29 23:12:54.599693 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:54.599517 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:12:54.599693 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:54.599652 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hj" podUID="480d690f-601d-4d63-aaf7-3717d5758230" Oct 29 23:12:54.819650 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:54.819550 2581 generic.go:356] "Generic (PLEG): container finished" podID="286e0f07-4271-46b1-bca0-18ed0b12754e" containerID="0bd3b24991303e3d4f822ea09b07c4235b8c4082e7483a15893fd6f859fcf6fd" exitCode=0 Oct 29 23:12:54.820384 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:54.819690 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-psb28" event={"ID":"286e0f07-4271-46b1-bca0-18ed0b12754e","Type":"ContainerDied","Data":"0bd3b24991303e3d4f822ea09b07c4235b8c4082e7483a15893fd6f859fcf6fd"} Oct 29 23:12:54.823937 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:54.823905 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-btfzv" event={"ID":"b2a9a07d-839b-4f06-af7e-4651164dce3f","Type":"ContainerStarted","Data":"be19980ba411cf74dc2cbdde1bd100399ce6e79fc31bd179acb0a8a8bbed6821"} Oct 29 23:12:54.935100 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:54.935036 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-btfzv" podStartSLOduration=2.249333146 podStartE2EDuration="12.935017632s" totalImagesPullingTime="10.685684486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:54.934258237 +0000 UTC m=+13.858478548" watchObservedRunningTime="2026-10-29 23:12:54.935017632 +0000 UTC m=+13.859237946" Oct 29 23:12:55.600241 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:55.600211 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:12:55.600458 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:55.600336 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ctmg" podUID="f7add189-cde4-470f-a543-4dc4a91be859" Oct 29 23:12:55.600458 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:55.600393 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:12:55.600567 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:55.600499 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnlbj" podUID="f1cc6108-50e3-4a4d-855e-c4884e581e2e" Oct 29 23:12:56.600220 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:56.600016 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:12:56.600660 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:56.600316 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hj" podUID="480d690f-601d-4d63-aaf7-3717d5758230" Oct 29 23:12:57.602507 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:57.602243 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:12:57.602507 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:57.602364 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnlbj" podUID="f1cc6108-50e3-4a4d-855e-c4884e581e2e" Oct 29 23:12:57.602507 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:57.602400 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:12:57.602507 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:57.602476 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ctmg" podUID="f7add189-cde4-470f-a543-4dc4a91be859" Oct 29 23:12:57.838758 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:57.838718 2581 generic.go:356] "Generic (PLEG): container finished" podID="286e0f07-4271-46b1-bca0-18ed0b12754e" containerID="5d73985664637eea83ea52d08ce8454e3911874fcadbae7a849be7ae746e5c00" exitCode=0 Oct 29 23:12:57.838935 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:57.838854 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-psb28" event={"ID":"286e0f07-4271-46b1-bca0-18ed0b12754e","Type":"ContainerDied","Data":"5d73985664637eea83ea52d08ce8454e3911874fcadbae7a849be7ae746e5c00"} Oct 29 23:12:58.599557 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:58.599517 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:12:58.599923 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:58.599696 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hj" podUID="480d690f-601d-4d63-aaf7-3717d5758230" Oct 29 23:12:58.843733 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:58.843698 2581 generic.go:356] "Generic (PLEG): container finished" podID="286e0f07-4271-46b1-bca0-18ed0b12754e" containerID="010a0e1c5053aca9e17231dcad9e19409540c9206ecb3acc6d92fb47825e89f7" exitCode=0 Oct 29 23:12:58.844171 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:58.843747 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-psb28" event={"ID":"286e0f07-4271-46b1-bca0-18ed0b12754e","Type":"ContainerDied","Data":"010a0e1c5053aca9e17231dcad9e19409540c9206ecb3acc6d92fb47825e89f7"} Oct 29 23:12:59.321456 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:59.321274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:12:59.321609 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:59.321468 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs\") pod \"network-metrics-daemon-l78hj\" (UID: \"480d690f-601d-4d63-aaf7-3717d5758230\") " pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:12:59.321609 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:59.321414 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:59.321609 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:59.321559 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:59.321609 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:59.321594 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret podName:f7add189-cde4-470f-a543-4dc4a91be859 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:15.321578162 +0000 UTC m=+34.245798452 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret") pod "global-pull-secret-syncer-4ctmg" (UID: "f7add189-cde4-470f-a543-4dc4a91be859") : object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:59.321609 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:59.321608 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs podName:480d690f-601d-4d63-aaf7-3717d5758230 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:15.321601397 +0000 UTC m=+34.245821687 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs") pod "network-metrics-daemon-l78hj" (UID: "480d690f-601d-4d63-aaf7-3717d5758230") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:59.421797 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:59.421712 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75sml\" (UniqueName: \"kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml\") pod \"network-check-target-xnlbj\" (UID: \"f1cc6108-50e3-4a4d-855e-c4884e581e2e\") " pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:12:59.421979 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:59.421928 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 29 23:12:59.421979 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:59.421945 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 29 23:12:59.421979 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:59.421954 2581 projected.go:196] Error preparing data for projected volume kube-api-access-75sml for pod openshift-network-diagnostics/network-check-target-xnlbj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:59.422086 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:59.422005 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml podName:f1cc6108-50e3-4a4d-855e-c4884e581e2e nodeName:}" failed. No retries permitted until 2026-10-29 23:13:15.421987555 +0000 UTC m=+34.346207858 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-75sml" (UniqueName: "kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml") pod "network-check-target-xnlbj" (UID: "f1cc6108-50e3-4a4d-855e-c4884e581e2e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:59.602585 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:59.602559 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:12:59.602719 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:59.602687 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnlbj" podUID="f1cc6108-50e3-4a4d-855e-c4884e581e2e" Oct 29 23:12:59.602785 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:59.602729 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:12:59.602837 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:12:59.602796 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ctmg" podUID="f7add189-cde4-470f-a543-4dc4a91be859" Oct 29 23:12:59.848479 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:59.848441 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" event={"ID":"e2317d5c-4fcc-4027-82a7-911a28143f1a","Type":"ContainerStarted","Data":"6dfaa0648fba8f9471856fe93ad9434d898f7a5b247279ce6e37ce47f45bf6ba"} Oct 29 23:12:59.848912 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:59.848517 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" event={"ID":"e2317d5c-4fcc-4027-82a7-911a28143f1a","Type":"ContainerStarted","Data":"6bfc46b7a6ee3d75b316495c2e64447284c09947b8860ed8332459fb61054e4b"} Oct 29 23:12:59.848912 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:59.848568 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" event={"ID":"e2317d5c-4fcc-4027-82a7-911a28143f1a","Type":"ContainerStarted","Data":"23ad5b9d63df4492f74824237464e0202cb6b4c379fb7706c9e9a3c5818a9866"} Oct 29 23:12:59.848912 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:59.848600 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" event={"ID":"e2317d5c-4fcc-4027-82a7-911a28143f1a","Type":"ContainerStarted","Data":"ea3def007f719998ac203592b1ac845c890a6a54e76246e14396b9b14ef8c76b"} Oct 29 23:12:59.848912 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:59.848643 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" event={"ID":"e2317d5c-4fcc-4027-82a7-911a28143f1a","Type":"ContainerStarted","Data":"5a42be703b1ebba19a3987a19aeb348a2053e5acbce54e21c0fb16f2e56f9aa5"} Oct 29 23:12:59.848912 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:59.848690 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" event={"ID":"e2317d5c-4fcc-4027-82a7-911a28143f1a","Type":"ContainerStarted","Data":"49cd170b68f539eabf0f3cc87cf149a5720a58708be8326a39439c53456f6eb7"} Oct 29 23:12:59.851701 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:59.851674 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-psb28" event={"ID":"286e0f07-4271-46b1-bca0-18ed0b12754e","Type":"ContainerStarted","Data":"47423499671b524299af36067f9a41dfa5ea9a73c182be6cf33573899475ee2f"} Oct 29 23:12:59.901014 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:12:59.900970 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-psb28" podStartSLOduration=7.238010305 podStartE2EDuration="17.90095937s" totalImagesPullingTime="10.662949065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:59.900799274 +0000 UTC m=+18.825019588" watchObservedRunningTime="2026-10-29 23:12:59.90095937 +0000 UTC m=+18.825179680" Oct 29 23:13:00.599644 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:00.599600 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:13:00.599838 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:00.599707 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hj" podUID="480d690f-601d-4d63-aaf7-3717d5758230" Oct 29 23:13:01.600364 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:01.600284 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:01.600901 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:01.600371 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ctmg" podUID="f7add189-cde4-470f-a543-4dc4a91be859" Oct 29 23:13:01.600901 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:01.600425 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:13:01.600901 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:01.600521 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnlbj" podUID="f1cc6108-50e3-4a4d-855e-c4884e581e2e" Oct 29 23:13:01.858752 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:01.858660 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" event={"ID":"e2317d5c-4fcc-4027-82a7-911a28143f1a","Type":"ContainerStarted","Data":"40fd28ad86b68ff01e80d4b61b63500bd9ab96381e1a76190e7c5c64e95ba3b0"} Oct 29 23:13:02.599508 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:02.599475 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:13:02.599651 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:02.599586 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hj" podUID="480d690f-601d-4d63-aaf7-3717d5758230" Oct 29 23:13:03.602616 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:03.602586 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:13:03.603217 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:03.602707 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnlbj" podUID="f1cc6108-50e3-4a4d-855e-c4884e581e2e" Oct 29 23:13:03.603217 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:03.602743 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:03.603217 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:03.602854 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ctmg" podUID="f7add189-cde4-470f-a543-4dc4a91be859" Oct 29 23:13:03.867200 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:03.867169 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" event={"ID":"e2317d5c-4fcc-4027-82a7-911a28143f1a","Type":"ContainerStarted","Data":"13b226a57fe48e7946015695e573aa0acf9cbadcefd43e0090acd63de6763284"} Oct 29 23:13:03.867435 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:03.867416 2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:03.882217 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:03.882193 2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:03.959131 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:03.959079 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" podStartSLOduration=6.832734354 podStartE2EDuration="21.959066184s" totalImagesPullingTime="15.12633183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:03.958943806 +0000 UTC m=+22.883164117" watchObservedRunningTime="2026-10-29 23:13:03.959066184 +0000 UTC m=+22.883286486" Oct 29 23:13:04.599993 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:04.599957 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:13:04.600155 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:04.600061 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hj" podUID="480d690f-601d-4d63-aaf7-3717d5758230" Oct 29 23:13:04.869852 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:04.869555 2581 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 29 23:13:04.869852 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:04.869728 2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:04.884743 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:04.884719 2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:05.603217 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:05.603125 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:13:05.603376 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:05.603253 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnlbj" podUID="f1cc6108-50e3-4a4d-855e-c4884e581e2e" Oct 29 23:13:05.603376 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:05.603291 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:05.603376 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:05.603354 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ctmg" podUID="f7add189-cde4-470f-a543-4dc4a91be859" Oct 29 23:13:05.622049 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:05.622017 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l78hj"] Oct 29 23:13:05.622187 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:05.622130 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:13:05.622259 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:05.622238 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hj" podUID="480d690f-601d-4d63-aaf7-3717d5758230" Oct 29 23:13:05.625809 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:05.625781 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xnlbj"] Oct 29 23:13:05.625953 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:05.625844 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4ctmg"] Oct 29 23:13:05.871547 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:05.871470 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:05.871547 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:05.871491 2581 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 29 23:13:05.872026 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:05.871571 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:13:05.872026 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:05.871583 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ctmg" podUID="f7add189-cde4-470f-a543-4dc4a91be859" Oct 29 23:13:05.872026 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:05.871947 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnlbj" podUID="f1cc6108-50e3-4a4d-855e-c4884e581e2e" Oct 29 23:13:06.873596 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:06.873567 2581 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 29 23:13:07.558850 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:07.558796 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k9bgk_c7491f84-75c3-4286-90f9-ec4314ac5bf9/dns-node-resolver/0.log" Oct 29 23:13:07.602748 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:07.602724 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:13:07.603027 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:07.602809 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:13:07.603027 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:07.602938 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:07.603027 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:07.602952 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hj" podUID="480d690f-601d-4d63-aaf7-3717d5758230" Oct 29 23:13:07.603173 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:07.603025 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ctmg" podUID="f7add189-cde4-470f-a543-4dc4a91be859" Oct 29 23:13:07.603173 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:07.603098 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnlbj" podUID="f1cc6108-50e3-4a4d-855e-c4884e581e2e" Oct 29 23:13:08.304851 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:08.304775 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l59n4_ec3af7c3-d20a-499e-9cf7-c743da6b8ed1/node-ca/0.log" Oct 29 23:13:09.599415 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:09.599380 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:09.599415 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:09.599409 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:13:09.600064 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:09.599380 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:13:09.600064 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:09.599498 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ctmg" podUID="f7add189-cde4-470f-a543-4dc4a91be859" Oct 29 23:13:09.600064 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:09.599562 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hj" podUID="480d690f-601d-4d63-aaf7-3717d5758230" Oct 29 23:13:09.600064 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:09.599661 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnlbj" podUID="f1cc6108-50e3-4a4d-855e-c4884e581e2e" Oct 29 23:13:10.094977 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:10.094947 2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vnmw9" Oct 29 23:13:10.095143 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:10.095080 2581 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 29 23:13:10.095478 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:10.095460 2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vnmw9" Oct 29 23:13:11.602835 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:11.602790 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:13:11.603225 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:11.602878 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:11.603225 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:11.602901 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:13:11.603225 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:11.602974 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ctmg" podUID="f7add189-cde4-470f-a543-4dc4a91be859" Oct 29 23:13:11.603225 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:11.603023 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hj" podUID="480d690f-601d-4d63-aaf7-3717d5758230" Oct 29 23:13:11.603225 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:11.603065 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnlbj" podUID="f1cc6108-50e3-4a4d-855e-c4884e581e2e" Oct 29 23:13:12.067714 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:12.067679 2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:12.067942 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:12.067901 2581 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 29 23:13:12.079231 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:12.079211 2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:13.600316 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:13.600272 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:13:13.600316 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:13.600300 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:13.600316 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:13.600292 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:13:13.600759 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:13.600416 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ctmg" podUID="f7add189-cde4-470f-a543-4dc4a91be859" Oct 29 23:13:13.600759 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:13.600466 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hj" podUID="480d690f-601d-4d63-aaf7-3717d5758230" Oct 29 23:13:13.600759 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:13.600528 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnlbj" podUID="f1cc6108-50e3-4a4d-855e-c4884e581e2e" Oct 29 23:13:15.329215 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:15.329173 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:15.329215 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:15.329219 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs\") pod \"network-metrics-daemon-l78hj\" (UID: \"480d690f-601d-4d63-aaf7-3717d5758230\") " pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:13:15.329616 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:15.329329 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:13:15.329616 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:15.329382 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs podName:480d690f-601d-4d63-aaf7-3717d5758230 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:47.329369241 +0000 UTC m=+66.253589529 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs") pod "network-metrics-daemon-l78hj" (UID: "480d690f-601d-4d63-aaf7-3717d5758230") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:13:15.329616 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:15.329332 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 29 23:13:15.329616 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:15.329461 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret podName:f7add189-cde4-470f-a543-4dc4a91be859 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:47.329448977 +0000 UTC m=+66.253669266 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret") pod "global-pull-secret-syncer-4ctmg" (UID: "f7add189-cde4-470f-a543-4dc4a91be859") : object "kube-system"/"original-pull-secret" not registered Oct 29 23:13:15.429497 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:15.429456 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75sml\" (UniqueName: \"kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml\") pod \"network-check-target-xnlbj\" (UID: \"f1cc6108-50e3-4a4d-855e-c4884e581e2e\") " pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:13:15.429677 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:15.429586 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 29 23:13:15.429677 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:15.429600 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 29 23:13:15.429677 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:15.429612 2581 projected.go:196] Error preparing data for projected volume kube-api-access-75sml for pod openshift-network-diagnostics/network-check-target-xnlbj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:13:15.429677 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:15.429656 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml podName:f1cc6108-50e3-4a4d-855e-c4884e581e2e nodeName:}" failed. No retries permitted until 2026-10-29 23:13:47.429643914 +0000 UTC m=+66.353864202 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-75sml" (UniqueName: "kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml") pod "network-check-target-xnlbj" (UID: "f1cc6108-50e3-4a4d-855e-c4884e581e2e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:13:15.602480 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:15.602402 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:13:15.602620 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:15.602502 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:13:15.602620 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:15.602509 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hj" podUID="480d690f-601d-4d63-aaf7-3717d5758230" Oct 29 23:13:15.602620 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:15.602529 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:15.602620 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:15.602606 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnlbj" podUID="f1cc6108-50e3-4a4d-855e-c4884e581e2e" Oct 29 23:13:15.602770 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:15.602663 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ctmg" podUID="f7add189-cde4-470f-a543-4dc4a91be859" Oct 29 23:13:17.602674 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:17.602644 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:13:17.603076 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:17.602649 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:13:17.603076 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:17.602740 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnlbj" podUID="f1cc6108-50e3-4a4d-855e-c4884e581e2e" Oct 29 23:13:17.603076 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:17.602649 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:17.603076 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:17.602834 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hj" podUID="480d690f-601d-4d63-aaf7-3717d5758230" Oct 29 23:13:17.603076 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:17.602887 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ctmg" podUID="f7add189-cde4-470f-a543-4dc4a91be859" Oct 29 23:13:19.602750 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:19.602720 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:13:19.602750 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:19.602739 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:19.603176 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:19.602835 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:13:19.603176 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:19.602857 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hj" podUID="480d690f-601d-4d63-aaf7-3717d5758230" Oct 29 23:13:19.603176 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:19.602900 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnlbj" podUID="f1cc6108-50e3-4a4d-855e-c4884e581e2e" Oct 29 23:13:19.603176 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:19.602966 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ctmg" podUID="f7add189-cde4-470f-a543-4dc4a91be859" Oct 29 23:13:21.602427 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:21.602398 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:13:21.602850 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:21.602398 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:13:21.602850 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:21.602504 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnlbj" podUID="f1cc6108-50e3-4a4d-855e-c4884e581e2e" Oct 29 23:13:21.602850 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:21.602402 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:21.602850 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:21.602586 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hj" podUID="480d690f-601d-4d63-aaf7-3717d5758230" Oct 29 23:13:21.602850 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:21.602696 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ctmg" podUID="f7add189-cde4-470f-a543-4dc4a91be859" Oct 29 23:13:23.603092 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:23.603058 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:13:23.603569 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:23.603145 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:13:23.603569 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:23.603162 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:23.603569 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:23.603241 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hj" podUID="480d690f-601d-4d63-aaf7-3717d5758230" Oct 29 23:13:23.603569 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:23.603323 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ctmg" podUID="f7add189-cde4-470f-a543-4dc4a91be859" Oct 29 23:13:23.603569 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:23.603414 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnlbj" podUID="f1cc6108-50e3-4a4d-855e-c4884e581e2e" Oct 29 23:13:25.599735 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.599641 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:13:25.600226 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.599641 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:25.600226 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:25.599768 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnlbj" podUID="f1cc6108-50e3-4a4d-855e-c4884e581e2e" Oct 29 23:13:25.600226 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:25.599854 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4ctmg" podUID="f7add189-cde4-470f-a543-4dc4a91be859" Oct 29 23:13:25.600226 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.599649 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:13:25.600226 ip-10-0-138-163 kubenswrapper[2581]: E1029 23:13:25.599937 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78hj" podUID="480d690f-601d-4d63-aaf7-3717d5758230" Oct 29 23:13:25.824998 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.824972 2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeReady" Oct 29 23:13:25.825156 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.825086 2581 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Oct 29 23:13:25.887374 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.887290 2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sxpxx"] Oct 29 23:13:25.889061 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.889046 2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-smjz7"] Oct 29 23:13:25.889188 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.889166 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:25.890672 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.890649 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:25.906171 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.906146 2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pqwqb"] Oct 29 23:13:25.907535 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.907520 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pqwqb" Oct 29 23:13:25.908334 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.908307 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 29 23:13:25.908446 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.908369 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tldxj\"" Oct 29 23:13:25.908511 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.908495 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 29 23:13:25.911553 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.911530 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 29 23:13:25.912527 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.912507 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sxpxx"] Oct 29 23:13:25.912690 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.912677 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-sx9m6\"" Oct 29 23:13:25.912748 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.912739 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 29 23:13:25.914039 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.914020 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-smjz7"] Oct 29 23:13:25.929565 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.929538 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pqwqb"] Oct 29 23:13:25.998300 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.998262 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ac381e5-012d-42c0-bfa4-1e6e313b694a-data-volume\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:25.998300 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.998300 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ac381e5-012d-42c0-bfa4-1e6e313b694a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:25.998551 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.998331 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxmhl\" (UniqueName: \"kubernetes.io/projected/4ac381e5-012d-42c0-bfa4-1e6e313b694a-kube-api-access-lxmhl\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:25.998551 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.998415 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-config-volume\") pod \"dns-default-sxpxx\" (UID: \"0fc5618f-b30f-45ce-b070-beed0ecbbbd9\") " pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:25.998551 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.998462 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ac381e5-012d-42c0-bfa4-1e6e313b694a-crio-socket\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:25.998691 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.998567 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ac381e5-012d-42c0-bfa4-1e6e313b694a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:25.998691 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.998598 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht2fz\" (UniqueName: \"kubernetes.io/projected/14a7a4eb-db41-4943-a17f-6f2f02d55966-kube-api-access-ht2fz\") pod \"ingress-canary-pqwqb\" (UID: \"14a7a4eb-db41-4943-a17f-6f2f02d55966\") " pod="openshift-ingress-canary/ingress-canary-pqwqb" Oct 29 23:13:25.998691 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.998625 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14a7a4eb-db41-4943-a17f-6f2f02d55966-cert\") pod \"ingress-canary-pqwqb\" (UID: \"14a7a4eb-db41-4943-a17f-6f2f02d55966\") " pod="openshift-ingress-canary/ingress-canary-pqwqb" Oct 29 23:13:25.998691 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.998685 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-metrics-tls\") pod \"dns-default-sxpxx\" (UID: \"0fc5618f-b30f-45ce-b070-beed0ecbbbd9\") " pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:25.998811 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.998741 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-tmp-dir\") pod \"dns-default-sxpxx\" (UID: \"0fc5618f-b30f-45ce-b070-beed0ecbbbd9\") " pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:25.998811 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:25.998797 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgqr9\" (UniqueName: \"kubernetes.io/projected/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-kube-api-access-vgqr9\") pod \"dns-default-sxpxx\" (UID: \"0fc5618f-b30f-45ce-b070-beed0ecbbbd9\") " pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:26.008934 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.008898 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 29 23:13:26.009046 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.008942 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 29 23:13:26.009046 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.008954 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 29 23:13:26.009046 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.009015 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 29 23:13:26.009158 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.009073 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-gj5kk\"" Oct 29 23:13:26.009158 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.009146 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 29 23:13:26.099904 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.099863 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ac381e5-012d-42c0-bfa4-1e6e313b694a-data-volume\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:26.099904 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.099908 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ac381e5-012d-42c0-bfa4-1e6e313b694a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:26.100148 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.100036 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxmhl\" (UniqueName: \"kubernetes.io/projected/4ac381e5-012d-42c0-bfa4-1e6e313b694a-kube-api-access-lxmhl\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:26.100148 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.100079 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-config-volume\") pod \"dns-default-sxpxx\" (UID: \"0fc5618f-b30f-45ce-b070-beed0ecbbbd9\") " pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:26.100148 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.100109 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ac381e5-012d-42c0-bfa4-1e6e313b694a-crio-socket\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:26.100303 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.100177 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ac381e5-012d-42c0-bfa4-1e6e313b694a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:26.100351 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.100310 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ac381e5-012d-42c0-bfa4-1e6e313b694a-data-volume\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:26.100393 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.100369 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ac381e5-012d-42c0-bfa4-1e6e313b694a-crio-socket\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:26.100439 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.100419 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht2fz\" (UniqueName: \"kubernetes.io/projected/14a7a4eb-db41-4943-a17f-6f2f02d55966-kube-api-access-ht2fz\") pod \"ingress-canary-pqwqb\" (UID: \"14a7a4eb-db41-4943-a17f-6f2f02d55966\") " pod="openshift-ingress-canary/ingress-canary-pqwqb" Oct 29 23:13:26.100485 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.100455 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14a7a4eb-db41-4943-a17f-6f2f02d55966-cert\") pod \"ingress-canary-pqwqb\" (UID: \"14a7a4eb-db41-4943-a17f-6f2f02d55966\") " pod="openshift-ingress-canary/ingress-canary-pqwqb" Oct 29 23:13:26.100610 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.100585 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-metrics-tls\") pod \"dns-default-sxpxx\" (UID: \"0fc5618f-b30f-45ce-b070-beed0ecbbbd9\") " pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:26.100661 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.100641 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-tmp-dir\") pod \"dns-default-sxpxx\" (UID: \"0fc5618f-b30f-45ce-b070-beed0ecbbbd9\") " pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:26.100706 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.100674 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgqr9\" (UniqueName: \"kubernetes.io/projected/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-kube-api-access-vgqr9\") pod \"dns-default-sxpxx\" (UID: \"0fc5618f-b30f-45ce-b070-beed0ecbbbd9\") " pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:26.100747 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.100722 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-config-volume\") pod \"dns-default-sxpxx\" (UID: \"0fc5618f-b30f-45ce-b070-beed0ecbbbd9\") " pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:26.100790 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.100776 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ac381e5-012d-42c0-bfa4-1e6e313b694a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:26.100961 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.100944 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-tmp-dir\") pod \"dns-default-sxpxx\" (UID: \"0fc5618f-b30f-45ce-b070-beed0ecbbbd9\") " pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:26.103769 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.103745 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ac381e5-012d-42c0-bfa4-1e6e313b694a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:26.103906 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.103785 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-metrics-tls\") pod \"dns-default-sxpxx\" (UID: \"0fc5618f-b30f-45ce-b070-beed0ecbbbd9\") " pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:26.103906 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.103864 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14a7a4eb-db41-4943-a17f-6f2f02d55966-cert\") pod \"ingress-canary-pqwqb\" (UID: \"14a7a4eb-db41-4943-a17f-6f2f02d55966\") " pod="openshift-ingress-canary/ingress-canary-pqwqb" Oct 29 23:13:26.120708 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.120676 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxmhl\" (UniqueName: \"kubernetes.io/projected/4ac381e5-012d-42c0-bfa4-1e6e313b694a-kube-api-access-lxmhl\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:26.121191 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.121175 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht2fz\" (UniqueName: \"kubernetes.io/projected/14a7a4eb-db41-4943-a17f-6f2f02d55966-kube-api-access-ht2fz\") pod \"ingress-canary-pqwqb\" (UID: \"14a7a4eb-db41-4943-a17f-6f2f02d55966\") " pod="openshift-ingress-canary/ingress-canary-pqwqb" Oct 29 23:13:26.121797 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.121772 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgqr9\" (UniqueName: \"kubernetes.io/projected/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-kube-api-access-vgqr9\") pod \"dns-default-sxpxx\" (UID: \"0fc5618f-b30f-45ce-b070-beed0ecbbbd9\") " pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:26.201951 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.201854 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:26.208281 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.208254 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:26.218278 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.218243 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pqwqb" Oct 29 23:13:26.514401 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.514364 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-smjz7"] Oct 29 23:13:26.517549 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:13:26.517519 2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ac381e5_012d_42c0_bfa4_1e6e313b694a.slice/crio-ba5f5b12df177fbc161b95aef99c135505439e298d3124ed749aaacd9c4ed5a5 WatchSource:0}: Error finding container ba5f5b12df177fbc161b95aef99c135505439e298d3124ed749aaacd9c4ed5a5: Status 404 returned error can't find the container with id ba5f5b12df177fbc161b95aef99c135505439e298d3124ed749aaacd9c4ed5a5 Oct 29 23:13:26.522016 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.521901 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pqwqb"] Oct 29 23:13:26.525110 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.525090 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sxpxx"] Oct 29 23:13:26.525368 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:13:26.525302 2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14a7a4eb_db41_4943_a17f_6f2f02d55966.slice/crio-3c0a2af3b088b7ded81dbf2274416b38f63511542ea4b2fd9c7eb02088e8a672 WatchSource:0}: Error finding container 3c0a2af3b088b7ded81dbf2274416b38f63511542ea4b2fd9c7eb02088e8a672: Status 404 returned error can't find the container with id 3c0a2af3b088b7ded81dbf2274416b38f63511542ea4b2fd9c7eb02088e8a672 Oct 29 23:13:26.527173 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:13:26.527150 2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fc5618f_b30f_45ce_b070_beed0ecbbbd9.slice/crio-0cfe4ce3648f45cdb974bfbddc3ddee17c5630a0b34788278232e0de08d1afc4 WatchSource:0}: Error finding container 0cfe4ce3648f45cdb974bfbddc3ddee17c5630a0b34788278232e0de08d1afc4: Status 404 returned error can't find the container with id 0cfe4ce3648f45cdb974bfbddc3ddee17c5630a0b34788278232e0de08d1afc4 Oct 29 23:13:26.919050 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.918943 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pqwqb" event={"ID":"14a7a4eb-db41-4943-a17f-6f2f02d55966","Type":"ContainerStarted","Data":"3c0a2af3b088b7ded81dbf2274416b38f63511542ea4b2fd9c7eb02088e8a672"} Oct 29 23:13:26.920669 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.920603 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sxpxx" event={"ID":"0fc5618f-b30f-45ce-b070-beed0ecbbbd9","Type":"ContainerStarted","Data":"0cfe4ce3648f45cdb974bfbddc3ddee17c5630a0b34788278232e0de08d1afc4"} Oct 29 23:13:26.922729 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.922707 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-smjz7" event={"ID":"4ac381e5-012d-42c0-bfa4-1e6e313b694a","Type":"ContainerStarted","Data":"65409ad7086727f9d4efb532469b52b9dee374db266dd50fc74fe8b4bfcea8ce"} Oct 29 23:13:26.922904 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:26.922756 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-smjz7" event={"ID":"4ac381e5-012d-42c0-bfa4-1e6e313b694a","Type":"ContainerStarted","Data":"ba5f5b12df177fbc161b95aef99c135505439e298d3124ed749aaacd9c4ed5a5"} Oct 29 23:13:27.599318 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:27.599283 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:27.599318 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:27.599304 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:13:27.599562 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:27.599456 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:13:27.616210 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:27.616082 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-89z4k\"" Oct 29 23:13:27.630133 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:27.630109 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2vcdm\"" Oct 29 23:13:27.630235 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:27.630188 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 29 23:13:27.630272 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:27.630234 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 29 23:13:27.630347 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:27.630334 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-phkn8\"" Oct 29 23:13:27.643602 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:27.643571 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 29 23:13:27.643746 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:27.643692 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 29 23:13:27.929385 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:27.929299 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-smjz7" event={"ID":"4ac381e5-012d-42c0-bfa4-1e6e313b694a","Type":"ContainerStarted","Data":"7e393ef47be3d1013309b9f83a67588222b6d589b5b7c90d37443da62e1263de"} Oct 29 23:13:28.830679 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:28.830638 2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-m47cv"] Oct 29 23:13:28.833940 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:28.833910 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" Oct 29 23:13:28.865699 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:28.865671 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Oct 29 23:13:28.865868 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:28.865750 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 29 23:13:28.866533 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:28.866513 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-m47cv"] Oct 29 23:13:28.879421 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:28.879388 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Oct 29 23:13:28.879421 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:28.879409 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-tpq4z\"" Oct 29 23:13:28.879619 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:28.879385 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 29 23:13:28.879619 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:28.879432 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 29 23:13:28.924396 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:28.924319 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-m47cv\" (UID: \"78f5b80d-524a-4d8a-8290-8a6fd7d1faa5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" Oct 29 23:13:28.924396 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:28.924362 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9djk\" (UniqueName: \"kubernetes.io/projected/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-kube-api-access-h9djk\") pod \"prometheus-operator-9cd89b74c-m47cv\" (UID: \"78f5b80d-524a-4d8a-8290-8a6fd7d1faa5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" Oct 29 23:13:28.924396 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:28.924387 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-m47cv\" (UID: \"78f5b80d-524a-4d8a-8290-8a6fd7d1faa5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" Oct 29 23:13:28.924653 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:28.924481 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-m47cv\" (UID: \"78f5b80d-524a-4d8a-8290-8a6fd7d1faa5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" Oct 29 23:13:28.934965 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:28.934930 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-smjz7" event={"ID":"4ac381e5-012d-42c0-bfa4-1e6e313b694a","Type":"ContainerStarted","Data":"d5b3184f654aa8354221ec76d3e7beca460f1f7abf49b009b4ce4b5af9b52a56"} Oct 29 23:13:28.937375 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:28.937346 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sxpxx" event={"ID":"0fc5618f-b30f-45ce-b070-beed0ecbbbd9","Type":"ContainerStarted","Data":"6c3270457c82bbe941200529d42c2d0697df39868f8e8debffce987f133778d4"} Oct 29 23:13:28.937501 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:28.937392 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sxpxx" event={"ID":"0fc5618f-b30f-45ce-b070-beed0ecbbbd9","Type":"ContainerStarted","Data":"e812fe1c66c45d0049f7d3df0c5108f81b4b555db66105659121d9f2eb786d4f"} Oct 29 23:13:28.937544 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:28.937497 2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:28.978099 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:28.978042 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-smjz7" podStartSLOduration=1.971965333 podStartE2EDuration="3.978023148s" totalImagesPullingTime="2.006057815s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:13:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:28.976997878 +0000 UTC m=+47.901218190" watchObservedRunningTime="2026-10-29 23:13:28.978023148 +0000 UTC m=+47.902243457" Oct 29 23:13:29.019501 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.019436 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-sxpxx" podStartSLOduration=2.267753016 podStartE2EDuration="4.019418667s" totalImagesPullingTime="1.751665651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:29.018683419 +0000 UTC m=+47.942903730" watchObservedRunningTime="2026-10-29 23:13:29.019418667 +0000 UTC m=+47.943638979" Oct 29 23:13:29.025799 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.025761 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-m47cv\" (UID: \"78f5b80d-524a-4d8a-8290-8a6fd7d1faa5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" Oct 29 23:13:29.025963 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.025851 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9djk\" (UniqueName: \"kubernetes.io/projected/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-kube-api-access-h9djk\") pod \"prometheus-operator-9cd89b74c-m47cv\" (UID: \"78f5b80d-524a-4d8a-8290-8a6fd7d1faa5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" Oct 29 23:13:29.025963 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.025917 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-m47cv\" (UID: \"78f5b80d-524a-4d8a-8290-8a6fd7d1faa5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" Oct 29 23:13:29.026078 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.025979 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-m47cv\" (UID: \"78f5b80d-524a-4d8a-8290-8a6fd7d1faa5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" Oct 29 23:13:29.027251 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.027221 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-m47cv\" (UID: \"78f5b80d-524a-4d8a-8290-8a6fd7d1faa5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" Oct 29 23:13:29.029729 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.029664 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-m47cv\" (UID: \"78f5b80d-524a-4d8a-8290-8a6fd7d1faa5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" Oct 29 23:13:29.029729 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.029682 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-m47cv\" (UID: \"78f5b80d-524a-4d8a-8290-8a6fd7d1faa5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" Oct 29 23:13:29.047919 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.047893 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9djk\" (UniqueName: \"kubernetes.io/projected/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-kube-api-access-h9djk\") pod \"prometheus-operator-9cd89b74c-m47cv\" (UID: \"78f5b80d-524a-4d8a-8290-8a6fd7d1faa5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" Oct 29 23:13:29.149231 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.149213 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" Oct 29 23:13:29.444254 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.444227 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-m47cv"] Oct 29 23:13:29.445893 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:13:29.445866 2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78f5b80d_524a_4d8a_8290_8a6fd7d1faa5.slice/crio-55d642655ff4479f6baaa851396b7452f17c842317163ca751c9bfdeaeb437f2 WatchSource:0}: Error finding container 55d642655ff4479f6baaa851396b7452f17c842317163ca751c9bfdeaeb437f2: Status 404 returned error can't find the container with id 55d642655ff4479f6baaa851396b7452f17c842317163ca751c9bfdeaeb437f2 Oct 29 23:13:29.577742 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.577711 2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-7848849768-qnlvb"] Oct 29 23:13:29.580843 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.580807 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:29.597169 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.597145 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Oct 29 23:13:29.597324 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.597234 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Oct 29 23:13:29.597452 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.597429 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Oct 29 23:13:29.598141 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.598104 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gnrh6\"" Oct 29 23:13:29.598244 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.598211 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Oct 29 23:13:29.598244 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.598216 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Oct 29 23:13:29.598351 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.598297 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Oct 29 23:13:29.598437 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.598416 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Oct 29 23:13:29.605995 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.605971 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7848849768-qnlvb"] Oct 29 23:13:29.732402 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.732321 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-config\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:29.732402 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.732357 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-oauth-serving-cert\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:29.732402 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.732388 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-serving-cert\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:29.732595 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.732451 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-tmp\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:29.732595 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.732486 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcxvh\" (UniqueName: \"kubernetes.io/projected/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-kube-api-access-bcxvh\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:29.732595 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.732527 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-service-ca\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:29.732595 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.732573 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-oauth-config\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:29.833217 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.833182 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-oauth-config\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:29.833382 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.833231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-config\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:29.833382 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.833258 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-oauth-serving-cert\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:29.833382 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.833307 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-serving-cert\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:29.833382 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.833328 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-tmp\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:29.833382 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.833351 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcxvh\" (UniqueName: \"kubernetes.io/projected/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-kube-api-access-bcxvh\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:29.833382 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.833374 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-service-ca\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:29.834164 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.834128 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-tmp\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:29.834164 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.834150 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-config\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:29.834334 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.834199 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-oauth-serving-cert\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:29.834334 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.834202 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-service-ca\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:29.836310 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.836280 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-oauth-config\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:29.836411 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.836392 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-serving-cert\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:29.855378 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.855346 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcxvh\" (UniqueName: \"kubernetes.io/projected/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-kube-api-access-bcxvh\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:29.892167 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.892137 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:29.942144 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.942108 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" event={"ID":"78f5b80d-524a-4d8a-8290-8a6fd7d1faa5","Type":"ContainerStarted","Data":"55d642655ff4479f6baaa851396b7452f17c842317163ca751c9bfdeaeb437f2"} Oct 29 23:13:29.944180 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.944119 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pqwqb" event={"ID":"14a7a4eb-db41-4943-a17f-6f2f02d55966","Type":"ContainerStarted","Data":"c2e268f052421dd363aace369f53fbe766c435c1d0d6bb21b3df2182c0585ae8"} Oct 29 23:13:29.994337 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:29.994246 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pqwqb" podStartSLOduration=2.372766623 podStartE2EDuration="4.994230694s" totalImagesPullingTime="2.621464071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:29.993414005 +0000 UTC m=+48.917634316" watchObservedRunningTime="2026-10-29 23:13:29.994230694 +0000 UTC m=+48.918451005" Oct 29 23:13:30.215047 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:30.215022 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7848849768-qnlvb"] Oct 29 23:13:30.216687 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:13:30.216663 2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c79a781_906d_4a89_9b9e_bbe8caf7ebbb.slice/crio-c32e3791a6cbd50c10c65b45d2e5731b965f8cd8f24e1057902c5f3061c2b1c9 WatchSource:0}: Error finding container c32e3791a6cbd50c10c65b45d2e5731b965f8cd8f24e1057902c5f3061c2b1c9: Status 404 returned error can't find the container with id c32e3791a6cbd50c10c65b45d2e5731b965f8cd8f24e1057902c5f3061c2b1c9 Oct 29 23:13:30.949099 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:30.949019 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7848849768-qnlvb" event={"ID":"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb","Type":"ContainerStarted","Data":"c32e3791a6cbd50c10c65b45d2e5731b965f8cd8f24e1057902c5f3061c2b1c9"} Oct 29 23:13:30.950739 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:30.950712 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" event={"ID":"78f5b80d-524a-4d8a-8290-8a6fd7d1faa5","Type":"ContainerStarted","Data":"08f03be92993e96659106a01d4640ce06d664cd856b5912eccfe2208c0441c72"} Oct 29 23:13:30.950860 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:30.950768 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" event={"ID":"78f5b80d-524a-4d8a-8290-8a6fd7d1faa5","Type":"ContainerStarted","Data":"22e516ed9accffe20278084e9d864b031c7e0d0400036b33e4b51e784de4e68a"} Oct 29 23:13:30.993678 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:30.993616 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" podStartSLOduration=1.928771222 podStartE2EDuration="2.993595636s" totalImagesPullingTime="1.064824414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:30.992386317 +0000 UTC m=+49.916606630" watchObservedRunningTime="2026-10-29 23:13:30.993595636 +0000 UTC m=+49.917815950" Oct 29 23:13:32.159937 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:32.159900 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sxpxx_0fc5618f-b30f-45ce-b070-beed0ecbbbd9/dns/0.log" Oct 29 23:13:32.360737 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:32.360711 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sxpxx_0fc5618f-b30f-45ce-b070-beed0ecbbbd9/kube-rbac-proxy/0.log" Oct 29 23:13:32.959596 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:32.959562 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k9bgk_c7491f84-75c3-4286-90f9-ec4314ac5bf9/dns-node-resolver/0.log" Oct 29 23:13:32.959777 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:32.959733 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7848849768-qnlvb" event={"ID":"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb","Type":"ContainerStarted","Data":"4af6fa9a3063fca68f0e64a5a64190b9e1cca1457d4d7d9b11bab9fa5370fc61"} Oct 29 23:13:33.009874 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.009806 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-7848849768-qnlvb" podStartSLOduration=1.4669140010000001 podStartE2EDuration="4.009791832s" totalImagesPullingTime="2.542877831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:33.009395725 +0000 UTC m=+51.933616054" watchObservedRunningTime="2026-10-29 23:13:33.009791832 +0000 UTC m=+51.934012202" Oct 29 23:13:33.480038 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.480004 2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pz649"] Oct 29 23:13:33.483601 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.483579 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.516844 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.516801 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 29 23:13:33.525222 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.525198 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 29 23:13:33.525315 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.525237 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vwjx7\"" Oct 29 23:13:33.525315 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.525293 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 29 23:13:33.567285 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.566600 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56b29c9c-9fc1-44be-834e-76724afbb2a6-sys\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.567285 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.566673 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-wtmp\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.567285 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.566729 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56b29c9c-9fc1-44be-834e-76724afbb2a6-metrics-client-ca\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.567285 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.566767 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.567285 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.566800 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.567285 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.566899 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h5kq\" (UniqueName: \"kubernetes.io/projected/56b29c9c-9fc1-44be-834e-76724afbb2a6-kube-api-access-7h5kq\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.567285 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.566946 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-tls\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.567285 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.567041 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56b29c9c-9fc1-44be-834e-76724afbb2a6-root\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.567285 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.567108 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-textfile\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.667973 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.667922 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56b29c9c-9fc1-44be-834e-76724afbb2a6-sys\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.667973 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.667984 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-wtmp\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.668232 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.668021 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56b29c9c-9fc1-44be-834e-76724afbb2a6-metrics-client-ca\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.668232 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.668043 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56b29c9c-9fc1-44be-834e-76724afbb2a6-sys\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.668232 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.668044 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.668232 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.668106 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.668232 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.668145 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h5kq\" (UniqueName: \"kubernetes.io/projected/56b29c9c-9fc1-44be-834e-76724afbb2a6-kube-api-access-7h5kq\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.668232 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.668181 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-tls\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.668232 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.668198 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-wtmp\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.668524 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.668348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56b29c9c-9fc1-44be-834e-76724afbb2a6-root\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.668524 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.668395 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-textfile\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.668524 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.668444 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56b29c9c-9fc1-44be-834e-76724afbb2a6-root\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.668723 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.668697 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56b29c9c-9fc1-44be-834e-76724afbb2a6-metrics-client-ca\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.668723 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.668716 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-textfile\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.668894 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.668733 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.670407 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.670385 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.670493 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.670470 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-tls\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.689564 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.689536 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h5kq\" (UniqueName: \"kubernetes.io/projected/56b29c9c-9fc1-44be-834e-76724afbb2a6-kube-api-access-7h5kq\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.798559 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.798523 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:33.813020 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:13:33.812990 2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56b29c9c_9fc1_44be_834e_76724afbb2a6.slice/crio-e8cb782e9c1be769d7148c5fbf674732f856c1c93ec4383ab35afe2299033f05 WatchSource:0}: Error finding container e8cb782e9c1be769d7148c5fbf674732f856c1c93ec4383ab35afe2299033f05: Status 404 returned error can't find the container with id e8cb782e9c1be769d7148c5fbf674732f856c1c93ec4383ab35afe2299033f05 Oct 29 23:13:33.960957 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.960930 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l59n4_ec3af7c3-d20a-499e-9cf7-c743da6b8ed1/node-ca/0.log" Oct 29 23:13:33.963482 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:33.963458 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pz649" event={"ID":"56b29c9c-9fc1-44be-834e-76724afbb2a6","Type":"ContainerStarted","Data":"e8cb782e9c1be769d7148c5fbf674732f856c1c93ec4383ab35afe2299033f05"} Oct 29 23:13:34.961835 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:34.961734 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pqwqb_14a7a4eb-db41-4943-a17f-6f2f02d55966/serve-healthcheck-canary/0.log" Oct 29 23:13:34.967959 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:34.967930 2581 generic.go:356] "Generic (PLEG): container finished" podID="56b29c9c-9fc1-44be-834e-76724afbb2a6" containerID="0a51bce31ead94584d7ca1d9f479f9491977cfdf301463e82de6d5dcf6f6cf73" exitCode=0 Oct 29 23:13:34.968113 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:34.967966 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pz649" event={"ID":"56b29c9c-9fc1-44be-834e-76724afbb2a6","Type":"ContainerDied","Data":"0a51bce31ead94584d7ca1d9f479f9491977cfdf301463e82de6d5dcf6f6cf73"} Oct 29 23:13:35.611649 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.611621 2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb"] Oct 29 23:13:35.615130 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.615114 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.635510 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.635487 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Oct 29 23:13:35.635863 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.635803 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Oct 29 23:13:35.635863 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.635840 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Oct 29 23:13:35.646237 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.646215 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Oct 29 23:13:35.646529 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.646500 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4i2ilsknuqmej\"" Oct 29 23:13:35.646638 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.646601 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Oct 29 23:13:35.646717 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.646697 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-tn89s\"" Oct 29 23:13:35.647851 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.647809 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb"] Oct 29 23:13:35.788739 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.788703 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-tls\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.788923 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.788746 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.788923 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.788767 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2187059-1391-4124-9981-0a203dfe8628-tmp\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.788923 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.788841 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.788923 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.788915 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.789063 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.788995 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-grpc-tls\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.789063 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.789021 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwwh4\" (UniqueName: \"kubernetes.io/projected/b2187059-1391-4124-9981-0a203dfe8628-kube-api-access-cwwh4\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.789122 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.789088 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2187059-1391-4124-9981-0a203dfe8628-metrics-client-ca\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.789122 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.789109 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.890121 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.890041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwwh4\" (UniqueName: \"kubernetes.io/projected/b2187059-1391-4124-9981-0a203dfe8628-kube-api-access-cwwh4\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.890121 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.890087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2187059-1391-4124-9981-0a203dfe8628-metrics-client-ca\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.890121 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.890109 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.890378 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.890144 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-tls\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.890378 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.890166 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.890378 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.890184 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2187059-1391-4124-9981-0a203dfe8628-tmp\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.890378 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.890209 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.890378 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.890234 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.890378 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.890269 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-grpc-tls\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.890801 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.890680 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2187059-1391-4124-9981-0a203dfe8628-tmp\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.891001 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.890953 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2187059-1391-4124-9981-0a203dfe8628-metrics-client-ca\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.892979 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.892950 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.893118 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.893096 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-grpc-tls\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.893203 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.893181 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-tls\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.893491 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.893459 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.893756 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.893734 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.893788 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.893739 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.929282 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.929244 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwwh4\" (UniqueName: \"kubernetes.io/projected/b2187059-1391-4124-9981-0a203dfe8628-kube-api-access-cwwh4\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.937954 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.937932 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:35.973897 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.972766 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pz649" event={"ID":"56b29c9c-9fc1-44be-834e-76724afbb2a6","Type":"ContainerStarted","Data":"4cb83bbe1ac8a03cbde6181e19e41e0c7887082e123620662a5294720d07dfcb"} Oct 29 23:13:35.973897 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:35.972854 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pz649" event={"ID":"56b29c9c-9fc1-44be-834e-76724afbb2a6","Type":"ContainerStarted","Data":"15e25bd163d9931214a2212c31df9ebb986059be07abc894dc3cda8745556704"} Oct 29 23:13:36.031331 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:36.031261 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pz649" podStartSLOduration=2.147342398 podStartE2EDuration="3.03124336s" totalImagesPullingTime="818.950928ms" totalInitContainerRuntime="64.950034ms" isStatefulPod=true podCreationTimestamp="2026-10-29 23:13:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:36.030557624 +0000 UTC m=+54.954777929" watchObservedRunningTime="2026-10-29 23:13:36.03124336 +0000 UTC m=+54.955463676" Oct 29 23:13:36.255058 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:36.255036 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb"] Oct 29 23:13:36.256752 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:13:36.256726 2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2187059_1391_4124_9981_0a203dfe8628.slice/crio-f97c977c720bad504712ebf34ec85e60e55e0d6cf9676c02b84e20d95f0e9c68 WatchSource:0}: Error finding container f97c977c720bad504712ebf34ec85e60e55e0d6cf9676c02b84e20d95f0e9c68: Status 404 returned error can't find the container with id f97c977c720bad504712ebf34ec85e60e55e0d6cf9676c02b84e20d95f0e9c68 Oct 29 23:13:36.977450 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:36.977418 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" event={"ID":"b2187059-1391-4124-9981-0a203dfe8628","Type":"ContainerStarted","Data":"f97c977c720bad504712ebf34ec85e60e55e0d6cf9676c02b84e20d95f0e9c68"} Oct 29 23:13:37.982240 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:37.982213 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" event={"ID":"b2187059-1391-4124-9981-0a203dfe8628","Type":"ContainerStarted","Data":"0cc86a57ad6f8d5b9582a249e3241172fbdb9a5afad80723b9c920654c73dba2"} Oct 29 23:13:38.008952 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.008927 2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-67998684c5-whnlb"] Oct 29 23:13:38.011902 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.011795 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:38.029613 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.029591 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-lzfjg\"" Oct 29 23:13:38.043169 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.043147 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Oct 29 23:13:38.043497 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.043475 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Oct 29 23:13:38.044538 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.043476 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Oct 29 23:13:38.044538 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.043537 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4i3e2rd218q0m\"" Oct 29 23:13:38.044538 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.043599 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Oct 29 23:13:38.045055 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.045030 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-67998684c5-whnlb"] Oct 29 23:13:38.112437 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.112397 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5a425c1c-3f2d-46ef-895e-0e19f7795633-secret-metrics-server-client-certs\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:38.112590 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.112446 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5a425c1c-3f2d-46ef-895e-0e19f7795633-audit-log\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:38.112688 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.112663 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5a425c1c-3f2d-46ef-895e-0e19f7795633-secret-metrics-server-tls\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:38.112732 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.112704 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5a425c1c-3f2d-46ef-895e-0e19f7795633-metrics-server-audit-profiles\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:38.112801 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.112772 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a425c1c-3f2d-46ef-895e-0e19f7795633-client-ca-bundle\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:38.112937 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.112916 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9rk6\" (UniqueName: \"kubernetes.io/projected/5a425c1c-3f2d-46ef-895e-0e19f7795633-kube-api-access-p9rk6\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:38.113013 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.112953 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a425c1c-3f2d-46ef-895e-0e19f7795633-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:38.213725 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.213623 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5a425c1c-3f2d-46ef-895e-0e19f7795633-audit-log\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:38.213889 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.213747 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5a425c1c-3f2d-46ef-895e-0e19f7795633-secret-metrics-server-tls\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:38.213889 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.213775 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5a425c1c-3f2d-46ef-895e-0e19f7795633-metrics-server-audit-profiles\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:38.213889 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.213801 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a425c1c-3f2d-46ef-895e-0e19f7795633-client-ca-bundle\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:38.214058 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.214032 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9rk6\" (UniqueName: \"kubernetes.io/projected/5a425c1c-3f2d-46ef-895e-0e19f7795633-kube-api-access-p9rk6\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:38.214120 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.214095 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5a425c1c-3f2d-46ef-895e-0e19f7795633-audit-log\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:38.214120 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.214101 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a425c1c-3f2d-46ef-895e-0e19f7795633-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:38.214217 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.214195 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5a425c1c-3f2d-46ef-895e-0e19f7795633-secret-metrics-server-client-certs\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:38.214628 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.214605 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a425c1c-3f2d-46ef-895e-0e19f7795633-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:38.214729 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.214647 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5a425c1c-3f2d-46ef-895e-0e19f7795633-metrics-server-audit-profiles\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:38.217072 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.217037 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5a425c1c-3f2d-46ef-895e-0e19f7795633-secret-metrics-server-tls\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:38.217193 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.217166 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5a425c1c-3f2d-46ef-895e-0e19f7795633-secret-metrics-server-client-certs\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:38.217349 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.217333 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a425c1c-3f2d-46ef-895e-0e19f7795633-client-ca-bundle\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:38.235617 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.235592 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9rk6\" (UniqueName: \"kubernetes.io/projected/5a425c1c-3f2d-46ef-895e-0e19f7795633-kube-api-access-p9rk6\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:38.255602 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.255573 2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-rpk9s"] Oct 29 23:13:38.259754 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.259738 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-rpk9s" Oct 29 23:13:38.279364 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.279162 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Oct 29 23:13:38.279364 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.279317 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-fqhm4\"" Oct 29 23:13:38.280360 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.280317 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-rpk9s"] Oct 29 23:13:38.325318 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.325290 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:38.416175 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.416144 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0234d968-7137-4520-8bd1-b26ee1f08885-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-rpk9s\" (UID: \"0234d968-7137-4520-8bd1-b26ee1f08885\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-rpk9s" Oct 29 23:13:38.416331 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.416190 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n6gc\" (UniqueName: \"kubernetes.io/projected/0234d968-7137-4520-8bd1-b26ee1f08885-kube-api-access-6n6gc\") pod \"monitoring-plugin-77f4f76594-rpk9s\" (UID: \"0234d968-7137-4520-8bd1-b26ee1f08885\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-rpk9s" Oct 29 23:13:38.517044 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.516999 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0234d968-7137-4520-8bd1-b26ee1f08885-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-rpk9s\" (UID: \"0234d968-7137-4520-8bd1-b26ee1f08885\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-rpk9s" Oct 29 23:13:38.517243 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.517086 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n6gc\" (UniqueName: \"kubernetes.io/projected/0234d968-7137-4520-8bd1-b26ee1f08885-kube-api-access-6n6gc\") pod \"monitoring-plugin-77f4f76594-rpk9s\" (UID: \"0234d968-7137-4520-8bd1-b26ee1f08885\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-rpk9s" Oct 29 23:13:38.519928 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.519902 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0234d968-7137-4520-8bd1-b26ee1f08885-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-rpk9s\" (UID: \"0234d968-7137-4520-8bd1-b26ee1f08885\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-rpk9s" Oct 29 23:13:38.537657 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.537615 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n6gc\" (UniqueName: \"kubernetes.io/projected/0234d968-7137-4520-8bd1-b26ee1f08885-kube-api-access-6n6gc\") pod \"monitoring-plugin-77f4f76594-rpk9s\" (UID: \"0234d968-7137-4520-8bd1-b26ee1f08885\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-rpk9s" Oct 29 23:13:38.571447 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.571415 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-rpk9s" Oct 29 23:13:38.633745 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.633707 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-67998684c5-whnlb"] Oct 29 23:13:38.704265 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.704235 2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-775f4c9db-dqrhs"] Oct 29 23:13:38.707351 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.707328 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.726984 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.726839 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Oct 29 23:13:38.726984 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.726857 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Oct 29 23:13:38.730654 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.729777 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Oct 29 23:13:38.730654 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.730490 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Oct 29 23:13:38.730936 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.730898 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-j6t55\"" Oct 29 23:13:38.731007 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.730920 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Oct 29 23:13:38.755537 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.755503 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\"" Oct 29 23:13:38.756456 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.756436 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-775f4c9db-dqrhs"] Oct 29 23:13:38.821063 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.821037 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzcq7\" (UniqueName: \"kubernetes.io/projected/d33591ce-f459-4bb1-8fa0-87c608b9616c-kube-api-access-nzcq7\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.821217 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.821108 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d33591ce-f459-4bb1-8fa0-87c608b9616c-serving-certs-ca-bundle\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.821261 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.821229 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-secret-telemeter-client\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.821302 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.821284 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-telemeter-client-tls\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.821378 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.821362 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-federate-client-tls\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.821414 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.821399 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d33591ce-f459-4bb1-8fa0-87c608b9616c-metrics-client-ca\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.821453 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.821433 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.821506 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.821489 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d33591ce-f459-4bb1-8fa0-87c608b9616c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.869166 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.869137 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-rpk9s"] Oct 29 23:13:38.870618 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:13:38.870598 2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0234d968_7137_4520_8bd1_b26ee1f08885.slice/crio-5f7f2c19f4a6bf8b04fc3e695f3af25c5d392989858cc60057e43de8d3a55eef WatchSource:0}: Error finding container 5f7f2c19f4a6bf8b04fc3e695f3af25c5d392989858cc60057e43de8d3a55eef: Status 404 returned error can't find the container with id 5f7f2c19f4a6bf8b04fc3e695f3af25c5d392989858cc60057e43de8d3a55eef Oct 29 23:13:38.922423 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.922384 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzcq7\" (UniqueName: \"kubernetes.io/projected/d33591ce-f459-4bb1-8fa0-87c608b9616c-kube-api-access-nzcq7\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.922609 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.922582 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d33591ce-f459-4bb1-8fa0-87c608b9616c-serving-certs-ca-bundle\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.922683 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.922656 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-secret-telemeter-client\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.922736 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.922702 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-telemeter-client-tls\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.922788 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.922752 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-federate-client-tls\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.922788 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.922775 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d33591ce-f459-4bb1-8fa0-87c608b9616c-metrics-client-ca\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.922916 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.922810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.922916 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.922870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d33591ce-f459-4bb1-8fa0-87c608b9616c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.923387 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.923362 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d33591ce-f459-4bb1-8fa0-87c608b9616c-serving-certs-ca-bundle\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.923616 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.923592 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d33591ce-f459-4bb1-8fa0-87c608b9616c-metrics-client-ca\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.924092 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.924064 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d33591ce-f459-4bb1-8fa0-87c608b9616c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.925496 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.925463 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-telemeter-client-tls\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.926081 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.926060 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.926217 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.926196 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-federate-client-tls\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.926466 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.926446 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-secret-telemeter-client\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.943860 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.943804 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzcq7\" (UniqueName: \"kubernetes.io/projected/d33591ce-f459-4bb1-8fa0-87c608b9616c-kube-api-access-nzcq7\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:38.946368 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.946344 2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:38.989221 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.989180 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" event={"ID":"b2187059-1391-4124-9981-0a203dfe8628","Type":"ContainerStarted","Data":"b0f033036c536795616d0e768f376619f536b2c0b2240652cb2ba2adbe105aba"} Oct 29 23:13:38.989706 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.989266 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" event={"ID":"b2187059-1391-4124-9981-0a203dfe8628","Type":"ContainerStarted","Data":"512128cb2f070f4f7e41781f5bb509ba79db3af23722bfadbf25b01f5ef60d63"} Oct 29 23:13:38.989706 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.989302 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" event={"ID":"b2187059-1391-4124-9981-0a203dfe8628","Type":"ContainerStarted","Data":"1cd5903aa4290691959349a2114e752e25b13fbbe8b23a779772aca1dd9acce2"} Oct 29 23:13:38.989706 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.989347 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" event={"ID":"b2187059-1391-4124-9981-0a203dfe8628","Type":"ContainerStarted","Data":"58f280409cd3c96219a061fe75f3664996889b8e0bf4b20e71f7b6e1110c5160"} Oct 29 23:13:38.989706 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.989392 2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:38.989706 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.989423 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" event={"ID":"b2187059-1391-4124-9981-0a203dfe8628","Type":"ContainerStarted","Data":"f70cca678a0f1d3989ab1199b851637b363220e9dcccb7b23ffb31bdd42c46c7"} Oct 29 23:13:38.990841 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.990801 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-67998684c5-whnlb" event={"ID":"5a425c1c-3f2d-46ef-895e-0e19f7795633","Type":"ContainerStarted","Data":"8d4e3cd859ccc6f561fb644dc0678fd98627b5683ebe29bafe80e2815d69179c"} Oct 29 23:13:38.991915 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:38.991893 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-rpk9s" event={"ID":"0234d968-7137-4520-8bd1-b26ee1f08885","Type":"ContainerStarted","Data":"5f7f2c19f4a6bf8b04fc3e695f3af25c5d392989858cc60057e43de8d3a55eef"} Oct 29 23:13:39.024205 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:39.024131 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:39.358380 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:39.358285 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" podStartSLOduration=2.068205991 podStartE2EDuration="4.358264162s" totalImagesPullingTime="2.290058171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:39.037444055 +0000 UTC m=+57.961664368" watchObservedRunningTime="2026-10-29 23:13:39.358264162 +0000 UTC m=+58.282484473" Oct 29 23:13:39.359153 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:39.359056 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-775f4c9db-dqrhs"] Oct 29 23:13:39.361389 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:13:39.361352 2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd33591ce_f459_4bb1_8fa0_87c608b9616c.slice/crio-e8fa71fef1d47c18629d5800716ba24d09d5b7e662016c2da87ab90415c25951 WatchSource:0}: Error finding container e8fa71fef1d47c18629d5800716ba24d09d5b7e662016c2da87ab90415c25951: Status 404 returned error can't find the container with id e8fa71fef1d47c18629d5800716ba24d09d5b7e662016c2da87ab90415c25951 Oct 29 23:13:39.892904 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:39.892792 2581 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:39.893218 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:39.893194 2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:39.899052 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:39.899017 2581 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:40.000642 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:40.000592 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" event={"ID":"d33591ce-f459-4bb1-8fa0-87c608b9616c","Type":"ContainerStarted","Data":"e8fa71fef1d47c18629d5800716ba24d09d5b7e662016c2da87ab90415c25951"} Oct 29 23:13:40.005680 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:40.005654 2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:41.005475 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:41.005439 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-rpk9s" event={"ID":"0234d968-7137-4520-8bd1-b26ee1f08885","Type":"ContainerStarted","Data":"39a5875256e1e43ea308f50c873e3e1319c398fe617101e34bac4226491ba1b3"} Oct 29 23:13:41.005934 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:41.005541 2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-rpk9s" Oct 29 23:13:41.008001 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:41.007976 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-67998684c5-whnlb" event={"ID":"5a425c1c-3f2d-46ef-895e-0e19f7795633","Type":"ContainerStarted","Data":"adebdac9baf101daa74eb26e30800ad5c39b311846ee514c9ed0e5dd29634f48"} Oct 29 23:13:41.010860 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:41.010835 2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-rpk9s" Oct 29 23:13:41.052862 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:41.052230 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-rpk9s" podStartSLOduration=1.683588006 podStartE2EDuration="3.052212855s" totalImagesPullingTime="1.368624849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:41.051993135 +0000 UTC m=+59.976213472" watchObservedRunningTime="2026-10-29 23:13:41.052212855 +0000 UTC m=+59.976433164" Oct 29 23:13:41.140054 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:41.139980 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-67998684c5-whnlb" podStartSLOduration=2.730888401 podStartE2EDuration="4.139960226s" totalImagesPullingTime="1.409071825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:41.139279093 +0000 UTC m=+60.063499405" watchObservedRunningTime="2026-10-29 23:13:41.139960226 +0000 UTC m=+60.064180539" Oct 29 23:13:42.012829 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:42.012787 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" event={"ID":"d33591ce-f459-4bb1-8fa0-87c608b9616c","Type":"ContainerStarted","Data":"754c645f2ffac1f5246e5c407ba17df37e3bcea9a6b474d5e35d35d9cdf4e3ba"} Oct 29 23:13:42.013244 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:42.012880 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" event={"ID":"d33591ce-f459-4bb1-8fa0-87c608b9616c","Type":"ContainerStarted","Data":"1c4dfc5ab0bd100446dd3d0f66a20467c85bcf95f7419aaf8c0fb3b22351961c"} Oct 29 23:13:42.013244 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:42.012913 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" event={"ID":"d33591ce-f459-4bb1-8fa0-87c608b9616c","Type":"ContainerStarted","Data":"d5df9c9c8876455ffefb75baeb5250b7d34c674f63aaaa147be506bab33369fb"} Oct 29 23:13:43.091931 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:43.091878 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" podStartSLOduration=2.628673321 podStartE2EDuration="5.09186484s" totalImagesPullingTime="2.463191519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:43.081615858 +0000 UTC m=+62.005836187" watchObservedRunningTime="2026-10-29 23:13:43.09186484 +0000 UTC m=+62.016085152" Oct 29 23:13:45.008907 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:45.008880 2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:47.055373 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.055338 2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-68bc6cfb6b-tw8lp"] Oct 29 23:13:47.058334 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.058315 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.085282 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.085252 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68bc6cfb6b-tw8lp"] Oct 29 23:13:47.103743 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.103715 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-service-ca\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.103920 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.103756 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4962406a-baa9-420f-8069-98171dc6bd1d-tmp\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.103920 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.103780 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-oauth-serving-cert\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.103920 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.103902 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4962406a-baa9-420f-8069-98171dc6bd1d-console-serving-cert\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.104055 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.103936 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-trusted-ca-bundle\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.104055 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.103964 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4962406a-baa9-420f-8069-98171dc6bd1d-console-oauth-config\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.104146 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.104123 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-console-config\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.104179 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.104171 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nfbj\" (UniqueName: \"kubernetes.io/projected/4962406a-baa9-420f-8069-98171dc6bd1d-kube-api-access-4nfbj\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.118503 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.118472 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Oct 29 23:13:47.205450 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.205411 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-console-config\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.205639 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.205463 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nfbj\" (UniqueName: \"kubernetes.io/projected/4962406a-baa9-420f-8069-98171dc6bd1d-kube-api-access-4nfbj\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.205639 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.205502 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-service-ca\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.205639 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.205526 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4962406a-baa9-420f-8069-98171dc6bd1d-tmp\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.205639 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.205542 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-oauth-serving-cert\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.205639 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.205569 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4962406a-baa9-420f-8069-98171dc6bd1d-console-serving-cert\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.205639 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.205590 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-trusted-ca-bundle\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.205639 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.205613 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4962406a-baa9-420f-8069-98171dc6bd1d-console-oauth-config\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.206281 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.206248 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4962406a-baa9-420f-8069-98171dc6bd1d-tmp\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.206412 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.206356 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-console-config\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.206412 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.206370 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-service-ca\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.206412 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.206370 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-oauth-serving-cert\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.206557 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.206519 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-trusted-ca-bundle\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.208148 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.208121 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4962406a-baa9-420f-8069-98171dc6bd1d-console-oauth-config\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.208253 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.208233 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4962406a-baa9-420f-8069-98171dc6bd1d-console-serving-cert\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.227743 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.227720 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nfbj\" (UniqueName: \"kubernetes.io/projected/4962406a-baa9-420f-8069-98171dc6bd1d-kube-api-access-4nfbj\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.369037 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.368955 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:47.407782 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.407746 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs\") pod \"network-metrics-daemon-l78hj\" (UID: \"480d690f-601d-4d63-aaf7-3717d5758230\") " pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:13:47.407970 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.407841 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:47.424034 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.423998 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 29 23:13:47.424195 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.424179 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 29 23:13:47.431406 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.431341 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:47.432227 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.431860 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs\") pod \"network-metrics-daemon-l78hj\" (UID: \"480d690f-601d-4d63-aaf7-3717d5758230\") " pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:13:47.508400 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.508358 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75sml\" (UniqueName: \"kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml\") pod \"network-check-target-xnlbj\" (UID: \"f1cc6108-50e3-4a4d-855e-c4884e581e2e\") " pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:13:47.523767 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.523738 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 29 23:13:47.544227 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.544199 2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 29 23:13:47.551590 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.551571 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75sml\" (UniqueName: \"kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml\") pod \"network-check-target-xnlbj\" (UID: \"f1cc6108-50e3-4a4d-855e-c4884e581e2e\") " pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:13:47.667687 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.667662 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68bc6cfb6b-tw8lp"] Oct 29 23:13:47.671014 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:13:47.670982 2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4962406a_baa9_420f_8069_98171dc6bd1d.slice/crio-2985ea8f11c7ddad9d09de957a0c93aa4e1ea269c6f72a5b41ce66849eb8f412 WatchSource:0}: Error finding container 2985ea8f11c7ddad9d09de957a0c93aa4e1ea269c6f72a5b41ce66849eb8f412: Status 404 returned error can't find the container with id 2985ea8f11c7ddad9d09de957a0c93aa4e1ea269c6f72a5b41ce66849eb8f412 Oct 29 23:13:47.731207 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.731185 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-89z4k\"" Oct 29 23:13:47.736490 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.736431 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:47.744287 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.744258 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2vcdm\"" Oct 29 23:13:47.748592 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.748570 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:13:47.748756 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.748731 2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-phkn8\"" Oct 29 23:13:47.752724 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:47.752705 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:13:48.036599 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:48.036564 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68bc6cfb6b-tw8lp" event={"ID":"4962406a-baa9-420f-8069-98171dc6bd1d","Type":"ContainerStarted","Data":"7c8395d795ff11b3126034c4d14074adf4d1c2619ada0ebc56a38b0eb804d2a5"} Oct 29 23:13:48.036766 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:48.036632 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68bc6cfb6b-tw8lp" event={"ID":"4962406a-baa9-420f-8069-98171dc6bd1d","Type":"ContainerStarted","Data":"2985ea8f11c7ddad9d09de957a0c93aa4e1ea269c6f72a5b41ce66849eb8f412"} Oct 29 23:13:48.053412 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:48.053390 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4ctmg"] Oct 29 23:13:48.054329 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:13:48.054307 2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7add189_cde4_470f_a543_4dc4a91be859.slice/crio-697d9bfb63032b9f5833cfe4f2efa4b518fedccc7940e59fcb50be042efd75e9 WatchSource:0}: Error finding container 697d9bfb63032b9f5833cfe4f2efa4b518fedccc7940e59fcb50be042efd75e9: Status 404 returned error can't find the container with id 697d9bfb63032b9f5833cfe4f2efa4b518fedccc7940e59fcb50be042efd75e9 Oct 29 23:13:48.062637 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:48.062612 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xnlbj"] Oct 29 23:13:48.063021 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:13:48.062762 2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1cc6108_50e3_4a4d_855e_c4884e581e2e.slice/crio-b95b006a3bb7b3a4fcf12694a7d28e921d90d4026201db3192f5a0c086834ade WatchSource:0}: Error finding container b95b006a3bb7b3a4fcf12694a7d28e921d90d4026201db3192f5a0c086834ade: Status 404 returned error can't find the container with id b95b006a3bb7b3a4fcf12694a7d28e921d90d4026201db3192f5a0c086834ade Oct 29 23:13:48.078070 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:48.078046 2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l78hj"] Oct 29 23:13:48.079275 ip-10-0-138-163 kubenswrapper[2581]: W1029 23:13:48.079248 2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod480d690f_601d_4d63_aaf7_3717d5758230.slice/crio-d708070e660da5e74974bb624ed25191154c10464134973b85d7d0fe759b9ba4 WatchSource:0}: Error finding container d708070e660da5e74974bb624ed25191154c10464134973b85d7d0fe759b9ba4: Status 404 returned error can't find the container with id d708070e660da5e74974bb624ed25191154c10464134973b85d7d0fe759b9ba4 Oct 29 23:13:48.084280 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:48.084240 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-68bc6cfb6b-tw8lp" podStartSLOduration=1.084226308 podStartE2EDuration="1.084226308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:48.082987714 +0000 UTC m=+67.007208027" watchObservedRunningTime="2026-10-29 23:13:48.084226308 +0000 UTC m=+67.008446618" Oct 29 23:13:49.042680 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:49.042636 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xnlbj" event={"ID":"f1cc6108-50e3-4a4d-855e-c4884e581e2e","Type":"ContainerStarted","Data":"b95b006a3bb7b3a4fcf12694a7d28e921d90d4026201db3192f5a0c086834ade"} Oct 29 23:13:49.045985 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:49.045918 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l78hj" event={"ID":"480d690f-601d-4d63-aaf7-3717d5758230","Type":"ContainerStarted","Data":"d708070e660da5e74974bb624ed25191154c10464134973b85d7d0fe759b9ba4"} Oct 29 23:13:49.047663 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:49.047621 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4ctmg" event={"ID":"f7add189-cde4-470f-a543-4dc4a91be859","Type":"ContainerStarted","Data":"697d9bfb63032b9f5833cfe4f2efa4b518fedccc7940e59fcb50be042efd75e9"} Oct 29 23:13:50.054511 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:50.054470 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l78hj" event={"ID":"480d690f-601d-4d63-aaf7-3717d5758230","Type":"ContainerStarted","Data":"cf1928379e1a4ae732d3bfb4f44c913e64c33910dcea57a56908ea3466f2174e"} Oct 29 23:13:50.055004 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:50.054538 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l78hj" event={"ID":"480d690f-601d-4d63-aaf7-3717d5758230","Type":"ContainerStarted","Data":"24469fbda6e072d7d0b5f7144a24736b8966fb4e0e5a7948a3b94c3a75322be0"} Oct 29 23:13:52.064438 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:52.064394 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xnlbj" event={"ID":"f1cc6108-50e3-4a4d-855e-c4884e581e2e","Type":"ContainerStarted","Data":"f6b901cf7694d6f94dd6fdf2d7591a395bd41423250c43521ae23e93fdba5953"} Oct 29 23:13:52.065238 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:52.065218 2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:13:52.109129 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:52.109069 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l78hj" podStartSLOduration=68.888033028 podStartE2EDuration="1m10.109049875s" totalImagesPullingTime="1.221016847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:50.104350833 +0000 UTC m=+69.028571141" watchObservedRunningTime="2026-10-29 23:13:52.109049875 +0000 UTC m=+71.033270292" Oct 29 23:13:52.109304 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:52.109176 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xnlbj" podStartSLOduration=66.569232741 podStartE2EDuration="1m10.109168056s" totalImagesPullingTime="3.539935315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:52.108632414 +0000 UTC m=+71.032852726" watchObservedRunningTime="2026-10-29 23:13:52.109168056 +0000 UTC m=+71.033388367" Oct 29 23:13:53.070181 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:53.070149 2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4ctmg" event={"ID":"f7add189-cde4-470f-a543-4dc4a91be859","Type":"ContainerStarted","Data":"04511a191a1e318fbb6323c615be3db82177fca52852342f0aa8de463a7cad51"} Oct 29 23:13:53.111946 ip-10-0-138-163 kubenswrapper[2581]: I1029 23:13:53.111883 2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4ctmg" podStartSLOduration=66.220846623 podStartE2EDuration="1m11.111867727s" totalImagesPullingTime="4.891021104s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:53.111611102 +0000 UTC m=+72.035831413" watchObservedRunningTime="2026-10-29 23:13:53.111867727 +0000 UTC m=+72.036088039" Oct 29 23:13:53.199418 ip-10-0-138-163 systemd[1]: Stopping Kubernetes Kubelet... Oct 29 23:13:53.216409 ip-10-0-138-163 systemd[1]: kubelet.service: Deactivated successfully. Oct 29 23:13:53.216676 ip-10-0-138-163 systemd[1]: Stopped Kubernetes Kubelet. Oct 29 23:13:53.216748 ip-10-0-138-163 systemd[1]: kubelet.service: Consumed 4.197s CPU time. Oct 29 23:13:53.230428 ip-10-0-138-163 systemd[1]: Starting Kubernetes Kubelet... Oct 29 23:13:53.304584 ip-10-0-138-163 kubenswrapper[6029]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 29 23:13:53.304584 ip-10-0-138-163 kubenswrapper[6029]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 29 23:13:53.304584 ip-10-0-138-163 kubenswrapper[6029]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 29 23:13:53.304584 ip-10-0-138-163 kubenswrapper[6029]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 29 23:13:53.306632 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306548 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:13:53.306632 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306631 6029 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:13:53.306632 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306635 6029 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:13:53.306744 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306639 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:13:53.306744 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306642 6029 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:13:53.306744 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306646 6029 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:13:53.306744 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306648 6029 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:13:53.306744 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306651 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:13:53.306744 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306654 6029 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:13:53.306744 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306657 6029 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:13:53.306744 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306660 6029 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:13:53.306744 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306663 6029 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:13:53.306744 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306665 6029 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:13:53.306744 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306668 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:13:53.306744 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306671 6029 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:13:53.306744 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306673 6029 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:13:53.306744 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306676 6029 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:13:53.306744 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306679 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:13:53.306744 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306681 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:13:53.306744 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306684 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:13:53.306744 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306686 6029 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:13:53.306744 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306689 6029 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:13:53.306744 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306691 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:13:53.307287 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306694 6029 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:13:53.307287 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306696 6029 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:13:53.307287 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306700 6029 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:13:53.307287 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306703 6029 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:13:53.307287 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306718 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:13:53.307287 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306721 6029 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:13:53.307287 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306724 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:13:53.307287 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306727 6029 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:13:53.307287 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306731 6029 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:13:53.307287 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306735 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:13:53.307287 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306738 6029 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:13:53.307287 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306741 6029 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:13:53.307287 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306744 6029 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:13:53.307287 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306747 6029 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:13:53.307287 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306750 6029 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:13:53.307287 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306755 6029 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:13:53.307287 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306759 6029 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:13:53.307287 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306762 6029 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:13:53.307287 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306766 6029 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:13:53.307755 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306768 6029 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:13:53.307755 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306771 6029 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:13:53.307755 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306773 6029 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:13:53.307755 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306776 6029 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:13:53.307755 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306779 6029 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:13:53.307755 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306782 6029 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:13:53.307755 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306785 6029 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:13:53.307755 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306788 6029 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:13:53.307755 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306790 6029 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:13:53.307755 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306793 6029 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:13:53.307755 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306796 6029 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:13:53.307755 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306798 6029 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:13:53.307755 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306800 6029 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:13:53.307755 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306809 6029 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:13:53.307755 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306826 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:13:53.307755 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306831 6029 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:13:53.307755 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306834 6029 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:13:53.307755 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306837 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:13:53.307755 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306840 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:13:53.307755 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306843 6029 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:13:53.308270 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306846 6029 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:13:53.308270 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306848 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:13:53.308270 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306851 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:13:53.308270 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306854 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:13:53.308270 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306857 6029 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:13:53.308270 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306860 6029 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:13:53.308270 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306863 6029 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:13:53.308270 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306865 6029 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:13:53.308270 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306868 6029 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:13:53.308270 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306870 6029 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:13:53.308270 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306874 6029 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:13:53.308270 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306877 6029 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:13:53.308270 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306880 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:13:53.308270 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306882 6029 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:13:53.308270 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306885 6029 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:13:53.308270 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306887 6029 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:13:53.308270 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306890 6029 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:13:53.308270 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306894 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:13:53.308270 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306896 6029 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:13:53.308742 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306899 6029 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:13:53.308742 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306901 6029 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:13:53.308742 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306904 6029 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:13:53.308742 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306906 6029 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:13:53.308742 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306909 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:13:53.308742 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306911 6029 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:13:53.308742 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306916 6029 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:13:53.308742 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306919 6029 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:13:53.308742 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306922 6029 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:13:53.308742 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306924 6029 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:13:53.308742 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306927 6029 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:13:53.308742 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306930 6029 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:13:53.308742 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306933 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:13:53.308742 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306936 6029 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:13:53.308742 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306939 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:13:53.308742 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306942 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:13:53.308742 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306944 6029 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:13:53.308742 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306947 6029 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:13:53.308742 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306951 6029 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:13:53.309222 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306954 6029 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:13:53.309222 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306956 6029 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:13:53.309222 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306959 6029 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:13:53.309222 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306961 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:13:53.309222 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306964 6029 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:13:53.309222 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.306966 6029 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:13:53.309222 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307753 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:13:53.309222 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307761 6029 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:13:53.309222 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307764 6029 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:13:53.309222 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307767 6029 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:13:53.309222 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307770 6029 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:13:53.309222 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307773 6029 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:13:53.309222 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307777 6029 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:13:53.309222 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307779 6029 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:13:53.309222 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307782 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:13:53.309222 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307785 6029 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:13:53.309222 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307788 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:13:53.309222 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307790 6029 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:13:53.309222 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307795 6029 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:13:53.309686 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307802 6029 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:13:53.309686 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307805 6029 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:13:53.309686 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307808 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:13:53.309686 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307830 6029 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:13:53.309686 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307834 6029 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:13:53.309686 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307837 6029 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:13:53.309686 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307839 6029 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:13:53.309686 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307842 6029 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:13:53.309686 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307844 6029 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:13:53.309686 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307848 6029 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:13:53.309686 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307850 6029 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:13:53.309686 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307853 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:13:53.309686 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307856 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:13:53.309686 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307858 6029 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:13:53.309686 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307861 6029 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:13:53.309686 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307864 6029 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:13:53.309686 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307866 6029 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:13:53.309686 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307869 6029 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:13:53.309686 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307871 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:13:53.310170 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307874 6029 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:13:53.310170 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307876 6029 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:13:53.310170 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307879 6029 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:13:53.310170 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307888 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:13:53.310170 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307891 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:13:53.310170 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307894 6029 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:13:53.310170 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307897 6029 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:13:53.310170 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307900 6029 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:13:53.310170 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307903 6029 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:13:53.310170 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307906 6029 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:13:53.310170 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307908 6029 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:13:53.310170 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307911 6029 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:13:53.310170 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307913 6029 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:13:53.310170 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307918 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:13:53.310170 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307920 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:13:53.310170 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307923 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:13:53.310170 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307926 6029 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:13:53.310170 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307930 6029 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:13:53.310170 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307933 6029 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:13:53.310641 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307936 6029 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:13:53.310641 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307939 6029 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:13:53.310641 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307941 6029 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:13:53.310641 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307944 6029 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:13:53.310641 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307947 6029 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:13:53.310641 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307949 6029 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:13:53.310641 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307952 6029 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:13:53.310641 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307955 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:13:53.310641 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307957 6029 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:13:53.310641 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307960 6029 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:13:53.310641 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307962 6029 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:13:53.310641 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307965 6029 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:13:53.310641 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307967 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:13:53.310641 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307970 6029 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:13:53.310641 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307972 6029 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:13:53.310641 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307975 6029 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:13:53.310641 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307979 6029 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:13:53.310641 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307982 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:13:53.310641 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307984 6029 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:13:53.310641 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307987 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:13:53.311141 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307990 6029 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:13:53.311141 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307993 6029 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:13:53.311141 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307995 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:13:53.311141 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.307998 6029 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:13:53.311141 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308000 6029 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:13:53.311141 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308003 6029 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:13:53.311141 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308007 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:13:53.311141 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308009 6029 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:13:53.311141 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308012 6029 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:13:53.311141 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308014 6029 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:13:53.311141 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308017 6029 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:13:53.311141 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308020 6029 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:13:53.311141 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308022 6029 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:13:53.311141 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308025 6029 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:13:53.311141 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308027 6029 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:13:53.311141 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308030 6029 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:13:53.311141 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308032 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:13:53.311141 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308035 6029 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:13:53.311141 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308038 6029 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:13:53.311141 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308040 6029 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:13:53.311654 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308043 6029 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:13:53.311654 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308046 6029 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:13:53.311654 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308058 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:13:53.311654 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308061 6029 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:13:53.311654 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308064 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:13:53.311654 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308066 6029 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:13:53.311654 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308069 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:13:53.311654 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308072 6029 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:13:53.311654 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308076 6029 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:13:53.311654 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308079 6029 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:13:53.311654 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308081 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:13:53.311654 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308086 6029 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:13:53.311654 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308089 6029 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:13:53.311654 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308091 6029 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:13:53.311654 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308094 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:13:53.311654 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308578 6029 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:13:53.311654 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308583 6029 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:13:53.311654 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308587 6029 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:13:53.311654 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308592 6029 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:13:53.311654 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308594 6029 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:13:53.312165 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308597 6029 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:13:53.312165 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308600 6029 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:13:53.312165 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308602 6029 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:13:53.312165 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308605 6029 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:13:53.312165 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308608 6029 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:13:53.312165 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308611 6029 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:13:53.312165 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308613 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:13:53.312165 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308616 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:13:53.312165 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308618 6029 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:13:53.312165 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308621 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:13:53.312165 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308623 6029 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:13:53.312165 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308626 6029 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:13:53.312165 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308629 6029 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:13:53.312165 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308632 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:13:53.312165 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308634 6029 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:13:53.312165 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308637 6029 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:13:53.312165 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308639 6029 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:13:53.312165 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308642 6029 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:13:53.312165 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308645 6029 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:13:53.312636 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308647 6029 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:13:53.312636 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308651 6029 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:13:53.312636 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308654 6029 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:13:53.312636 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308656 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:13:53.312636 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308659 6029 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:13:53.312636 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308662 6029 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:13:53.312636 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308664 6029 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:13:53.312636 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308667 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:13:53.312636 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308670 6029 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:13:53.312636 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308673 6029 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:13:53.312636 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308675 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:13:53.312636 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308679 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:13:53.312636 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308682 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:13:53.312636 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308685 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:13:53.312636 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308687 6029 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:13:53.312636 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308690 6029 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:13:53.312636 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308692 6029 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:13:53.312636 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308696 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:13:53.312636 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308698 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:13:53.313352 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308701 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:13:53.313352 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308703 6029 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:13:53.313352 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308706 6029 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:13:53.313352 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308709 6029 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:13:53.313352 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308711 6029 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:13:53.313352 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308714 6029 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:13:53.313352 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308716 6029 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:13:53.313352 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308719 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:13:53.313352 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308721 6029 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:13:53.313352 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308724 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:13:53.313352 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308726 6029 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:13:53.313352 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308729 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:13:53.313352 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308732 6029 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:13:53.313352 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308734 6029 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:13:53.313352 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308738 6029 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:13:53.313352 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308740 6029 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:13:53.313352 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308743 6029 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:13:53.313352 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308746 6029 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:13:53.313352 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308749 6029 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:13:53.313352 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308751 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:13:53.314037 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308754 6029 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:13:53.314037 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308757 6029 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:13:53.314037 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308760 6029 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:13:53.314037 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308763 6029 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:13:53.314037 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308766 6029 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:13:53.314037 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308769 6029 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:13:53.314037 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308772 6029 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:13:53.314037 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308774 6029 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:13:53.314037 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308777 6029 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:13:53.314037 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308779 6029 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:13:53.314037 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308782 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:13:53.314037 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308784 6029 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:13:53.314037 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308787 6029 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:13:53.314037 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308789 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:13:53.314037 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308792 6029 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:13:53.314037 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308794 6029 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:13:53.314037 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308796 6029 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:13:53.314037 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308799 6029 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:13:53.314037 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308802 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:13:53.314037 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308804 6029 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:13:53.314705 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308807 6029 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:13:53.314705 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308809 6029 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:13:53.314705 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308826 6029 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:13:53.314705 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308829 6029 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:13:53.314705 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308833 6029 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:13:53.314705 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308837 6029 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:13:53.314705 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308840 6029 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:13:53.314705 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308843 6029 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:13:53.314705 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308846 6029 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:13:53.314705 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308849 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:13:53.314705 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308851 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:13:53.314705 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308854 6029 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:13:53.314705 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308856 6029 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:13:53.314705 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308859 6029 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:13:53.314705 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308862 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:13:53.314705 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308868 6029 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:13:53.314705 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308874 6029 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:13:53.314705 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308877 6029 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:13:53.314705 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308879 6029 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308882 6029 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308884 6029 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308887 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.308889 6029 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.308980 6029 flags.go:64] FLAG: --address="0.0.0.0" Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.308992 6029 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.308998 6029 flags.go:64] FLAG: --anonymous-auth="true" Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309002 6029 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309007 6029 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309010 6029 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309015 6029 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309019 6029 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309022 6029 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309025 6029 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309029 6029 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309032 6029 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309035 6029 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309038 6029 flags.go:64] FLAG: --cgroup-root="" Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309040 6029 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309044 6029 flags.go:64] FLAG: --client-ca-file="" Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309047 6029 flags.go:64] FLAG: --cloud-provider="external" Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309050 6029 flags.go:64] FLAG: --cluster-dns="[]" Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309054 6029 flags.go:64] FLAG: --cluster-domain="" Oct 29 23:13:53.315250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309057 6029 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309060 6029 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309063 6029 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309066 6029 flags.go:64] FLAG: --container-log-max-files="5" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309070 6029 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309074 6029 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309079 6029 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309083 6029 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309086 6029 flags.go:64] FLAG: --contention-profiling="false" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309089 6029 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309092 6029 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309095 6029 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309098 6029 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309103 6029 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309106 6029 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309109 6029 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309112 6029 flags.go:64] FLAG: --enable-load-reader="false" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309115 6029 flags.go:64] FLAG: --enable-server="true" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309118 6029 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309122 6029 flags.go:64] FLAG: --event-burst="100" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309126 6029 flags.go:64] FLAG: --event-qps="50" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309129 6029 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309132 6029 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309135 6029 flags.go:64] FLAG: --eviction-hard="" Oct 29 23:13:53.315836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309139 6029 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309142 6029 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309145 6029 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309148 6029 flags.go:64] FLAG: --eviction-soft="" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309151 6029 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309154 6029 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309157 6029 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309160 6029 flags.go:64] FLAG: --experimental-mounter-path="" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309163 6029 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309166 6029 flags.go:64] FLAG: --fail-swap-on="true" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309169 6029 flags.go:64] FLAG: --feature-gates="" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309173 6029 flags.go:64] FLAG: --file-check-frequency="20s" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309177 6029 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309180 6029 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309185 6029 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309189 6029 flags.go:64] FLAG: --healthz-port="10248" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309192 6029 flags.go:64] FLAG: --help="false" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309195 6029 flags.go:64] FLAG: --hostname-override="ip-10-0-138-163.ec2.internal" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309198 6029 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309201 6029 flags.go:64] FLAG: --http-check-frequency="20s" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309204 6029 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309208 6029 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309211 6029 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309214 6029 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 29 23:13:53.316449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309217 6029 flags.go:64] FLAG: --image-service-endpoint="" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309220 6029 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309223 6029 flags.go:64] FLAG: --kube-api-burst="100" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309226 6029 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309229 6029 flags.go:64] FLAG: --kube-api-qps="50" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309232 6029 flags.go:64] FLAG: --kube-reserved="" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309235 6029 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309239 6029 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309242 6029 flags.go:64] FLAG: --kubelet-cgroups="" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309245 6029 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309248 6029 flags.go:64] FLAG: --lock-file="" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309251 6029 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309254 6029 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309257 6029 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309267 6029 flags.go:64] FLAG: --log-json-split-stream="false" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309269 6029 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309273 6029 flags.go:64] FLAG: --log-text-split-stream="false" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309276 6029 flags.go:64] FLAG: --logging-format="text" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309279 6029 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309282 6029 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309285 6029 flags.go:64] FLAG: --manifest-url="" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309287 6029 flags.go:64] FLAG: --manifest-url-header="" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309293 6029 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309297 6029 flags.go:64] FLAG: --max-open-files="1000000" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309305 6029 flags.go:64] FLAG: --max-pods="110" Oct 29 23:13:53.317056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309308 6029 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309311 6029 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309313 6029 flags.go:64] FLAG: --memory-manager-policy="None" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309316 6029 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309319 6029 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309322 6029 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309326 6029 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309333 6029 flags.go:64] FLAG: --node-status-max-images="50" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309336 6029 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309339 6029 flags.go:64] FLAG: --oom-score-adj="-999" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309342 6029 flags.go:64] FLAG: --pod-cidr="" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309345 6029 flags.go:64] FLAG: --pod-manifest-path="" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309348 6029 flags.go:64] FLAG: --pod-max-pids="-1" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309351 6029 flags.go:64] FLAG: --pods-per-core="0" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309354 6029 flags.go:64] FLAG: --port="10250" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309357 6029 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309360 6029 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0030698b1e5e5f4e2" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309363 6029 flags.go:64] FLAG: --qos-reserved="" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309366 6029 flags.go:64] FLAG: --read-only-port="10255" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309368 6029 flags.go:64] FLAG: --register-node="true" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309371 6029 flags.go:64] FLAG: --register-with-taints="" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309375 6029 flags.go:64] FLAG: --registry-burst="10" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309378 6029 flags.go:64] FLAG: --registry-qps="5" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309381 6029 flags.go:64] FLAG: --reserved-cpus="" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309384 6029 flags.go:64] FLAG: --reserved-memory="" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309388 6029 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 29 23:13:53.317641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309391 6029 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309394 6029 flags.go:64] FLAG: --rotate-certificates="false" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309397 6029 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309400 6029 flags.go:64] FLAG: --runonce="false" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309403 6029 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309406 6029 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309409 6029 flags.go:64] FLAG: --seccomp-default="false" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309412 6029 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309415 6029 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309418 6029 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309421 6029 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309424 6029 flags.go:64] FLAG: --storage-driver-password="root" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309428 6029 flags.go:64] FLAG: --storage-driver-secure="false" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309431 6029 flags.go:64] FLAG: --storage-driver-table="stats" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309434 6029 flags.go:64] FLAG: --storage-driver-user="root" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309437 6029 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309440 6029 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309443 6029 flags.go:64] FLAG: --system-cgroups="" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309446 6029 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309451 6029 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309454 6029 flags.go:64] FLAG: --tls-cert-file="" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309456 6029 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309460 6029 flags.go:64] FLAG: --tls-min-version="" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309463 6029 flags.go:64] FLAG: --tls-private-key-file="" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309466 6029 flags.go:64] FLAG: --topology-manager-policy="none" Oct 29 23:13:53.318317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309469 6029 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 29 23:13:53.319067 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309472 6029 flags.go:64] FLAG: --topology-manager-scope="container" Oct 29 23:13:53.319067 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309475 6029 flags.go:64] FLAG: --v="2" Oct 29 23:13:53.319067 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309479 6029 flags.go:64] FLAG: --version="false" Oct 29 23:13:53.319067 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309483 6029 flags.go:64] FLAG: --vmodule="" Oct 29 23:13:53.319067 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309487 6029 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 29 23:13:53.319067 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309490 6029 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 29 23:13:53.319067 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309622 6029 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:13:53.319067 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309626 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:13:53.319067 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309629 6029 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:13:53.319067 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309631 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:13:53.319067 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309634 6029 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:13:53.319067 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309637 6029 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:13:53.319067 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309640 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:13:53.319067 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309643 6029 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:13:53.319067 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309645 6029 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:13:53.319067 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309647 6029 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:13:53.319067 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309650 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:13:53.319067 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309653 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:13:53.319067 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309657 6029 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:13:53.319067 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309659 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:13:53.319067 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309662 6029 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:13:53.319584 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309664 6029 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:13:53.319584 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309667 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:13:53.319584 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309669 6029 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:13:53.319584 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309672 6029 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:13:53.319584 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309674 6029 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:13:53.319584 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309677 6029 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:13:53.319584 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309679 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:13:53.319584 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309682 6029 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:13:53.319584 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309685 6029 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:13:53.319584 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309687 6029 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:13:53.319584 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309690 6029 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:13:53.319584 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309693 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:13:53.319584 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309696 6029 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:13:53.319584 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309698 6029 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:13:53.319584 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309702 6029 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:13:53.319584 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309706 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:13:53.319584 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309709 6029 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:13:53.319584 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309712 6029 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:13:53.319584 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309715 6029 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:13:53.320223 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309717 6029 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:13:53.320223 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309720 6029 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:13:53.320223 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309722 6029 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:13:53.320223 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309725 6029 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:13:53.320223 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309728 6029 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:13:53.320223 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309731 6029 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:13:53.320223 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309733 6029 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:13:53.320223 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309736 6029 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:13:53.320223 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309738 6029 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:13:53.320223 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309741 6029 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:13:53.320223 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309744 6029 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:13:53.320223 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309747 6029 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:13:53.320223 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309749 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:13:53.320223 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309752 6029 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:13:53.320223 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309754 6029 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:13:53.320223 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309757 6029 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:13:53.320223 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309759 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:13:53.320223 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309762 6029 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:13:53.320223 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309765 6029 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:13:53.320916 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309767 6029 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:13:53.320916 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309772 6029 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:13:53.320916 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309775 6029 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:13:53.320916 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309777 6029 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:13:53.320916 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309780 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:13:53.320916 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309782 6029 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:13:53.320916 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309785 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:13:53.320916 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309787 6029 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:13:53.320916 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309790 6029 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:13:53.320916 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309792 6029 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:13:53.320916 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309795 6029 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:13:53.320916 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309798 6029 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:13:53.320916 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309800 6029 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:13:53.320916 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309803 6029 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:13:53.320916 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309805 6029 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:13:53.320916 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309809 6029 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:13:53.320916 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309827 6029 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:13:53.320916 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309830 6029 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:13:53.320916 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309833 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:13:53.320916 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309836 6029 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:13:53.321599 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309839 6029 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:13:53.321599 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309842 6029 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:13:53.321599 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309844 6029 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:13:53.321599 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309848 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:13:53.321599 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309851 6029 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:13:53.321599 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309853 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:13:53.321599 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309856 6029 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:13:53.321599 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309859 6029 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:13:53.321599 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309861 6029 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:13:53.321599 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309864 6029 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:13:53.321599 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309866 6029 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:13:53.321599 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309869 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:13:53.321599 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309871 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:13:53.321599 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309875 6029 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:13:53.321599 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309878 6029 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:13:53.321599 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309880 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:13:53.321599 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309883 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:13:53.321599 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309885 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:13:53.321599 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309888 6029 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:13:53.321599 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309890 6029 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:13:53.322191 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309893 6029 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:13:53.322191 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309896 6029 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:13:53.322191 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309899 6029 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:13:53.322191 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309901 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:13:53.322191 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309904 6029 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:13:53.322191 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309906 6029 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:13:53.322191 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309909 6029 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:13:53.322191 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309912 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:13:53.322191 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309914 6029 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:13:53.322191 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309917 6029 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:13:53.322191 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309920 6029 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:13:53.322191 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309922 6029 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:13:53.322191 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309925 6029 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:13:53.322191 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.309952 6029 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 29 23:13:53.322191 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309987 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:13:53.322604 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309993 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:13:53.322604 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309997 6029 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:13:53.322604 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.309999 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:13:53.322604 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310002 6029 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:13:53.322604 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310005 6029 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:13:53.322604 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310007 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:13:53.322604 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310010 6029 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:13:53.322604 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310012 6029 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:13:53.322604 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310015 6029 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:13:53.322604 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310018 6029 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:13:53.322604 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310020 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:13:53.322604 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310024 6029 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:13:53.322604 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310027 6029 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:13:53.322604 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310029 6029 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:13:53.322604 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310032 6029 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:13:53.322604 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310035 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:13:53.322604 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310037 6029 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:13:53.322604 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310040 6029 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:13:53.322604 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310044 6029 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:13:53.323136 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310048 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:13:53.323136 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310051 6029 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:13:53.323136 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310054 6029 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:13:53.323136 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310057 6029 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:13:53.323136 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310059 6029 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:13:53.323136 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310062 6029 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:13:53.323136 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310064 6029 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:13:53.323136 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310067 6029 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:13:53.323136 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310069 6029 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:13:53.323136 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310072 6029 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:13:53.323136 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310075 6029 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:13:53.323136 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310078 6029 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:13:53.323136 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310080 6029 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:13:53.323136 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310084 6029 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:13:53.323136 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310087 6029 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:13:53.323136 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310090 6029 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:13:53.323136 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310092 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:13:53.323136 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310094 6029 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:13:53.323136 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310097 6029 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:13:53.323656 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310099 6029 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:13:53.323656 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310102 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:13:53.323656 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310104 6029 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:13:53.323656 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310107 6029 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:13:53.323656 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310110 6029 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:13:53.323656 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310114 6029 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:13:53.323656 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310118 6029 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:13:53.323656 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310120 6029 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:13:53.323656 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310123 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:13:53.323656 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310125 6029 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:13:53.323656 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310128 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:13:53.323656 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310130 6029 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:13:53.323656 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310133 6029 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:13:53.323656 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310135 6029 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:13:53.323656 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310138 6029 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:13:53.323656 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310140 6029 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:13:53.323656 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310143 6029 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:13:53.323656 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310145 6029 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:13:53.323656 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310148 6029 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:13:53.324189 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310151 6029 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:13:53.324189 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310155 6029 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:13:53.324189 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310157 6029 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:13:53.324189 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310160 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:13:53.324189 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310163 6029 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:13:53.324189 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310165 6029 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:13:53.324189 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310168 6029 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:13:53.324189 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310173 6029 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:13:53.324189 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310176 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:13:53.324189 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310178 6029 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:13:53.324189 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310181 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:13:53.324189 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310184 6029 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:13:53.324189 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310187 6029 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:13:53.324189 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310190 6029 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:13:53.324189 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310192 6029 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:13:53.324189 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310195 6029 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:13:53.324189 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310197 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:13:53.324189 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310200 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:13:53.324189 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310205 6029 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:13:53.324682 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310208 6029 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:13:53.324682 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310210 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:13:53.324682 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310213 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:13:53.324682 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310215 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:13:53.324682 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310218 6029 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:13:53.324682 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310220 6029 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:13:53.324682 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310223 6029 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:13:53.324682 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310225 6029 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:13:53.324682 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310228 6029 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:13:53.324682 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310230 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:13:53.324682 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310233 6029 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:13:53.324682 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310236 6029 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:13:53.324682 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310239 6029 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:13:53.324682 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310241 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:13:53.324682 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310244 6029 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:13:53.324682 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310246 6029 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:13:53.324682 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310249 6029 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:13:53.324682 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310251 6029 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:13:53.324682 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310253 6029 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:13:53.324682 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310256 6029 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:13:53.325305 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310264 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:13:53.325305 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310267 6029 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:13:53.325305 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310270 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:13:53.325305 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310272 6029 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:13:53.325305 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310274 6029 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:13:53.325305 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310278 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:13:53.325305 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310281 6029 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:13:53.325305 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310283 6029 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:13:53.325305 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.310285 6029 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:13:53.325305 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.315734 6029 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 29 23:13:53.325305 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.315752 6029 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 29 23:13:53.325305 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.315773 6029 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 29 23:13:53.325305 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.315777 6029 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 29 23:13:53.325305 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315861 6029 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:13:53.325305 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315868 6029 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:13:53.325305 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315871 6029 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:13:53.325305 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315875 6029 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:13:53.325305 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315878 6029 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:13:53.325305 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315881 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:13:53.325771 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315884 6029 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:13:53.325771 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315887 6029 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:13:53.325771 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315889 6029 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:13:53.325771 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315893 6029 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:13:53.325771 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315896 6029 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:13:53.325771 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315899 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:13:53.325771 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315901 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:13:53.325771 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315904 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:13:53.325771 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315907 6029 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:13:53.325771 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315909 6029 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:13:53.325771 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315912 6029 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:13:53.325771 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315914 6029 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:13:53.325771 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315917 6029 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:13:53.325771 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315920 6029 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:13:53.325771 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315922 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:13:53.325771 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315925 6029 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:13:53.325771 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315927 6029 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:13:53.325771 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315930 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:13:53.325771 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315933 6029 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:13:53.325771 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315935 6029 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:13:53.326267 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315938 6029 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:13:53.326267 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315940 6029 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:13:53.326267 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315944 6029 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:13:53.326267 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315947 6029 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:13:53.326267 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315952 6029 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:13:53.326267 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315955 6029 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:13:53.326267 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315958 6029 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:13:53.326267 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315961 6029 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:13:53.326267 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315963 6029 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:13:53.326267 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315966 6029 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:13:53.326267 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315969 6029 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:13:53.326267 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315971 6029 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:13:53.326267 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315974 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:13:53.326267 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315976 6029 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:13:53.326267 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315979 6029 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:13:53.326267 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315982 6029 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:13:53.326267 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315984 6029 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:13:53.326267 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315987 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:13:53.326267 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315990 6029 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:13:53.326753 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315992 6029 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:13:53.326753 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315995 6029 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:13:53.326753 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.315997 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:13:53.326753 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316000 6029 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:13:53.326753 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316002 6029 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:13:53.326753 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316005 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:13:53.326753 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316008 6029 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:13:53.326753 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316010 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:13:53.326753 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316013 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:13:53.326753 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316015 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:13:53.326753 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316018 6029 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:13:53.326753 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316020 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:13:53.326753 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316023 6029 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:13:53.326753 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316025 6029 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:13:53.326753 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316028 6029 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:13:53.326753 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316032 6029 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:13:53.326753 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316034 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:13:53.326753 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316037 6029 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:13:53.326753 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316039 6029 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:13:53.326753 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316042 6029 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:13:53.327250 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316045 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:13:53.327250 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316047 6029 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:13:53.327250 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316056 6029 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:13:53.327250 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316059 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:13:53.327250 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316062 6029 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:13:53.327250 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316065 6029 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:13:53.327250 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316068 6029 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:13:53.327250 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316070 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:13:53.327250 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316073 6029 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:13:53.327250 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316076 6029 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:13:53.327250 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316078 6029 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:13:53.327250 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316081 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:13:53.327250 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316084 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:13:53.327250 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316086 6029 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:13:53.327250 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316090 6029 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:13:53.327250 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316093 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:13:53.327250 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316095 6029 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:13:53.327250 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316098 6029 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:13:53.327250 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316102 6029 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:13:53.327708 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316106 6029 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:13:53.327708 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316109 6029 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:13:53.327708 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316112 6029 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:13:53.327708 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316116 6029 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:13:53.327708 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316118 6029 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:13:53.327708 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316121 6029 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:13:53.327708 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316123 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:13:53.327708 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316126 6029 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:13:53.327708 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316129 6029 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:13:53.327708 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316131 6029 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:13:53.327708 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316134 6029 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:13:53.327708 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316136 6029 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:13:53.327708 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316139 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:13:53.327708 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316141 6029 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:13:53.327708 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316144 6029 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:13:53.327708 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316147 6029 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:13:53.327708 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316149 6029 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:13:53.327708 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316152 6029 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:13:53.327708 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316154 6029 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:13:53.327708 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316157 6029 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:13:53.328205 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316159 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:13:53.328205 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316162 6029 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:13:53.328205 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.316188 6029 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 29 23:13:53.328205 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316333 6029 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:13:53.328205 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316338 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:13:53.328205 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316341 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:13:53.328205 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316344 6029 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:13:53.328205 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316347 6029 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:13:53.328205 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316350 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:13:53.328205 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316353 6029 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:13:53.328205 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316356 6029 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:13:53.328205 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316358 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:13:53.328205 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316361 6029 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:13:53.328205 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316364 6029 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:13:53.328205 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316367 6029 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:13:53.328205 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316370 6029 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:13:53.328590 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316372 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:13:53.328590 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316375 6029 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:13:53.328590 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316378 6029 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:13:53.328590 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316380 6029 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:13:53.328590 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316383 6029 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:13:53.328590 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316385 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:13:53.328590 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316388 6029 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:13:53.328590 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316391 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:13:53.328590 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316394 6029 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:13:53.328590 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316397 6029 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:13:53.328590 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316399 6029 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:13:53.328590 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316401 6029 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:13:53.328590 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316404 6029 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:13:53.328590 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316407 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:13:53.328590 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316409 6029 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:13:53.328590 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316412 6029 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:13:53.328590 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316414 6029 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:13:53.328590 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316417 6029 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:13:53.328590 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316423 6029 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:13:53.328590 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316426 6029 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:13:53.329188 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316429 6029 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:13:53.329188 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316431 6029 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:13:53.329188 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316434 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:13:53.329188 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316436 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:13:53.329188 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316440 6029 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:13:53.329188 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316446 6029 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:13:53.329188 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316449 6029 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:13:53.329188 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316452 6029 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:13:53.329188 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316455 6029 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:13:53.329188 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316457 6029 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:13:53.329188 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316460 6029 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:13:53.329188 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316463 6029 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:13:53.329188 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316466 6029 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:13:53.329188 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316469 6029 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:13:53.329188 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316471 6029 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:13:53.329188 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316474 6029 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:13:53.329188 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316477 6029 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:13:53.329188 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316479 6029 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:13:53.329188 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316481 6029 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:13:53.329188 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316484 6029 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:13:53.329795 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316487 6029 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:13:53.329795 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316489 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:13:53.329795 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316492 6029 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:13:53.329795 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316494 6029 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:13:53.329795 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316497 6029 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:13:53.329795 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316501 6029 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:13:53.329795 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316504 6029 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:13:53.329795 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316507 6029 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:13:53.329795 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316510 6029 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:13:53.329795 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316513 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:13:53.329795 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316516 6029 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:13:53.329795 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316519 6029 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:13:53.329795 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316521 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:13:53.329795 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316524 6029 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:13:53.329795 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316527 6029 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:13:53.329795 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316529 6029 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:13:53.329795 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316532 6029 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:13:53.329795 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316534 6029 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:13:53.329795 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316538 6029 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:13:53.329795 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316540 6029 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:13:53.330361 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316543 6029 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:13:53.330361 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316545 6029 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:13:53.330361 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316548 6029 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:13:53.330361 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316550 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:13:53.330361 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316553 6029 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:13:53.330361 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316555 6029 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:13:53.330361 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316558 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:13:53.330361 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316560 6029 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:13:53.330361 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316563 6029 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:13:53.330361 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316565 6029 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:13:53.330361 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316568 6029 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:13:53.330361 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316570 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:13:53.330361 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316573 6029 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:13:53.330361 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316576 6029 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:13:53.330361 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316578 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:13:53.330361 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316581 6029 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:13:53.330361 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316583 6029 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:13:53.330361 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316586 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:13:53.330361 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316588 6029 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:13:53.330361 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316590 6029 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:13:53.330858 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316593 6029 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:13:53.330858 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316596 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:13:53.330858 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316598 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:13:53.330858 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316601 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:13:53.330858 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316603 6029 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:13:53.330858 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316606 6029 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:13:53.330858 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316608 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:13:53.330858 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316611 6029 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:13:53.330858 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316613 6029 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:13:53.330858 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316618 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:13:53.330858 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316621 6029 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:13:53.330858 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316624 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:13:53.330858 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316627 6029 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:13:53.330858 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.316649 6029 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 29 23:13:53.330858 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316680 6029 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:13:53.331220 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316684 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:13:53.331220 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316687 6029 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:13:53.331220 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316690 6029 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:13:53.331220 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316693 6029 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:13:53.331220 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316695 6029 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:13:53.331220 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316698 6029 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:13:53.331220 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316701 6029 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:13:53.331220 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316703 6029 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:13:53.331220 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316706 6029 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:13:53.331220 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316708 6029 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:13:53.331220 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316711 6029 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:13:53.331220 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316713 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:13:53.331220 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316716 6029 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:13:53.331220 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316719 6029 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:13:53.331220 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316721 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:13:53.331220 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316724 6029 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:13:53.331220 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316727 6029 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:13:53.331220 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316730 6029 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:13:53.331220 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316732 6029 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:13:53.331220 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316735 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:13:53.331727 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316738 6029 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:13:53.331727 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316740 6029 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:13:53.331727 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316743 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:13:53.331727 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316746 6029 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:13:53.331727 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316748 6029 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:13:53.331727 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316750 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:13:53.331727 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316755 6029 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:13:53.331727 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316758 6029 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:13:53.331727 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316760 6029 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:13:53.331727 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316763 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:13:53.331727 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316766 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:13:53.331727 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316768 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:13:53.331727 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316771 6029 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:13:53.331727 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316773 6029 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:13:53.331727 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316776 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:13:53.331727 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316778 6029 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:13:53.331727 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316781 6029 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:13:53.331727 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316783 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:13:53.331727 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316786 6029 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:13:53.332580 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316788 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:13:53.332580 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316791 6029 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:13:53.332580 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316793 6029 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:13:53.332580 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316796 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:13:53.332580 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316798 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:13:53.332580 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316801 6029 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:13:53.332580 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316803 6029 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:13:53.332580 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316806 6029 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:13:53.332580 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316809 6029 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:13:53.332580 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316828 6029 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:13:53.332580 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316832 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:13:53.332580 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316835 6029 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:13:53.332580 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316838 6029 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:13:53.332580 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316840 6029 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:13:53.332580 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316843 6029 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:13:53.332580 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316846 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:13:53.332580 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316848 6029 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:13:53.332580 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316851 6029 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:13:53.332580 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316853 6029 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:13:53.333401 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316858 6029 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:13:53.333401 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316861 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:13:53.333401 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316863 6029 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:13:53.333401 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316866 6029 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:13:53.333401 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316869 6029 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:13:53.333401 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316872 6029 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:13:53.333401 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316875 6029 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:13:53.333401 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316877 6029 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:13:53.333401 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316880 6029 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:13:53.333401 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316882 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:13:53.333401 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316885 6029 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:13:53.333401 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316887 6029 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:13:53.333401 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316890 6029 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:13:53.333401 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316892 6029 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:13:53.333401 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316895 6029 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:13:53.333401 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316898 6029 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:13:53.333401 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316900 6029 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:13:53.333401 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316903 6029 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:13:53.333401 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316905 6029 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:13:53.333401 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316908 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:13:53.334054 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316912 6029 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:13:53.334054 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316916 6029 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:13:53.334054 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316919 6029 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:13:53.334054 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316922 6029 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:13:53.334054 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316925 6029 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:13:53.334054 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316928 6029 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:13:53.334054 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316932 6029 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:13:53.334054 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316934 6029 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:13:53.334054 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316937 6029 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:13:53.334054 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316940 6029 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:13:53.334054 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316942 6029 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:13:53.334054 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316945 6029 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:13:53.334054 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316949 6029 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:13:53.334054 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316951 6029 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:13:53.334054 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316954 6029 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:13:53.334054 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316956 6029 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:13:53.334054 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316959 6029 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:13:53.334054 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316962 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:13:53.334054 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316964 6029 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:13:53.334054 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316967 6029 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:13:53.334578 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316969 6029 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:13:53.334578 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316973 6029 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:13:53.334578 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316977 6029 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:13:53.334578 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316980 6029 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:13:53.334578 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316983 6029 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:13:53.334578 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316987 6029 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:13:53.334578 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:13:53.316990 6029 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:13:53.334578 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.317056 6029 server.go:957] "Client rotation is on, will bootstrap in background" Oct 29 23:13:53.334578 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.318032 6029 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Oct 29 23:13:53.334578 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.318087 6029 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Oct 29 23:13:53.334578 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.318277 6029 server.go:1014] "Starting client certificate rotation" Oct 29 23:13:53.334578 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.318426 6029 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 29 23:13:53.334578 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.318481 6029 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-28 23:07:42 +0000 UTC" deadline="2028-06-23 16:01:39.594233537 +0000 UTC" Oct 29 23:13:53.334578 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.318516 6029 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14464h47m46.275719248s" Oct 29 23:13:53.334578 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.318747 6029 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 29 23:13:53.335080 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.319849 6029 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 29 23:13:53.335080 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.321423 6029 log.go:25] "Validated CRI v1 runtime API" Oct 29 23:13:53.335080 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.323330 6029 log.go:25] "Validated CRI v1 image API" Oct 29 23:13:53.335080 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.323931 6029 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 29 23:13:53.335080 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.325993 6029 fs.go:135] Filesystem UUIDs: map[1c8c7f94-9768-4c37-a75e-2a2a439e7c86:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c4e30fbe-77ba-45f8-9e80-288301d614da:/dev/nvme0n1p3] Oct 29 23:13:53.335278 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.326011 6029 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/04d9d55239382b834b38a6f4c37944238b1509e14a0602fcadeb61fca0508b95/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/04d9d55239382b834b38a6f4c37944238b1509e14a0602fcadeb61fca0508b95/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0cfe4ce3648f45cdb974bfbddc3ddee17c5630a0b34788278232e0de08d1afc4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0cfe4ce3648f45cdb974bfbddc3ddee17c5630a0b34788278232e0de08d1afc4/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0f81a6e97ab7690b909a0f19219b64f62d9f7004b1c1218bbea4f09e584442dd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0f81a6e97ab7690b909a0f19219b64f62d9f7004b1c1218bbea4f09e584442dd/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/25755c20867e43dee9a0c733805d8732fc83331d524a3218d6ffb8c493e8cc4e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/25755c20867e43dee9a0c733805d8732fc83331d524a3218d6ffb8c493e8cc4e/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2985ea8f11c7ddad9d09de957a0c93aa4e1ea269c6f72a5b41ce66849eb8f412/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2985ea8f11c7ddad9d09de957a0c93aa4e1ea269c6f72a5b41ce66849eb8f412/userdata/shm major:0 minor:394 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3c0a2af3b088b7ded81dbf2274416b38f63511542ea4b2fd9c7eb02088e8a672/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3c0a2af3b088b7ded81dbf2274416b38f63511542ea4b2fd9c7eb02088e8a672/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/55d642655ff4479f6baaa851396b7452f17c842317163ca751c9bfdeaeb437f2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/55d642655ff4479f6baaa851396b7452f17c842317163ca751c9bfdeaeb437f2/userdata/shm major:0 minor:247 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5f7f2c19f4a6bf8b04fc3e695f3af25c5d392989858cc60057e43de8d3a55eef/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5f7f2c19f4a6bf8b04fc3e695f3af25c5d392989858cc60057e43de8d3a55eef/userdata/shm major:0 minor:333 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/697d9bfb63032b9f5833cfe4f2efa4b518fedccc7940e59fcb50be042efd75e9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/697d9bfb63032b9f5833cfe4f2efa4b518fedccc7940e59fcb50be042efd75e9/userdata/shm major:0 minor:403 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/69e14cc55a0c169ad2e87174f66daa3ea17a581045ab0bf52d3b88b92e257768/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/69e14cc55a0c169ad2e87174f66daa3ea17a581045ab0bf52d3b88b92e257768/userdata/shm major:0 minor:77 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/82cc95bcb4a5fd542030a9c4381b16b4004e7320696015a86238f18b81570a1a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/82cc95bcb4a5fd542030a9c4381b16b4004e7320696015a86238f18b81570a1a/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8c55e8d9b8fafd3455e99b739cd513f81d5c50767e7a907aa1424655fd8787db/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8c55e8d9b8fafd3455e99b739cd513f81d5c50767e7a907aa1424655fd8787db/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8d4e3cd859ccc6f561fb644dc0678fd98627b5683ebe29bafe80e2815d69179c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8d4e3cd859ccc6f561fb644dc0678fd98627b5683ebe29bafe80e2815d69179c/userdata/shm major:0 minor:329 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ae2a0c3a0041823cad6a647bb942b967685040749078f098715db9e4cdb4adb7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ae2a0c3a0041823cad6a647bb942b967685040749078f098715db9e4cdb4adb7/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b95b006a3bb7b3a4fcf12694a7d28e921d90d4026201db3192f5a0c086834ade/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b95b006a3bb7b3a4fcf12694a7d28e921d90d4026201db3192f5a0c086834ade/userdata/shm major:0 minor:410 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ba5f5b12df177fbc161b95aef99c135505439e298d3124ed749aaacd9c4ed5a5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ba5f5b12df177fbc161b95aef99c135505439e298d3124ed749aaacd9c4ed5a5/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c32e3791a6cbd50c10c65b45d2e5731b965f8cd8f24e1057902c5f3061c2b1c9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c32e3791a6cbd50c10c65b45d2e5731b965f8cd8f24e1057902c5f3061c2b1c9/userdata/shm major:0 minor:260 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ceb618a53abf5cc77fff88bf0bc5e0f429e55a66d8902ab495e54503b68a0710/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ceb618a53abf5cc77fff88bf0bc5e0f429e55a66d8902ab495e54503b68a0710/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d708070e660da5e74974bb624ed25191154c10464134973b85d7d0fe759b9ba4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d708070e660da5e74974bb624ed25191154c10464134973b85d7d0fe759b9ba4/userdata/shm major:0 minor:409 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/db6b3223a1a717d9d45a67097fc11687afecdebae32a30f500efb4c08123b93c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/db6b3223a1a717d9d45a67097fc11687afecdebae32a30f500efb4c08123b93c/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e8cb782e9c1be769d7148c5fbf674732f856c1c93ec4383ab35afe2299033f05/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e8cb782e9c1be769d7148c5fbf674732f856c1c93ec4383ab35afe2299033f05/userdata/shm major:0 minor:284 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e8fa71fef1d47c18629d5800716ba24d09d5b7e662016c2da87ab90415c25951/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e8fa71fef1d47c18629d5800716ba24d09d5b7e662016c2da87ab90415c25951/userdata/shm major:0 minor:359 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f0017bc2c60bfc43e54a7237d2b242138809e4da2c89d1f2b5138fda836f19da/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f0017bc2c60bfc43e54a7237d2b242138809e4da2c89d1f2b5138fda836f19da/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f97c977c720bad504712ebf34ec85e60e55e0d6cf9676c02b84e20d95f0e9c68/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f97c977c720bad504712ebf34ec85e60e55e0d6cf9676c02b84e20d95f0e9c68/userdata/shm major:0 minor:305 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0234d968-7137-4520-8bd1-b26ee1f08885/volumes/kubernetes.io~projected/kube-api-access-6n6gc:{mountpoint:/var/lib/kubelet/pods/0234d968-7137-4520-8bd1-b26ee1f08885/volumes/kubernetes.io~projected/kube-api-access-6n6gc major:0 minor:332 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0234d968-7137-4520-8bd1-b26ee1f08885/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/0234d968-7137-4520-8bd1-b26ee1f08885/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:331 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0fc5618f-b30f-45ce-b070-beed0ecbbbd9/volumes/kubernetes.io~projected/kube-api-access-vgqr9:{mountpoint:/var/lib/kubelet/pods/0fc5618f-b30f-45ce-b070-beed0ecbbbd9/volumes/kubernetes.io~projected/kube-api-access-vgqr9 major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0fc5618f-b30f-45ce-b070-beed0ecbbbd9/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/0fc5618f-b30f-45ce-b070-beed0ecbbbd9/volumes/kubernetes.io~secret/metrics-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/14a7a4eb-db41-4943-a17f-6f2f02d55966/volumes/kubernetes.io~projected/kube-api-access-ht2fz:{mountpoint:/var/lib/kubelet/pods/14a7a4eb-db41-4943-a17f-6f2f02d55966/volumes/kubernetes.io~projected/kube-api-access-ht2fz major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/14a7a4eb-db41-4943-a17f-6f2f02d55966/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/14a7a4eb-db41-4943-a17f-6f2f02d55966/volumes/kubernetes.io~secret/cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/286e0f07-4271-46b1-bca0-18ed0b12754e/volumes/kubernetes.io~projected/kube-api-access-mw5vc:{mountpoint:/var/lib/kubelet/pods/286e0f07-4271-46b1-bca0-18ed0b12754e/volumes/kubernetes.io~projected/kube-api-access-mw5vc major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb/volumes/kubernetes.io~projected/kube-api-access-bcxvh:{mountpoint:/var/lib/kubelet/pods/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb/volumes/kubernetes.io~projected/kube-api-access-bcxvh major:0 minor:259 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:257 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:258 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/480d690f-601d-4d63-aaf7-3717d5758230/volumes/kubernetes.io~projected/kube-api-access-2zsds:{mountpoint:/var/lib/kubelet/pods/480d690f-601d-4d63-aaf7-3717d5758230/volumes/kubernetes.io~projected/kube-api-access-2zsds major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/480d690f-601d-4d63-aaf7-3717d5758230/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/480d690f-601d-4d63-aaf7-3717d5758230/volumes/kubernetes.io~secret/metrics-certs major:0 minor:397 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4962406a-baa9-420f-8069-98171dc6bd1d/volumes/kubernetes.io~projected/kube-api-access-4nfbj:{mountpoint:/var/lib/kubelet/pods/4962406a-baa9-420f-8069-98171dc6bd1d/volumes/kubernetes.io~projected/kube-api-access-4nfbj major:0 minor:393 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4962406a-baa9-420f-8069-98171dc6bd1d/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/4962406a-baa9-420f-8069-98171dc6bd1d/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:388 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4962406a-baa9-420f-8069-98171dc6bd1d/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/4962406a-baa9-420f-8069-98171dc6bd1d/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:392 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4ac381e5-012d-42c0-bfa4-1e6e313b694a/volumes/kubernetes.io~projected/kube-api-access-lxmhl:{mountpoint:/var/lib/kubelet/pods/4ac381e5-012d-42c0-bfa4-1e6e313b694a/volumes/kubernetes.io~projected/kube-api-access-lxmhl major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4ac381e5-012d-42c0-bfa4-1e6e313b694a/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/4ac381e5-012d-42c0-bfa4-1e6e313b694a/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/56b29c9c-9fc1-44be-834e-76724afbb2a6/volumes/kubernetes.io~projected/kube-api-access-7h5kq:{mountpoint:/var/lib/kubelet/pods/56b29c9c-9fc1-44be-834e-76724afbb2a6/volumes/kubernetes.io~projected/kube-api-access-7h5kq major:0 minor:283 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/56b29c9c-9fc1-44be-834e-76724afbb2a6/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/56b29c9c-9fc1-44be-834e-76724afbb2a6/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:282 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/56b29c9c-9fc1-44be-834e-76724afbb2a6/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/56b29c9c-9fc1-44be-834e-76724afbb2a6/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:277 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5a425c1c-3f2d-46ef-895e-0e19f7795633/volumes/kubernetes.io~projected/kube-api-access-p9rk6:{mountpoint:/var/lib/kubelet/pods/5a425c1c-3f2d-46ef-895e-0e19f7795633/volumes/kubernetes.io~projected/kube-api-access-p9rk6 major:0 minor:328 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5a425c1c-3f2d-46ef-895e-0e19f7795633/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/5a425c1c-3f2d-46ef-895e-0e19f7795633/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:327 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5a425c1c-3f2d-46ef-895e-0e19f7795633/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/5a425c1c-3f2d-46ef-895e-0e19f7795633/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:326 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5a425c1c-3f2d-46ef-895e-0e19f7795633/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/5a425c1c-3f2d-46ef-895e-0e19f7795633/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:322 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7138ba89-e1c9-4c07-a833-3ba8f9a54445/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/7138ba89-e1c9-4c07-a833-3ba8f9a54445/volumes/kubernetes.io~secret/agent-certs major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5/volumes/kubernetes.io~projected/kube-api-access-h9djk:{mountpoint:/var/lib/kubelet/pods/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5/volumes/kubernetes.io~projected/kube-api-access-h9djk major:0 minor:246 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config major:0 minor:245 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5/volumes/kubernetes.io~secret/prometheus-operator-tls:{mountpoint:/var/lib/kubelet/pods/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5/volumes/kubernetes.io~secret/prometheus-operator-tls major:0 minor:241 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7b4b45cd-366a-4e03-8b83-0ad02541bfd6/volumes/kubernetes.io~projected/kube-api-access-qbdwc:{mountpoint:/var/lib/kubelet/pods/7b4b45cd-366a-4e03-8b83-0ad02541bfd6/volumes/kubernetes.io~projected/kube-api-access-qbdwc major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b2187059-1391-4124-9981-0a203dfe8628/volumes/kubernetes.io~projected/kube-api-access-cwwh4:{mountpoint:/var/lib/kubelet/pods/b2187059-1391-4124-9981-0a203dfe8628/volumes/kubernetes.io~projected/kube-api-access-cwwh4 major:0 minor:304 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b2187059-1391-4124-9981-0a203dfe8628/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/b2187059-1391-4124-9981-0a203dfe8628/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b2187059-1391-4124-9981-0a203dfe8628/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/b2187059-1391-4124-9981-0a203dfe8628/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:303 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b2187059-1391-4124-9981-0a203dfe8628/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/b2187059-1391-4124-9981-0a203dfe8628/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:299 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b2187059-1391-4124-9981-0a203dfe8628/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/b2187059-1391-4124-9981-0a203dfe8628/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:302 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b2187059-1391-4124-9981-0a203dfe8628/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/b2187059-1391-4124-9981-0a203dfe8628/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:300 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b2187059-1391-4124-9981-0a203dfe8628/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/b2187059-1391-4124-9981-0a203dfe8628/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:301 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b2a9a07d-839b-4f06-af7e-4651164dce3f/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/b2a9a07d-839b-4f06-af7e-4651164dce3f/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b2a9a07d-839b-4f06-af7e-4651164dce3f/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/b2a9a07d-839b-4f06-af7e-4651164dce3f/volumes/kubernetes.io~empty-dir/tmp major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b2a9a07d-839b-4f06-af7e-4651164dce3f/volumes/kubernetes.io~projected/kube-api-access-wvkrk:{mountpoint:/var/lib/kubelet/pods/b2a9a07d-839b-4f06-af7e-4651164dce3f/volumes/kubernetes.io~projected/kube-api-access-wvkrk major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c7491f84-75c3-4286-90f9-ec4314ac5bf9/volumes/kubernetes.io~projected/kube-api-access-jfr6k:{mountpoint:/var/lib/kubelet/pods/c7491f84-75c3-4286-90f9-ec4314ac5bf9/volumes/kubernetes.io~projected/kube-api-access-jfr6k major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d33591ce-f459-4bb1-8fa0-87c608b9616c/volumes/kubernetes.io~projected/kube-api-access-nzcq7:{mountpoint:/var/lib/kubelet/pods/d33591ce-f459-4bb1-8fa0-87c608b9616c/volumes/kubernetes.io~projected/kube-api-access-nzcq7 major:0 minor:358 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d33591ce-f459-4bb1-8fa0-87c608b9616c/volumes/kubernetes.io~secret/federate-client-tls:{mountpoint:/var/lib/kubelet/pods/d33591ce-f459-4bb1-8fa0-87c608b9616c/volumes/kubernetes.io~secret/federate-client-tls major:0 minor:356 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d33591ce-f459-4bb1-8fa0-87c608b9616c/volumes/kubernetes.io~secret/secret-telemeter-client:{mountpoint:/var/lib/kubelet/pods/d33591ce-f459-4bb1-8fa0-87c608b9616c/volumes/kubernetes.io~secret/secret-telemeter-client major:0 minor:357 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d33591ce-f459-4bb1-8fa0-87c608b9616c/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/d33591ce-f459-4bb1-8fa0-87c608b9616c/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config major:0 minor:355 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d33591ce-f459-4bb1-8fa0-87c608b9616c/volumes/kubernetes.io~secret/telemeter-client-tls:{mountpoint:/var/lib/kubelet/pods/d33591ce-f459-4bb1-8fa0-87c608b9616c/volumes/kubernetes.io~secret/telemeter-client-tls major:0 minor:351 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e2317d5c-4fcc-4027-82a7-911a28143f1a/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/e2317d5c-4fcc-4027-82a7-911a28143f1a/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e2317d5c-4fcc-4027-82a7-911a28143f1a/volumes/kubernetes.io~projected/kube-api-access-r2brg:{mountpoint:/var/lib/kubelet/pods/e2317d5c-4fcc-4027-82a7-911a28143f1a/volumes/kubernetes.io~projected/kube-api-access-r2brg major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e2317d5c-4fcc-4027-82a7-911a28143f1a/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/e2317d5c-4fcc-4027-82a7-911a28143f1a/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ec3af7c3-d20a-499e-9cf7-c743da6b8ed1/volumes/kubernetes.io~projected/kube-api-access-k6nnh:{mountpoint:/var/lib/kubelet/pods/ec3af7c3-d20a-499e-9cf7-c743da6b8ed1/volumes/kubernetes.io~projected/kube-api-access-k6nnh major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f1cc6108-50e3-4a4d-855e-c4884e581e2e/volumes/kubernetes.io~projected/kube-api-access-75sml:{mountpoint:/var/lib/kubelet/pods/f1cc6108-50e3-4a4d-855e-c4884e581e2e/volumes/kubernetes.io~projected/kube-api-access-75sml major:0 minor:398 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f2e07092-e461-46b5-a31e-8f2512b34cbd/volumes/kubernetes.io~projected/kube-api-access-cwkxq:{mountpoint:/var/lib/kubelet/pods/f2e07092-e461-46b5-a31e-8f2512b34cbd/volumes/kubernetes.io~projected/kube-api-access-cwkxq major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f7add189-cde4-470f-a543-4dc4a91be859/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/f7add189-cde4-470f-a543-4dc4a91be859/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:396 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ffb39d83-b282-4ae6-ada1-8250e3d1273c/volumes/kubernetes.io~projected/kube-api-access-8w2ls:{mountpoint:/var/lib/kubelet/pods/ffb39d83-b282-4ae6-ada1-8250e3d1273c/volumes/kubernetes.io~projected/kube-api-access-8w2ls major:0 minor:60 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/a3c44f3bf3b6eda471f32d761c6fb73945c18f5aa01279017f7597ffba83905c/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/a29d693950b69d1e03b7f54ee6d7ae1cce18892c309b63b0a58ebd147546138b/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/bca5730a450beb3ec8e55ee30ea402462edf9a9d9f0d4439b43cbaba22a3a787/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/ec54fa330f9949b17fbc2b42234f6ff609112748a09627809ad84943d9627c40/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/c713f9d09c059c0f537ef87693ef0ddcd76e7aa494a9c63417cb935126e226b4/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/1d64f562a1f289a00095790b77b61542fd929dc26681b37c0148fae9f15fb6e7/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/a3ad42ef0feb9b530766822bbd9b08d0c5ddd8610d366896dcd7f57b7fe2fd9f/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/574b3195c5644223f36c29932d271229f257186243a2f4d97b3dfb4df0ec9a2e/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/ac0674b4e15bd262f0ac06e15ebe8b4115419ccd16c6fd29e7e9baf7554b3e58/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/ca520eacbc79e0569d2af8a9d989c5c91aa6061b116c6aea34b68d84c2056c9a/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/3f778e5c361148a825749a7820f8da9081a32b96ed215cd1d303fe9ffb0036f4/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-140:{mountpoint:/var/lib/containers/storage/overlay/8fd0b94b316fc0fcc3960ab8d10ffc9a4987449dd440c307e387b1d4e214745a/merged major:0 minor:140 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/560e8bff76348f5ab4750440b934b11724177dd466ebc154921051d940d9a4f1/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-154:{mountpoint:/var/lib/containers/storage/overlay/438b3bea430883514148ec3b2164aa3a4108f510672cf09d9435aae22517dbec/merged major:0 minor:154 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/4edfc4c00b7b29f116e0eeb06e8f03e384939663fbc072198f9d573b4544212c/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/91859d6acfbaddb0e3a82434705360b93ab6b384f81c4ca9c16b6f346db20087/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/00d3391759fa86338a634758fc4e7282f62d35088744d0c8f676dbce2dc4f9dd/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/92c1fa14f919601d42e4e13aa2115b0cdfac8a4e1704f058b05b384a27134aee/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/76afe5b3fd45ff9dc9fffef7e25a736e16208b9d251264b7f045f3f1fda94200/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/1af2c6cf0a95f2ae4b3722631c9a543986a963c70575d5f8284a62c0c1f32b6d/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/1aecbd586976973ca72a4a61f6b554beaa9e80fe8b75e97c35565f7e31d3bf35/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/31a0e0fa9943c4ef833057f62157f14ee54676f565fd410c28c06c19a6f12c92/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/df86f70e2f78858abe0700c25a7b5acbf971131e63cb10679f6f7c57a0e31889/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/bd5b90baf6d3ceddc64024d983ccb0fb0c259b366d8fce97788d4561ba6b33f7/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/0463aef205917bd0005fd85794e685d1cad0af246b245d8fb1fa2e35e9f657c4/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/0dfdd787c74b22e93ea0962607d31adfb811d65f1c3d6c5907f486942fbc69f1/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-225:{mountpoint:/var/lib/containers/storage/overlay/3c81e495a021331fa63b50c19f8df3a3aa45dc7f435d86069dc6c360f1f38e21/merged major:0 minor:225 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/80deb2f4945995fffcb385684f647ca22782a64e09b9d85b57941ce211dcbc92/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-236:{mountpoint:/var/lib/containers/storage/overlay/3da5874c94680e1ed77bd0bab987e0d1868e7f1d0c14c2f120d0d8cc45ee8ea1/merged major:0 minor:236 fsType:overlay blockSize:0} overlay_0-249:{mountpoint:/var/lib/containers/storage/overlay/2502702c35caa708498c2aa47a04a51429edf62b0af09f6e25a3e6d26e5eaf47/merged major:0 minor:249 fsType:overlay blockSize:0} overlay_0-251:{mountpoint:/var/lib/containers/storage/overlay/5a525cc42388f4fed11a0dc36822fa60a3c07342110a6c23d02b0e20c178c986/merged major:0 minor:251 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/3fa2a5398d43b38f3f047954097a3da8af07a5d65c17c7ab9f6bae63cbc15880/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/4db717ff12afefb46320e81353f4c8efff01892112f2978775787bf0bce22adf/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/e81a313606b095f35c4b320fbd9fbd309e000b1c7139b48d4e743d2046f18af9/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-272:{mountpoint:/var/lib/containers/storage/overlay/15d03a75d2de00500f52b49a210e8240e49dd4062729cc732441ecc3818faacf/merged major:0 minor:272 fsType:overlay blockSize:0} overlay_0-286:{mountpoint:/var/lib/containers/storage/overlay/8e8f6ce07b052020801d606feda8994f7952c05d8b06d380063f053bcc981c53/merged major:0 minor:286 fsType:overlay blockSize:0} overlay_0-288:{mountpoint:/var/lib/containers/storage/overlay/703d1857c472dc01cbc064a1b8430920d184bc65f959e195995f5b970d66f623/merged major:0 minor:288 fsType:overlay blockSize:0} overlay_0-290:{mountpoint:/var/lib/containers/storage/overlay/198ecbbd43bd1d8d0efa269dbc9e37abc8a78cca0451b663034c139042432c15/merged major:0 minor:290 fsType:overlay blockSize:0} overlay_0-307:{mountpoint:/var/lib/containers/storage/overlay/2098b574b7703b34805c162a12d5bb23e9b62f15c0cae6e2c3ed6390d68a7d56/merged major:0 minor:307 fsType:overlay blockSize:0} overlay_0-309:{mountpoint:/var/lib/containers/storage/overlay/55710e6df8e0c1ade74b6cd3ae792e4b9577b494ac1bf042bfded265a9d0582b/merged major:0 minor:309 fsType:overlay blockSize:0} overlay_0-311:{mountpoint:/var/lib/containers/storage/overlay/7b03f699dca956de9e44cfa2c98a4326f10b43734e2f079507054d1e7cb48649/merged major:0 minor:311 fsType:overlay blockSize:0} overlay_0-317:{mountpoint:/var/lib/containers/storage/overlay/ec270a61b6d4963ff750368b437705a7e4cdd3fc55a17cc252e629d19332d3b1/merged major:0 minor:317 fsType:overlay blockSize:0} overlay_0-335:{mountpoint:/var/lib/containers/storage/overlay/476cd4974b916c85923012efacaaf5f0f9f9217ad4aa5cb9ab7d8955f0571f01/merged major:0 minor:335 fsType:overlay blockSize:0} overlay_0-337:{mountpoint:/var/lib/containers/storage/overlay/e18d49f6f894c8f713b7aa50825d0cb1b34131856f2934d3c8f8aea9b138fd42/merged major:0 minor:337 fsType:overlay blockSize:0} overlay_0-339:{mountpoint:/var/lib/containers/storage/overlay/bdf9b68fc17fafbf01f051463f001dc280a85579ef30b9daca6f597897b808ad/merged major:0 minor:339 fsType:overlay blockSize:0} overlay_0-344:{mountpoint:/var/lib/containers/storage/overlay/cea42f42041406aa12725f5167850b05f48bad475d65e2df5209f4c624c8137d/merged major:0 minor:344 fsType:overlay blockSize:0} overlay_0-349:{mountpoint:/var/lib/containers/storage/overlay/f9e8d027969aeb89ce4a8349a77e3c393d8c02c4fffb3efc9cf8072d0fc86db5/merged major:0 minor:349 fsType:overlay blockSize:0} overlay_0-361:{mountpoint:/var/lib/containers/storage/overlay/370f5a5e717989d1f09d9d052bf731215fcc8f5154f6aedd4f340e5586990c0f/merged major:0 minor:361 fsType:overlay blockSize:0} overlay_0-363:{mountpoint:/var/lib/containers/storage/overlay/35692b9fedd9ce4afca5616f8001aede0e0478af7f74a0019ec68a87c1712e1b/merged major:0 minor:363 fsType:overlay blockSize:0} overlay_0-365:{mountpoint:/var/lib/containers/storage/overlay/c363d87a9527d810b3f86284636a76c10c82d145b28cf552f8c04fa0300d61e6/merged major:0 minor:365 fsType:overlay blockSize:0} overlay_0-371:{mountpoint:/var/lib/containers/storage/overlay/3cfb8aec425d2a0a7f9f0e9637ee5d9ab625239a893494d9e8b2a8300063550b/merged major:0 minor:371 fsType:overlay blockSize:0} overlay_0-377:{mountpoint:/var/lib/containers/storage/overlay/9035b68a11a01d14f663d835d313ee2f5b8f1fee7a9749fe00c01d39f8f3e065/merged major:0 minor:377 fsType:overlay blockSize:0} overlay_0-383:{mountpoint:/var/lib/containers/storage/overlay/f0eec098bde30bbd261098c26a336f908a63d4ab50cf627b6c4a8dd3ae498c3b/merged major:0 minor:383 fsType:overlay blockSize:0} overlay_0-399:{mountpoint:/var/lib/containers/storage/overlay/fe9946c3707ff4d6236198fbf38368b24bf1d4f3201eae4853658d76986d90d5/merged major:0 minor:399 fsType:overlay blockSize:0} overlay_0-401:{mountpoint:/var/lib/containers/storage/overlay/85acfbcf60c9c741423e2f42958e7b2045fbbbaa3f37caa67fe2045254cdb649/merged major:0 minor:401 fsType:overlay blockSize:0} overlay_0-413:{mountpoint:/var/lib/containers/storage/overlay/3aec286d9b7a804e2017c04621c148f63fc41282917c6c1be1147b9d31d28be1/merged major:0 minor:413 fsType:overlay blockSize:0} overlay_0-415:{mountpoint:/var/lib/containers/storage/overlay/2fb415fc383ee7a6f8bc68fba8ca6891587de2d081d1fb847c24ab8db65547a2/merged major:0 minor:415 fsType:overlay blockSize:0} overlay_0-417:{mountpoint:/var/lib/containers/storage/overlay/8c970ab2dc4b5cd831405edcaf91357bd983992b9fba0c9d60f419be7e95b067/merged major:0 minor:417 fsType:overlay blockSize:0} overlay_0-419:{mountpoint:/var/lib/containers/storage/overlay/29f491e58c333def4936305d6408c8357b5ba4793f6bcbffca89375d4954b9ff/merged major:0 minor:419 fsType:overlay blockSize:0} overlay_0-421:{mountpoint:/var/lib/containers/storage/overlay/2351a2dc16085d4577954bed51396e804d2acadd2c404e55e57b67ebc5c0c396/merged major:0 minor:421 fsType:overlay blockSize:0} overlay_0-427:{mountpoint:/var/lib/containers/storage/overlay/05d0a281b3351fc899cf3683401d204479e2e6f8c3dac6e754316795581bf36d/merged major:0 minor:427 fsType:overlay blockSize:0} overlay_0-432:{mountpoint:/var/lib/containers/storage/overlay/9a32068f571475eac3498b8b4dd988a633c935d7e77cbabf7527b4e2d4c592a1/merged major:0 minor:432 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/9a13ff40b99b25db21970bafe142e28063e4bd7eb5aaf7f82e4e937d3e4251ae/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/624886b2c3fd3fca03135082380fafe8c71ee7e9ffe2b9476f4d3529978d594a/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/0fe7a0a9a5674e2019a2ae29e6f64f927b68185b42263fa37fa151109900c5dc/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/7443f41fdbd1f95a041fbb99e8765043530a5d7b4ea74fe9b728e2e03868683f/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-79:{mountpoint:/var/lib/containers/storage/overlay/951c70d59356a8dabba27b213cb39bf53ee3aa0dd69f99fda82d51f762db0b9c/merged major:0 minor:79 fsType:overlay blockSize:0} overlay_0-83:{mountpoint:/var/lib/containers/storage/overlay/bed6da5f38b9b19c7ba73f56cebc3b75bd9de2cc82c3fc9a80ad4671a367c45c/merged major:0 minor:83 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/965d5ffda221e06771d0a860e912c995edbad1545e1b378b7cf37b3084b8055c/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/300c832b346f2ae9ce9a70ace720364f7a039ecf950edd59ab94965ff8cc3fdc/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/7eeaf29e833bb7af82c03eccfd5eb156003bafa36afbbee0eb60215d0f16c46b/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/e28035a200b38461162a2c18dcd85e8464b013fb0648133b9b24b5cb0e162a12/merged major:0 minor:96 fsType:overlay blockSize:0}] Oct 29 23:13:53.335538 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.334680 6029 manager.go:217] Machine: {Timestamp:2026-10-29 23:13:53.334185231 +0000 UTC m=+0.060435814 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099949 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a607c6eb2af6750524a5fa4c1b966 SystemUUID:ec2a607c-6eb2-af67-5052-4a5fa4c1b966 BootID:ff0c9569-20a2-45db-b52a-e32d18d4dba3 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/04d9d55239382b834b38a6f4c37944238b1509e14a0602fcadeb61fca0508b95/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-349 DeviceMajor:0 DeviceMinor:349 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-383 DeviceMajor:0 DeviceMinor:383 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b2a9a07d-839b-4f06-af7e-4651164dce3f/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:57 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e2317d5c-4fcc-4027-82a7-911a28143f1a/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:58 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-399 DeviceMajor:0 DeviceMinor:399 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/25755c20867e43dee9a0c733805d8732fc83331d524a3218d6ffb8c493e8cc4e/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-272 DeviceMajor:0 DeviceMinor:272 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-335 DeviceMajor:0 DeviceMinor:335 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d33591ce-f459-4bb1-8fa0-87c608b9616c/volumes/kubernetes.io~secret/secret-telemeter-client DeviceMajor:0 DeviceMinor:357 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-83 DeviceMajor:0 DeviceMinor:83 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c32e3791a6cbd50c10c65b45d2e5731b965f8cd8f24e1057902c5f3061c2b1c9/userdata/shm DeviceMajor:0 DeviceMinor:260 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/5a425c1c-3f2d-46ef-895e-0e19f7795633/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:326 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-317 DeviceMajor:0 DeviceMinor:317 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-225 DeviceMajor:0 DeviceMinor:225 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5/volumes/kubernetes.io~secret/prometheus-operator-tls DeviceMajor:0 DeviceMinor:241 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-337 DeviceMajor:0 DeviceMinor:337 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-339 DeviceMajor:0 DeviceMinor:339 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/69e14cc55a0c169ad2e87174f66daa3ea17a581045ab0bf52d3b88b92e257768/userdata/shm DeviceMajor:0 DeviceMinor:77 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-140 DeviceMajor:0 DeviceMinor:140 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/56b29c9c-9fc1-44be-834e-76724afbb2a6/volumes/kubernetes.io~projected/kube-api-access-7h5kq DeviceMajor:0 DeviceMinor:283 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-286 DeviceMajor:0 DeviceMinor:286 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-307 DeviceMajor:0 DeviceMinor:307 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/b2a9a07d-839b-4f06-af7e-4651164dce3f/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:55 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ba5f5b12df177fbc161b95aef99c135505439e298d3124ed749aaacd9c4ed5a5/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-288 DeviceMajor:0 DeviceMinor:288 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0f81a6e97ab7690b909a0f19219b64f62d9f7004b1c1218bbea4f09e584442dd/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ceb618a53abf5cc77fff88bf0bc5e0f429e55a66d8902ab495e54503b68a0710/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ae2a0c3a0041823cad6a647bb942b967685040749078f098715db9e4cdb4adb7/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/55d642655ff4479f6baaa851396b7452f17c842317163ca751c9bfdeaeb437f2/userdata/shm DeviceMajor:0 DeviceMinor:247 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f0017bc2c60bfc43e54a7237d2b242138809e4da2c89d1f2b5138fda836f19da/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-79 DeviceMajor:0 DeviceMinor:79 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-401 DeviceMajor:0 DeviceMinor:401 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b2a9a07d-839b-4f06-af7e-4651164dce3f/volumes/kubernetes.io~projected/kube-api-access-wvkrk DeviceMajor:0 DeviceMinor:63 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-309 DeviceMajor:0 DeviceMinor:309 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5a425c1c-3f2d-46ef-895e-0e19f7795633/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:322 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0234d968-7137-4520-8bd1-b26ee1f08885/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:331 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4962406a-baa9-420f-8069-98171dc6bd1d/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:388 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/56b29c9c-9fc1-44be-834e-76724afbb2a6/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:282 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-154 DeviceMajor:0 DeviceMinor:154 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e8fa71fef1d47c18629d5800716ba24d09d5b7e662016c2da87ab90415c25951/userdata/shm DeviceMajor:0 DeviceMinor:359 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4962406a-baa9-420f-8069-98171dc6bd1d/volumes/kubernetes.io~projected/kube-api-access-4nfbj DeviceMajor:0 DeviceMinor:393 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/480d690f-601d-4d63-aaf7-3717d5758230/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:397 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/14a7a4eb-db41-4943-a17f-6f2f02d55966/volumes/kubernetes.io~projected/kube-api-access-ht2fz DeviceMajor:0 DeviceMinor:203 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:257 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-417 DeviceMajor:0 DeviceMinor:417 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/db6b3223a1a717d9d45a67097fc11687afecdebae32a30f500efb4c08123b93c/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e2317d5c-4fcc-4027-82a7-911a28143f1a/volumes/kubernetes.io~projected/kube-api-access-r2brg DeviceMajor:0 DeviceMinor:62 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-249 DeviceMajor:0 DeviceMinor:249 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d33591ce-f459-4bb1-8fa0-87c608b9616c/volumes/kubernetes.io~projected/kube-api-access-nzcq7 DeviceMajor:0 DeviceMinor:358 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-427 DeviceMajor:0 DeviceMinor:427 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5/volumes/kubernetes.io~projected/kube-api-access-h9djk DeviceMajor:0 DeviceMinor:246 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8d4e3cd859ccc6f561fb644dc0678fd98627b5683ebe29bafe80e2815d69179c/userdata/shm DeviceMajor:0 DeviceMinor:329 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d33591ce-f459-4bb1-8fa0-87c608b9616c/volumes/kubernetes.io~secret/federate-client-tls DeviceMajor:0 DeviceMinor:356 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-432 DeviceMajor:0 DeviceMinor:432 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/286e0f07-4271-46b1-bca0-18ed0b12754e/volumes/kubernetes.io~projected/kube-api-access-mw5vc DeviceMajor:0 DeviceMinor:61 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb/volumes/kubernetes.io~projected/kube-api-access-bcxvh DeviceMajor:0 DeviceMinor:259 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b2187059-1391-4124-9981-0a203dfe8628/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:295 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d33591ce-f459-4bb1-8fa0-87c608b9616c/volumes/kubernetes.io~secret/telemeter-client-tls DeviceMajor:0 DeviceMinor:351 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-365 DeviceMajor:0 DeviceMinor:365 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7b4b45cd-366a-4e03-8b83-0ad02541bfd6/volumes/kubernetes.io~projected/kube-api-access-qbdwc DeviceMajor:0 DeviceMinor:64 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e2317d5c-4fcc-4027-82a7-911a28143f1a/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-236 DeviceMajor:0 DeviceMinor:236 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/7138ba89-e1c9-4c07-a833-3ba8f9a54445/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:56 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b2187059-1391-4124-9981-0a203dfe8628/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:300 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-344 DeviceMajor:0 DeviceMinor:344 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4962406a-baa9-420f-8069-98171dc6bd1d/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:392 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-415 DeviceMajor:0 DeviceMinor:415 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ffb39d83-b282-4ae6-ada1-8250e3d1273c/volumes/kubernetes.io~projected/kube-api-access-8w2ls DeviceMajor:0 DeviceMinor:60 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b2187059-1391-4124-9981-0a203dfe8628/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:302 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ec3af7c3-d20a-499e-9cf7-c743da6b8ed1/volumes/kubernetes.io~projected/kube-api-access-k6nnh DeviceMajor:0 DeviceMinor:66 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4ac381e5-012d-42c0-bfa4-1e6e313b694a/volumes/kubernetes.io~projected/kube-api-access-lxmhl DeviceMajor:0 DeviceMinor:202 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0fc5618f-b30f-45ce-b070-beed0ecbbbd9/volumes/kubernetes.io~projected/kube-api-access-vgqr9 DeviceMajor:0 DeviceMinor:204 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e8cb782e9c1be769d7148c5fbf674732f856c1c93ec4383ab35afe2299033f05/userdata/shm DeviceMajor:0 DeviceMinor:284 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/5a425c1c-3f2d-46ef-895e-0e19f7795633/volumes/kubernetes.io~projected/kube-api-access-p9rk6 DeviceMajor:0 DeviceMinor:328 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-361 DeviceMajor:0 DeviceMinor:361 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0fc5618f-b30f-45ce-b070-beed0ecbbbd9/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:197 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3c0a2af3b088b7ded81dbf2274416b38f63511542ea4b2fd9c7eb02088e8a672/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-251 DeviceMajor:0 DeviceMinor:251 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:258 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-371 DeviceMajor:0 DeviceMinor:371 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f97c977c720bad504712ebf34ec85e60e55e0d6cf9676c02b84e20d95f0e9c68/userdata/shm DeviceMajor:0 DeviceMinor:305 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5f7f2c19f4a6bf8b04fc3e695f3af25c5d392989858cc60057e43de8d3a55eef/userdata/shm DeviceMajor:0 DeviceMinor:333 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2985ea8f11c7ddad9d09de957a0c93aa4e1ea269c6f72a5b41ce66849eb8f412/userdata/shm DeviceMajor:0 DeviceMinor:394 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-413 DeviceMajor:0 DeviceMinor:413 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-419 DeviceMajor:0 DeviceMinor:419 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-290 DeviceMajor:0 DeviceMinor:290 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b2187059-1391-4124-9981-0a203dfe8628/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:301 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d33591ce-f459-4bb1-8fa0-87c608b9616c/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:355 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/697d9bfb63032b9f5833cfe4f2efa4b518fedccc7940e59fcb50be042efd75e9/userdata/shm DeviceMajor:0 DeviceMinor:403 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-421 DeviceMajor:0 DeviceMinor:421 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/14a7a4eb-db41-4943-a17f-6f2f02d55966/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:201 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f7add189-cde4-470f-a543-4dc4a91be859/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:396 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:245 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d708070e660da5e74974bb624ed25191154c10464134973b85d7d0fe759b9ba4/userdata/shm DeviceMajor:0 DeviceMinor:409 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b95b006a3bb7b3a4fcf12694a7d28e921d90d4026201db3192f5a0c086834ade/userdata/shm DeviceMajor:0 DeviceMinor:410 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/480d690f-601d-4d63-aaf7-3717d5758230/volumes/kubernetes.io~projected/kube-api-access-2zsds DeviceMajor:0 DeviceMinor:67 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/82cc95bcb4a5fd542030a9c4381b16b4004e7320696015a86238f18b81570a1a/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b2187059-1391-4124-9981-0a203dfe8628/volumes/kubernetes.io~projected/kube-api-access-cwwh4 DeviceMajor:0 DeviceMinor:304 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-311 DeviceMajor:0 DeviceMinor:311 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f2e07092-e461-46b5-a31e-8f2512b34cbd/volumes/kubernetes.io~projected/kube-api-access-cwkxq DeviceMajor:0 DeviceMinor:59 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0cfe4ce3648f45cdb974bfbddc3ddee17c5630a0b34788278232e0de08d1afc4/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b2187059-1391-4124-9981-0a203dfe8628/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:299 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/5a425c1c-3f2d-46ef-895e-0e19f7795633/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:327 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-363 DeviceMajor:0 DeviceMinor:363 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c7491f84-75c3-4286-90f9-ec4314ac5bf9/volumes/kubernetes.io~projected/kube-api-access-jfr6k DeviceMajor:0 DeviceMinor:65 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4ac381e5-012d-42c0-bfa4-1e6e313b694a/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:45 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/56b29c9c-9fc1-44be-834e-76724afbb2a6/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:277 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0234d968-7137-4520-8bd1-b26ee1f08885/volumes/kubernetes.io~projected/kube-api-access-6n6gc DeviceMajor:0 DeviceMinor:332 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8c55e8d9b8fafd3455e99b739cd513f81d5c50767e7a907aa1424655fd8787db/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b2187059-1391-4124-9981-0a203dfe8628/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:303 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-377 DeviceMajor:0 DeviceMinor:377 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f1cc6108-50e3-4a4d-855e-c4884e581e2e/volumes/kubernetes.io~projected/kube-api-access-75sml DeviceMajor:0 DeviceMinor:398 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:0cfe4ce3648f45c MacAddress:e6:ab:0a:cf:e3:9b Speed:10000 Mtu:8901} {Name:2985ea8f11c7dda MacAddress:8e:41:19:03:e5:53 Speed:10000 Mtu:8901} {Name:3c0a2af3b088b7d MacAddress:76:7f:8f:b6:5b:6a Speed:10000 Mtu:8901} {Name:55d642655ff4479 MacAddress:2e:4d:24:b6:db:45 Speed:10000 Mtu:8901} {Name:5f7f2c19f4a6bf8 MacAddress:6e:70:21:21:97:33 Speed:10000 Mtu:8901} {Name:697d9bfb63032b9 MacAddress:f6:99:e8:2d:54:c9 Speed:10000 Mtu:8901} {Name:8d4e3cd859ccc6f MacAddress:fe:b7:20:78:c5:a8 Speed:10000 Mtu:8901} {Name:b95b006a3bb7b3a MacAddress:b2:db:8a:1b:a2:0e Speed:10000 Mtu:8901} {Name:ba5f5b12df177fb MacAddress:b6:df:d5:b6:75:08 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:f9:c8:8c:c7 Speed:0 Mtu:9001} {Name:br-int MacAddress:b2:67:a9:c7:ff:51 Speed:0 Mtu:8901} {Name:c32e3791a6cbd50 MacAddress:36:06:7c:c7:68:e2 Speed:10000 Mtu:8901} {Name:d708070e660da5e MacAddress:f6:c3:6f:b8:11:55 Speed:10000 Mtu:8901} {Name:e8fa71fef1d47c1 MacAddress:ae:82:6c:75:67:2b Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:f9:c8:8c:c7 Speed:0 Mtu:9001} {Name:f97c977c720bad5 MacAddress:62:f3:fd:4d:8b:4a Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:be:ad:91:f6:d7:0e Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:ca:d0:90:35:40:ae Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 29 23:13:53.335538 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.335094 6029 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 29 23:13:53.335538 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.335144 6029 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 29 23:13:53.335538 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.335410 6029 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 29 23:13:53.335810 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.335438 6029 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-163.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 29 23:13:53.335810 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.335565 6029 topology_manager.go:143] "Creating topology manager with none policy" Oct 29 23:13:53.335810 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.335573 6029 container_manager_linux.go:311] "Creating device plugin manager" Oct 29 23:13:53.335810 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.335584 6029 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 29 23:13:53.335810 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.335606 6029 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 29 23:13:53.335810 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.335714 6029 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 29 23:13:53.336028 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.335899 6029 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 29 23:13:53.336028 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.336011 6029 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 29 23:13:53.336102 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.336059 6029 kubelet.go:493] "Attempting to sync node with API server" Oct 29 23:13:53.336102 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.336071 6029 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 29 23:13:53.336102 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.336082 6029 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 29 23:13:53.336102 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.336090 6029 kubelet.go:405] "Adding apiserver pod source" Oct 29 23:13:53.336102 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.336098 6029 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 29 23:13:53.336697 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.336682 6029 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 29 23:13:53.336697 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.336694 6029 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 29 23:13:53.337184 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.337157 6029 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 29 23:13:53.339759 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.339742 6029 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 29 23:13:53.339759 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.339757 6029 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 29 23:13:53.339899 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.339873 6029 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Oct 29 23:13:53.340076 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.340064 6029 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 29 23:13:53.340111 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.340094 6029 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 29 23:13:53.340203 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.340193 6029 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 29 23:13:53.340250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.340208 6029 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 29 23:13:53.340250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.340215 6029 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 29 23:13:53.340250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.340221 6029 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 29 23:13:53.340250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.340227 6029 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 29 23:13:53.340250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.340232 6029 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 29 23:13:53.340250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.340239 6029 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 29 23:13:53.340250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.340248 6029 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 29 23:13:53.340481 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.340256 6029 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 29 23:13:53.340481 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.340262 6029 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 29 23:13:53.340481 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.340276 6029 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 29 23:13:53.340481 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.340285 6029 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 29 23:13:53.340481 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.340311 6029 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 29 23:13:53.340481 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.340320 6029 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 29 23:13:53.343683 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.343670 6029 server.go:1263] "Started kubelet" Oct 29 23:13:53.343768 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.343740 6029 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 29 23:13:53.343864 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.343790 6029 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 29 23:13:53.344076 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.344062 6029 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 29 23:13:53.344226 ip-10-0-138-163 systemd[1]: Started Kubernetes Kubelet. Oct 29 23:13:53.344371 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.344354 6029 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 29 23:13:53.346005 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.345967 6029 server.go:317] "Adding debug handlers to kubelet server" Oct 29 23:13:53.350274 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.350068 6029 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 29 23:13:53.352227 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.352199 6029 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 29 23:13:53.352318 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:13:53.352225 6029 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-163.ec2.internal\" not found" Oct 29 23:13:53.352318 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.352266 6029 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 29 23:13:53.352318 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.352283 6029 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 29 23:13:53.352456 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.352327 6029 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-28 23:07:44 +0000 UTC" deadline="2028-04-01 18:22:52.616267993 +0000 UTC" Oct 29 23:13:53.352456 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.352347 6029 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12475h8m59.263924515s" Oct 29 23:13:53.352456 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.352354 6029 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 29 23:13:53.355046 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.354968 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d33591ce-f459-4bb1-8fa0-87c608b9616c" volumeName="kubernetes.io/configmap/d33591ce-f459-4bb1-8fa0-87c608b9616c-metrics-client-ca" seLinuxMountContext="" Oct 29 23:13:53.355046 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355037 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d33591ce-f459-4bb1-8fa0-87c608b9616c" volumeName="kubernetes.io/projected/d33591ce-f459-4bb1-8fa0-87c608b9616c-kube-api-access-nzcq7" seLinuxMountContext="" Oct 29 23:13:53.355179 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355052 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ec3af7c3-d20a-499e-9cf7-c743da6b8ed1" volumeName="kubernetes.io/configmap/ec3af7c3-d20a-499e-9cf7-c743da6b8ed1-serviceca" seLinuxMountContext="" Oct 29 23:13:53.355179 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355063 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1cc6108-50e3-4a4d-855e-c4884e581e2e" volumeName="kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml" seLinuxMountContext="" Oct 29 23:13:53.355179 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355076 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="286e0f07-4271-46b1-bca0-18ed0b12754e" volumeName="kubernetes.io/configmap/286e0f07-4271-46b1-bca0-18ed0b12754e-whereabouts-flatfile-configmap" seLinuxMountContext="" Oct 29 23:13:53.355179 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355089 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2a9a07d-839b-4f06-af7e-4651164dce3f" volumeName="kubernetes.io/projected/b2a9a07d-839b-4f06-af7e-4651164dce3f-kube-api-access-wvkrk" seLinuxMountContext="" Oct 29 23:13:53.355179 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355100 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2317d5c-4fcc-4027-82a7-911a28143f1a" volumeName="kubernetes.io/configmap/e2317d5c-4fcc-4027-82a7-911a28143f1a-ovnkube-config" seLinuxMountContext="" Oct 29 23:13:53.355179 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355112 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4962406a-baa9-420f-8069-98171dc6bd1d" volumeName="kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-oauth-serving-cert" seLinuxMountContext="" Oct 29 23:13:53.355179 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355126 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2187059-1391-4124-9981-0a203dfe8628" volumeName="kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext="" Oct 29 23:13:53.355179 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355163 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d33591ce-f459-4bb1-8fa0-87c608b9616c" volumeName="kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-secret-telemeter-client-kube-rbac-proxy-config" seLinuxMountContext="" Oct 29 23:13:53.355179 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355177 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2317d5c-4fcc-4027-82a7-911a28143f1a" volumeName="kubernetes.io/projected/e2317d5c-4fcc-4027-82a7-911a28143f1a-kube-api-access-r2brg" seLinuxMountContext="" Oct 29 23:13:53.355448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355189 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f2e07092-e461-46b5-a31e-8f2512b34cbd" volumeName="kubernetes.io/projected/f2e07092-e461-46b5-a31e-8f2512b34cbd-kube-api-access-cwkxq" seLinuxMountContext="" Oct 29 23:13:53.355448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355201 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f7add189-cde4-470f-a543-4dc4a91be859" volumeName="kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret" seLinuxMountContext="" Oct 29 23:13:53.355448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355216 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0fc5618f-b30f-45ce-b070-beed0ecbbbd9" volumeName="kubernetes.io/configmap/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-config-volume" seLinuxMountContext="" Oct 29 23:13:53.355448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355230 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3c79a781-906d-4a89-9b9e-bbe8caf7ebbb" volumeName="kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-config" seLinuxMountContext="" Oct 29 23:13:53.355448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355243 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3c79a781-906d-4a89-9b9e-bbe8caf7ebbb" volumeName="kubernetes.io/empty-dir/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-tmp" seLinuxMountContext="" Oct 29 23:13:53.355448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355263 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4ac381e5-012d-42c0-bfa4-1e6e313b694a" volumeName="kubernetes.io/secret/4ac381e5-012d-42c0-bfa4-1e6e313b694a-insights-runtime-extractor-tls" seLinuxMountContext="" Oct 29 23:13:53.355448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355274 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="56b29c9c-9fc1-44be-834e-76724afbb2a6" volumeName="kubernetes.io/projected/56b29c9c-9fc1-44be-834e-76724afbb2a6-kube-api-access-7h5kq" seLinuxMountContext="" Oct 29 23:13:53.355448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355286 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f2e07092-e461-46b5-a31e-8f2512b34cbd" volumeName="kubernetes.io/configmap/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-daemon-config" seLinuxMountContext="" Oct 29 23:13:53.355448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355298 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4962406a-baa9-420f-8069-98171dc6bd1d" volumeName="kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-trusted-ca-bundle" seLinuxMountContext="" Oct 29 23:13:53.355448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355310 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2187059-1391-4124-9981-0a203dfe8628" volumeName="kubernetes.io/configmap/b2187059-1391-4124-9981-0a203dfe8628-metrics-client-ca" seLinuxMountContext="" Oct 29 23:13:53.355448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355323 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d33591ce-f459-4bb1-8fa0-87c608b9616c" volumeName="kubernetes.io/configmap/d33591ce-f459-4bb1-8fa0-87c608b9616c-telemeter-trusted-ca-bundle" seLinuxMountContext="" Oct 29 23:13:53.355448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355335 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="286e0f07-4271-46b1-bca0-18ed0b12754e" volumeName="kubernetes.io/configmap/286e0f07-4271-46b1-bca0-18ed0b12754e-cni-binary-copy" seLinuxMountContext="" Oct 29 23:13:53.355448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355350 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3c79a781-906d-4a89-9b9e-bbe8caf7ebbb" volumeName="kubernetes.io/secret/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-oauth-config" seLinuxMountContext="" Oct 29 23:13:53.355448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355361 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="480d690f-601d-4d63-aaf7-3717d5758230" volumeName="kubernetes.io/projected/480d690f-601d-4d63-aaf7-3717d5758230-kube-api-access-2zsds" seLinuxMountContext="" Oct 29 23:13:53.355448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355373 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4962406a-baa9-420f-8069-98171dc6bd1d" volumeName="kubernetes.io/projected/4962406a-baa9-420f-8069-98171dc6bd1d-kube-api-access-4nfbj" seLinuxMountContext="" Oct 29 23:13:53.355448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355386 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="56b29c9c-9fc1-44be-834e-76724afbb2a6" volumeName="kubernetes.io/empty-dir/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-textfile" seLinuxMountContext="" Oct 29 23:13:53.355448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355398 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a425c1c-3f2d-46ef-895e-0e19f7795633" volumeName="kubernetes.io/projected/5a425c1c-3f2d-46ef-895e-0e19f7795633-kube-api-access-p9rk6" seLinuxMountContext="" Oct 29 23:13:53.355448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355417 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a425c1c-3f2d-46ef-895e-0e19f7795633" volumeName="kubernetes.io/secret/5a425c1c-3f2d-46ef-895e-0e19f7795633-secret-metrics-server-client-certs" seLinuxMountContext="" Oct 29 23:13:53.355448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355429 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7138ba89-e1c9-4c07-a833-3ba8f9a54445" volumeName="kubernetes.io/configmap/7138ba89-e1c9-4c07-a833-3ba8f9a54445-konnectivity-ca" seLinuxMountContext="" Oct 29 23:13:53.355448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355441 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0234d968-7137-4520-8bd1-b26ee1f08885" volumeName="kubernetes.io/secret/0234d968-7137-4520-8bd1-b26ee1f08885-monitoring-plugin-cert" seLinuxMountContext="" Oct 29 23:13:53.355448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355454 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="14a7a4eb-db41-4943-a17f-6f2f02d55966" volumeName="kubernetes.io/secret/14a7a4eb-db41-4943-a17f-6f2f02d55966-cert" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355468 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="286e0f07-4271-46b1-bca0-18ed0b12754e" volumeName="kubernetes.io/configmap/286e0f07-4271-46b1-bca0-18ed0b12754e-cni-sysctl-allowlist" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355484 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="56b29c9c-9fc1-44be-834e-76724afbb2a6" volumeName="kubernetes.io/configmap/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-accelerators-collector-config" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355496 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2317d5c-4fcc-4027-82a7-911a28143f1a" volumeName="kubernetes.io/secret/e2317d5c-4fcc-4027-82a7-911a28143f1a-ovn-node-metrics-cert" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355507 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ec3af7c3-d20a-499e-9cf7-c743da6b8ed1" volumeName="kubernetes.io/projected/ec3af7c3-d20a-499e-9cf7-c743da6b8ed1-kube-api-access-k6nnh" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355519 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="286e0f07-4271-46b1-bca0-18ed0b12754e" volumeName="kubernetes.io/projected/286e0f07-4271-46b1-bca0-18ed0b12754e-kube-api-access-mw5vc" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355545 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="480d690f-601d-4d63-aaf7-3717d5758230" volumeName="kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355558 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4962406a-baa9-420f-8069-98171dc6bd1d" volumeName="kubernetes.io/secret/4962406a-baa9-420f-8069-98171dc6bd1d-console-serving-cert" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355572 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a425c1c-3f2d-46ef-895e-0e19f7795633" volumeName="kubernetes.io/secret/5a425c1c-3f2d-46ef-895e-0e19f7795633-secret-metrics-server-tls" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355583 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2187059-1391-4124-9981-0a203dfe8628" volumeName="kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355594 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2187059-1391-4124-9981-0a203dfe8628" volumeName="kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355607 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ffb39d83-b282-4ae6-ada1-8250e3d1273c" volumeName="kubernetes.io/projected/ffb39d83-b282-4ae6-ada1-8250e3d1273c-kube-api-access-8w2ls" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355619 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2187059-1391-4124-9981-0a203dfe8628" volumeName="kubernetes.io/projected/b2187059-1391-4124-9981-0a203dfe8628-kube-api-access-cwwh4" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355630 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2187059-1391-4124-9981-0a203dfe8628" volumeName="kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-tls" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355643 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2187059-1391-4124-9981-0a203dfe8628" volumeName="kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-grpc-tls" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355664 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f2e07092-e461-46b5-a31e-8f2512b34cbd" volumeName="kubernetes.io/configmap/f2e07092-e461-46b5-a31e-8f2512b34cbd-cni-binary-copy" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355676 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0fc5618f-b30f-45ce-b070-beed0ecbbbd9" volumeName="kubernetes.io/empty-dir/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-tmp-dir" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355689 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4962406a-baa9-420f-8069-98171dc6bd1d" volumeName="kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-service-ca" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355704 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b4b45cd-366a-4e03-8b83-0ad02541bfd6" volumeName="kubernetes.io/configmap/7b4b45cd-366a-4e03-8b83-0ad02541bfd6-iptables-alerter-script" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355716 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b4b45cd-366a-4e03-8b83-0ad02541bfd6" volumeName="kubernetes.io/projected/7b4b45cd-366a-4e03-8b83-0ad02541bfd6-kube-api-access-qbdwc" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355727 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c7491f84-75c3-4286-90f9-ec4314ac5bf9" volumeName="kubernetes.io/empty-dir/c7491f84-75c3-4286-90f9-ec4314ac5bf9-tmp-dir" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355737 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c7491f84-75c3-4286-90f9-ec4314ac5bf9" volumeName="kubernetes.io/projected/c7491f84-75c3-4286-90f9-ec4314ac5bf9-kube-api-access-jfr6k" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355748 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3c79a781-906d-4a89-9b9e-bbe8caf7ebbb" volumeName="kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-service-ca" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355760 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3c79a781-906d-4a89-9b9e-bbe8caf7ebbb" volumeName="kubernetes.io/projected/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-kube-api-access-bcxvh" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355773 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a425c1c-3f2d-46ef-895e-0e19f7795633" volumeName="kubernetes.io/empty-dir/5a425c1c-3f2d-46ef-895e-0e19f7795633-audit-log" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355795 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7138ba89-e1c9-4c07-a833-3ba8f9a54445" volumeName="kubernetes.io/secret/7138ba89-e1c9-4c07-a833-3ba8f9a54445-agent-certs" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355805 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a425c1c-3f2d-46ef-895e-0e19f7795633" volumeName="kubernetes.io/configmap/5a425c1c-3f2d-46ef-895e-0e19f7795633-metrics-server-audit-profiles" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355834 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2a9a07d-839b-4f06-af7e-4651164dce3f" volumeName="kubernetes.io/empty-dir/b2a9a07d-839b-4f06-af7e-4651164dce3f-tmp" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355846 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d33591ce-f459-4bb1-8fa0-87c608b9616c" volumeName="kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-federate-client-tls" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355857 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2317d5c-4fcc-4027-82a7-911a28143f1a" volumeName="kubernetes.io/configmap/e2317d5c-4fcc-4027-82a7-911a28143f1a-env-overrides" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355868 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="78f5b80d-524a-4d8a-8290-8a6fd7d1faa5" volumeName="kubernetes.io/secret/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-prometheus-operator-kube-rbac-proxy-config" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355880 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0fc5618f-b30f-45ce-b070-beed0ecbbbd9" volumeName="kubernetes.io/secret/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-metrics-tls" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355892 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3c79a781-906d-4a89-9b9e-bbe8caf7ebbb" volumeName="kubernetes.io/secret/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-serving-cert" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355903 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4962406a-baa9-420f-8069-98171dc6bd1d" volumeName="kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-console-config" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355914 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4ac381e5-012d-42c0-bfa4-1e6e313b694a" volumeName="kubernetes.io/empty-dir/4ac381e5-012d-42c0-bfa4-1e6e313b694a-data-volume" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355924 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4ac381e5-012d-42c0-bfa4-1e6e313b694a" volumeName="kubernetes.io/projected/4ac381e5-012d-42c0-bfa4-1e6e313b694a-kube-api-access-lxmhl" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355935 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="56b29c9c-9fc1-44be-834e-76724afbb2a6" volumeName="kubernetes.io/configmap/56b29c9c-9fc1-44be-834e-76724afbb2a6-metrics-client-ca" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355945 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a425c1c-3f2d-46ef-895e-0e19f7795633" volumeName="kubernetes.io/configmap/5a425c1c-3f2d-46ef-895e-0e19f7795633-configmap-kubelet-serving-ca-bundle" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355957 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0fc5618f-b30f-45ce-b070-beed0ecbbbd9" volumeName="kubernetes.io/projected/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-kube-api-access-vgqr9" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355969 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3c79a781-906d-4a89-9b9e-bbe8caf7ebbb" volumeName="kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-oauth-serving-cert" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355980 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="56b29c9c-9fc1-44be-834e-76724afbb2a6" volumeName="kubernetes.io/secret/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-tls" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.355991 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="78f5b80d-524a-4d8a-8290-8a6fd7d1faa5" volumeName="kubernetes.io/configmap/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-metrics-client-ca" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356002 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="78f5b80d-524a-4d8a-8290-8a6fd7d1faa5" volumeName="kubernetes.io/secret/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-prometheus-operator-tls" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356013 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2a9a07d-839b-4f06-af7e-4651164dce3f" volumeName="kubernetes.io/empty-dir/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-tuned" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356025 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d33591ce-f459-4bb1-8fa0-87c608b9616c" volumeName="kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-secret-telemeter-client" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356036 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d33591ce-f459-4bb1-8fa0-87c608b9616c" volumeName="kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-telemeter-client-tls" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356055 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2187059-1391-4124-9981-0a203dfe8628" volumeName="kubernetes.io/empty-dir/b2187059-1391-4124-9981-0a203dfe8628-tmp" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356067 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0234d968-7137-4520-8bd1-b26ee1f08885" volumeName="kubernetes.io/projected/0234d968-7137-4520-8bd1-b26ee1f08885-kube-api-access-6n6gc" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356078 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="14a7a4eb-db41-4943-a17f-6f2f02d55966" volumeName="kubernetes.io/projected/14a7a4eb-db41-4943-a17f-6f2f02d55966-kube-api-access-ht2fz" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356089 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4962406a-baa9-420f-8069-98171dc6bd1d" volumeName="kubernetes.io/empty-dir/4962406a-baa9-420f-8069-98171dc6bd1d-tmp" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356100 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4962406a-baa9-420f-8069-98171dc6bd1d" volumeName="kubernetes.io/secret/4962406a-baa9-420f-8069-98171dc6bd1d-console-oauth-config" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356111 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4ac381e5-012d-42c0-bfa4-1e6e313b694a" volumeName="kubernetes.io/configmap/4ac381e5-012d-42c0-bfa4-1e6e313b694a-kube-rbac-proxy-cm" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356122 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2187059-1391-4124-9981-0a203dfe8628" volumeName="kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356133 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2317d5c-4fcc-4027-82a7-911a28143f1a" volumeName="kubernetes.io/configmap/e2317d5c-4fcc-4027-82a7-911a28143f1a-ovnkube-script-lib" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356144 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="56b29c9c-9fc1-44be-834e-76724afbb2a6" volumeName="kubernetes.io/secret/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-kube-rbac-proxy-config" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356154 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a425c1c-3f2d-46ef-895e-0e19f7795633" volumeName="kubernetes.io/secret/5a425c1c-3f2d-46ef-895e-0e19f7795633-client-ca-bundle" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356163 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="78f5b80d-524a-4d8a-8290-8a6fd7d1faa5" volumeName="kubernetes.io/projected/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-kube-api-access-h9djk" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356175 6029 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d33591ce-f459-4bb1-8fa0-87c608b9616c" volumeName="kubernetes.io/configmap/d33591ce-f459-4bb1-8fa0-87c608b9616c-serving-certs-ca-bundle" seLinuxMountContext="" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356186 6029 reconstruct.go:97] "Volume reconstruction finished" Oct 29 23:13:53.356313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356193 6029 reconciler.go:29] "Reconciler: start to sync state" Oct 29 23:13:53.359007 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356520 6029 factory.go:153] Registering CRI-O factory Oct 29 23:13:53.359007 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356537 6029 factory.go:223] Registration of the crio container factory successfully Oct 29 23:13:53.359007 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356582 6029 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 29 23:13:53.359007 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356591 6029 factory.go:55] Registering systemd factory Oct 29 23:13:53.359007 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356598 6029 factory.go:223] Registration of the systemd container factory successfully Oct 29 23:13:53.359007 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356612 6029 factory.go:103] Registering Raw factory Oct 29 23:13:53.359007 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356627 6029 manager.go:1199] Started watching for new ooms in manager Oct 29 23:13:53.359007 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.356963 6029 manager.go:319] Starting recovery of all containers Oct 29 23:13:53.379696 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.379645 6029 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 29 23:13:53.381291 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.381265 6029 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 29 23:13:53.381291 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.381289 6029 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 29 23:13:53.381469 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.381314 6029 kubelet.go:2521] "Starting kubelet main sync loop" Oct 29 23:13:53.381469 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:13:53.381354 6029 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 29 23:13:53.394575 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.394538 6029 generic.go:356] "Generic (PLEG): container finished" podID="56b29c9c-9fc1-44be-834e-76724afbb2a6" containerID="0a51bce31ead94584d7ca1d9f479f9491977cfdf301463e82de6d5dcf6f6cf73" exitCode=0 Oct 29 23:13:53.402937 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.402914 6029 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Oct 29 23:13:53.403909 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.403884 6029 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:13:53.404131 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.404105 6029 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:13:53.411455 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.411431 6029 generic.go:356] "Generic (PLEG): container finished" podID="286e0f07-4271-46b1-bca0-18ed0b12754e" containerID="010a0e1c5053aca9e17231dcad9e19409540c9206ecb3acc6d92fb47825e89f7" exitCode=0 Oct 29 23:13:53.411537 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.411451 6029 generic.go:356] "Generic (PLEG): container finished" podID="286e0f07-4271-46b1-bca0-18ed0b12754e" containerID="5d73985664637eea83ea52d08ce8454e3911874fcadbae7a849be7ae746e5c00" exitCode=0 Oct 29 23:13:53.411537 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.411468 6029 generic.go:356] "Generic (PLEG): container finished" podID="286e0f07-4271-46b1-bca0-18ed0b12754e" containerID="0bd3b24991303e3d4f822ea09b07c4235b8c4082e7483a15893fd6f859fcf6fd" exitCode=0 Oct 29 23:13:53.411537 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.411476 6029 generic.go:356] "Generic (PLEG): container finished" podID="286e0f07-4271-46b1-bca0-18ed0b12754e" containerID="6e6ea7f62bc1e222bb152f09d48442ab02ac27fd0821768b23f07fd6f013e478" exitCode=0 Oct 29 23:13:53.411537 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.411482 6029 generic.go:356] "Generic (PLEG): container finished" podID="286e0f07-4271-46b1-bca0-18ed0b12754e" containerID="164ef08b6dee5b9ee3e865ed303b995bc223e52b649942b20273d13f7bc3d405" exitCode=0 Oct 29 23:13:53.411537 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.411487 6029 generic.go:356] "Generic (PLEG): container finished" podID="286e0f07-4271-46b1-bca0-18ed0b12754e" containerID="333336c07a4b3bbd7cfe7105681ea8f64a663c48d0cf76ae1151abc9e9f403aa" exitCode=0 Oct 29 23:13:53.428104 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.428070 6029 generic.go:356] "Generic (PLEG): container finished" podID="b0bfae2a96103ad8818ab15e83f094e2" containerID="146f82fa852187897bcd3bae9991518dabef2375adaa72067cf0b10bb1369d4c" exitCode=0 Oct 29 23:13:53.429239 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.429216 6029 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:13:53.429741 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.429717 6029 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:13:53.465541 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.465464 6029 manager.go:324] Recovery completed Oct 29 23:13:53.481476 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:13:53.481435 6029 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Oct 29 23:13:53.487843 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.487803 6029 cpu_manager.go:226] "Starting" policy="none" Oct 29 23:13:53.487843 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.487835 6029 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 29 23:13:53.488013 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.487855 6029 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 29 23:13:53.488045 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.488017 6029 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Oct 29 23:13:53.488088 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.488033 6029 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Oct 29 23:13:53.488088 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.488066 6029 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Oct 29 23:13:53.488088 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.488074 6029 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Oct 29 23:13:53.488088 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.488082 6029 policy_none.go:50] "Start" Oct 29 23:13:53.488189 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.488095 6029 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 29 23:13:53.488189 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.488109 6029 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 29 23:13:53.488243 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.488235 6029 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Oct 29 23:13:53.488271 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.488242 6029 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Oct 29 23:13:53.488271 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.488248 6029 policy_none.go:44] "Start" Oct 29 23:13:53.492761 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.492733 6029 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 29 23:13:53.495349 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.495337 6029 manager.go:341] "Starting Device Plugin manager" Oct 29 23:13:53.496397 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:13:53.495364 6029 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 29 23:13:53.496444 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.496401 6029 server.go:87] "Starting device plugin registration server" Oct 29 23:13:53.496662 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.496652 6029 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 29 23:13:53.496693 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.496668 6029 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 29 23:13:53.496778 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.496759 6029 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 29 23:13:53.496909 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.496878 6029 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 29 23:13:53.496964 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.496916 6029 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 29 23:13:53.496964 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.496923 6029 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 29 23:13:53.497056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.496982 6029 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-29T23:13:53.496906414Z","UUID":"01dc700a-cfb6-4140-9594-875fa4f49971","Handler":null,"Name":"","Endpoint":""} Oct 29 23:13:53.499106 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:13:53.499077 6029 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 29 23:13:53.499292 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.499275 6029 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 29 23:13:53.499356 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.499315 6029 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 29 23:13:53.597017 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.596975 6029 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:13:53.599008 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.598984 6029 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:13:53.599098 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.599024 6029 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:13:53.599098 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.599037 6029 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:13:53.599098 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.599080 6029 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-138-163.ec2.internal" Oct 29 23:13:53.635063 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.635025 6029 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-138-163.ec2.internal" Oct 29 23:13:53.635207 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.635113 6029 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-138-163.ec2.internal" Oct 29 23:13:53.682079 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.682023 6029 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal"] Oct 29 23:13:53.682716 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.682700 6029 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Oct 29 23:13:53.682804 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.682743 6029 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" Oct 29 23:13:53.682804 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.682755 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" event={"ID":"b0bfae2a96103ad8818ab15e83f094e2","Type":"ContainerStarted","Data":"ef6dd3be7c123efb050edc726b786afcb1aef8d6b87ed74fd9d250895fb9426b"} Oct 29 23:13:53.682887 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.682836 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" event={"ID":"b0bfae2a96103ad8818ab15e83f094e2","Type":"ContainerDied","Data":"146f82fa852187897bcd3bae9991518dabef2375adaa72067cf0b10bb1369d4c"} Oct 29 23:13:53.682887 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.682860 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" event={"ID":"b0bfae2a96103ad8818ab15e83f094e2","Type":"ContainerStarted","Data":"db6b3223a1a717d9d45a67097fc11687afecdebae32a30f500efb4c08123b93c"} Oct 29 23:13:53.682887 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.682875 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" event={"ID":"d854221abd6c4396f6ea6f6c004dea85","Type":"ContainerStarted","Data":"f1c7a1a453e05e1f9b68ff6409d4043c525a3a0b83c730a44eb2f4ad55467654"} Oct 29 23:13:53.682972 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.682890 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" event={"ID":"d854221abd6c4396f6ea6f6c004dea85","Type":"ContainerStarted","Data":"0f81a6e97ab7690b909a0f19219b64f62d9f7004b1c1218bbea4f09e584442dd"} Oct 29 23:13:53.707051 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.707011 6029 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 29 23:13:53.707108 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:13:53.707081 6029 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-138-163.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" Oct 29 23:13:53.707576 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.707560 6029 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 29 23:13:53.707620 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:13:53.707602 6029 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Oct 29 23:13:53.803991 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.803962 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b0bfae2a96103ad8818ab15e83f094e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal\" (UID: \"b0bfae2a96103ad8818ab15e83f094e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Oct 29 23:13:53.804098 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.803994 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0bfae2a96103ad8818ab15e83f094e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal\" (UID: \"b0bfae2a96103ad8818ab15e83f094e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Oct 29 23:13:53.804098 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.804022 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d854221abd6c4396f6ea6f6c004dea85-config\") pod \"kube-apiserver-proxy-ip-10-0-138-163.ec2.internal\" (UID: \"d854221abd6c4396f6ea6f6c004dea85\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" Oct 29 23:13:53.904708 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.904671 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b0bfae2a96103ad8818ab15e83f094e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal\" (UID: \"b0bfae2a96103ad8818ab15e83f094e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Oct 29 23:13:53.904708 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.904712 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0bfae2a96103ad8818ab15e83f094e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal\" (UID: \"b0bfae2a96103ad8818ab15e83f094e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Oct 29 23:13:53.904952 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.904730 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d854221abd6c4396f6ea6f6c004dea85-config\") pod \"kube-apiserver-proxy-ip-10-0-138-163.ec2.internal\" (UID: \"d854221abd6c4396f6ea6f6c004dea85\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" Oct 29 23:13:53.904952 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.904770 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d854221abd6c4396f6ea6f6c004dea85-config\") pod \"kube-apiserver-proxy-ip-10-0-138-163.ec2.internal\" (UID: \"d854221abd6c4396f6ea6f6c004dea85\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" Oct 29 23:13:53.904952 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.904807 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b0bfae2a96103ad8818ab15e83f094e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal\" (UID: \"b0bfae2a96103ad8818ab15e83f094e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Oct 29 23:13:53.904952 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:53.904810 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0bfae2a96103ad8818ab15e83f094e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal\" (UID: \"b0bfae2a96103ad8818ab15e83f094e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Oct 29 23:13:54.337129 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.337098 6029 apiserver.go:52] "Watching apiserver" Oct 29 23:13:54.380310 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.380276 6029 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 29 23:13:54.380965 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.380939 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal","openshift-network-diagnostics/network-check-target-xnlbj","kube-system/global-pull-secret-syncer-4ctmg","openshift-monitoring/metrics-server-67998684c5-whnlb","openshift-monitoring/prometheus-operator-9cd89b74c-m47cv","openshift-insights/insights-runtime-extractor-smjz7","openshift-console/console-68bc6cfb6b-tw8lp","openshift-image-registry/node-ca-l59n4","openshift-ingress-canary/ingress-canary-pqwqb","openshift-network-operator/iptables-alerter-pdsvg","openshift-ovn-kubernetes/ovnkube-node-zbltb","openshift-dns/node-resolver-k9bgk","openshift-monitoring/monitoring-plugin-77f4f76594-rpk9s","openshift-monitoring/node-exporter-pz649","openshift-monitoring/telemeter-client-775f4c9db-dqrhs","openshift-multus/multus-additional-cni-plugins-psb28","openshift-multus/multus-sk9hv","openshift-multus/network-metrics-daemon-l78hj","kube-system/konnectivity-agent-vnmw9","kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp","openshift-cluster-node-tuning-operator/tuned-btfzv","openshift-console/console-7848849768-qnlvb","openshift-dns/dns-default-sxpxx"] Oct 29 23:13:54.397966 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.397931 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2vcdm\"" Oct 29 23:13:54.398128 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.397986 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-t8tv9\"" Oct 29 23:13:54.398128 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.398077 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8km5l\"" Oct 29 23:13:54.398275 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.398258 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 29 23:13:54.398433 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.398415 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-89z4k\"" Oct 29 23:13:54.399428 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.399408 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 29 23:13:54.399560 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.399431 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 29 23:13:54.399616 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.399597 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 29 23:13:54.399690 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.399669 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-pgvzg\"" Oct 29 23:13:54.399742 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.399732 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 29 23:13:54.399884 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.399863 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-phkn8\"" Oct 29 23:13:54.399973 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.399957 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 29 23:13:54.400025 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.399898 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 29 23:13:54.400159 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.400135 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 29 23:13:54.400219 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.400209 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 29 23:13:54.400287 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.400246 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 29 23:13:54.400287 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.400276 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hwcbb\"" Oct 29 23:13:54.400433 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.400418 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 29 23:13:54.400482 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.400424 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 29 23:13:54.400543 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.400428 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 29 23:13:54.400631 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.400547 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 29 23:13:54.400763 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.400588 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 29 23:13:54.411678 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.411658 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Oct 29 23:13:54.411783 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.411686 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qbkzf\"" Oct 29 23:13:54.411783 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.411705 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 29 23:13:54.411783 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.411740 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 29 23:13:54.414859 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.414834 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 29 23:13:54.414980 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.414890 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9w58g\"" Oct 29 23:13:54.415069 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.414979 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Oct 29 23:13:54.415360 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.415341 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 29 23:13:54.415452 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.415393 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 29 23:13:54.415452 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.415404 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 29 23:13:54.415581 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.415465 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 29 23:13:54.415651 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.415581 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 29 23:13:54.415711 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.415660 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Oct 29 23:13:54.415711 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.415701 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-tpq4z\"" Oct 29 23:13:54.415784 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.415766 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Oct 29 23:13:54.415862 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.415849 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 29 23:13:54.415918 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.415888 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Oct 29 23:13:54.415918 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.415914 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Oct 29 23:13:54.416041 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.415955 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Oct 29 23:13:54.416041 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.415968 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-lzfjg\"" Oct 29 23:13:54.416041 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.415997 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Oct 29 23:13:54.416041 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416021 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Oct 29 23:13:54.416041 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416027 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 29 23:13:54.416041 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416033 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Oct 29 23:13:54.416041 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416036 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Oct 29 23:13:54.416399 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416092 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 29 23:13:54.416399 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416097 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 29 23:13:54.416399 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416102 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Oct 29 23:13:54.416399 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416146 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-j6t55\"" Oct 29 23:13:54.416399 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416151 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7zkzr\"" Oct 29 23:13:54.416399 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416173 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 29 23:13:54.416399 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416183 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 29 23:13:54.416399 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416203 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Oct 29 23:13:54.416399 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416240 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 29 23:13:54.416399 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416258 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 29 23:13:54.416399 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416260 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 29 23:13:54.416399 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416281 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 29 23:13:54.416399 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416347 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-sx9m6\"" Oct 29 23:13:54.416399 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416358 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Oct 29 23:13:54.416399 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416345 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 29 23:13:54.416399 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416349 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 29 23:13:54.417079 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416446 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vwjx7\"" Oct 29 23:13:54.417079 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416471 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gnrh6\"" Oct 29 23:13:54.417079 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416484 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Oct 29 23:13:54.417079 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416492 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Oct 29 23:13:54.417079 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416514 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Oct 29 23:13:54.417079 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416538 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Oct 29 23:13:54.417079 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416657 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 29 23:13:54.417079 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416725 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 29 23:13:54.417079 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416729 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Oct 29 23:13:54.417079 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416767 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-tn89s\"" Oct 29 23:13:54.417079 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416873 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jb6zf\"" Oct 29 23:13:54.417079 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416887 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 29 23:13:54.417079 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416901 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 29 23:13:54.417079 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416930 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 29 23:13:54.417079 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.416974 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tldxj\"" Oct 29 23:13:54.417079 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.417000 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 29 23:13:54.417079 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.417077 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Oct 29 23:13:54.417698 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.417111 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Oct 29 23:13:54.417698 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.417153 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4i2ilsknuqmej\"" Oct 29 23:13:54.417698 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.417184 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pnrbh\"" Oct 29 23:13:54.417698 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.417215 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Oct 29 23:13:54.417698 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.417263 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-fqhm4\"" Oct 29 23:13:54.417698 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.417261 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Oct 29 23:13:54.417698 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.417305 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Oct 29 23:13:54.424948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.424918 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4i3e2rd218q0m\"" Oct 29 23:13:54.425027 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.424952 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 29 23:13:54.425027 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.424957 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 29 23:13:54.425027 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.424953 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 29 23:13:54.425027 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.424952 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 29 23:13:54.425027 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.424989 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-gj5kk\"" Oct 29 23:13:54.428962 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.428947 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 29 23:13:54.430066 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.430047 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\"" Oct 29 23:13:54.430159 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.430143 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Oct 29 23:13:54.447494 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.447474 6029 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Oct 29 23:13:54.447584 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.447572 6029 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" Oct 29 23:13:54.454536 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.454517 6029 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 29 23:13:54.486791 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.486767 6029 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 29 23:13:54.486896 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:13:54.486835 6029 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-138-163.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" Oct 29 23:13:54.488363 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.488348 6029 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 29 23:13:54.488422 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:13:54.488387 6029 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Oct 29 23:13:54.507097 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507073 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56b29c9c-9fc1-44be-834e-76724afbb2a6-sys\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:54.507165 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507106 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5a425c1c-3f2d-46ef-895e-0e19f7795633-secret-metrics-server-client-certs\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:54.507165 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507125 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6nnh\" (UniqueName: \"kubernetes.io/projected/ec3af7c3-d20a-499e-9cf7-c743da6b8ed1-kube-api-access-k6nnh\") pod \"node-ca-l59n4\" (UID: \"ec3af7c3-d20a-499e-9cf7-c743da6b8ed1\") " pod="openshift-image-registry/node-ca-l59n4" Oct 29 23:13:54.507165 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507142 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h5kq\" (UniqueName: \"kubernetes.io/projected/56b29c9c-9fc1-44be-834e-76724afbb2a6-kube-api-access-7h5kq\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:54.507255 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507195 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-socket-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:13:54.507297 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507250 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c7491f84-75c3-4286-90f9-ec4314ac5bf9-hosts-file\") pod \"node-resolver-k9bgk\" (UID: \"c7491f84-75c3-4286-90f9-ec4314ac5bf9\") " pod="openshift-dns/node-resolver-k9bgk" Oct 29 23:13:54.507383 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507368 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgqr9\" (UniqueName: \"kubernetes.io/projected/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-kube-api-access-vgqr9\") pod \"dns-default-sxpxx\" (UID: \"0fc5618f-b30f-45ce-b070-beed0ecbbbd9\") " pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:54.507426 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507411 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ac381e5-012d-42c0-bfa4-1e6e313b694a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:54.507479 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507448 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/286e0f07-4271-46b1-bca0-18ed0b12754e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:13:54.507524 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507483 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5a425c1c-3f2d-46ef-895e-0e19f7795633-secret-metrics-server-client-certs\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:54.507627 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507486 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-serving-cert\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:54.507627 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507568 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0234d968-7137-4520-8bd1-b26ee1f08885-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-rpk9s\" (UID: \"0234d968-7137-4520-8bd1-b26ee1f08885\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-rpk9s" Oct 29 23:13:54.507627 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507596 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nfbj\" (UniqueName: \"kubernetes.io/projected/4962406a-baa9-420f-8069-98171dc6bd1d-kube-api-access-4nfbj\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:54.507627 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507628 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zsds\" (UniqueName: \"kubernetes.io/projected/480d690f-601d-4d63-aaf7-3717d5758230-kube-api-access-2zsds\") pod \"network-metrics-daemon-l78hj\" (UID: \"480d690f-601d-4d63-aaf7-3717d5758230\") " pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:13:54.507863 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507646 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ac381e5-012d-42c0-bfa4-1e6e313b694a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:54.507863 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507660 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7add189-cde4-470f-a543-4dc4a91be859-kubelet-config\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:54.507863 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507694 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw5vc\" (UniqueName: \"kubernetes.io/projected/286e0f07-4271-46b1-bca0-18ed0b12754e-kube-api-access-mw5vc\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:13:54.507863 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507707 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-serving-cert\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:54.507863 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507719 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-var-lib-openvswitch\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.507863 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507746 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d33591ce-f459-4bb1-8fa0-87c608b9616c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:54.507863 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507772 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7491f84-75c3-4286-90f9-ec4314ac5bf9-tmp-dir\") pod \"node-resolver-k9bgk\" (UID: \"c7491f84-75c3-4286-90f9-ec4314ac5bf9\") " pod="openshift-dns/node-resolver-k9bgk" Oct 29 23:13:54.507863 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507800 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:54.508221 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507891 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7491f84-75c3-4286-90f9-ec4314ac5bf9-tmp-dir\") pod \"node-resolver-k9bgk\" (UID: \"c7491f84-75c3-4286-90f9-ec4314ac5bf9\") " pod="openshift-dns/node-resolver-k9bgk" Oct 29 23:13:54.508221 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507895 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0234d968-7137-4520-8bd1-b26ee1f08885-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-rpk9s\" (UID: \"0234d968-7137-4520-8bd1-b26ee1f08885\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-rpk9s" Oct 29 23:13:54.508221 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507939 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/286e0f07-4271-46b1-bca0-18ed0b12754e-cnibin\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:13:54.508221 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507964 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec3af7c3-d20a-499e-9cf7-c743da6b8ed1-serviceca\") pod \"node-ca-l59n4\" (UID: \"ec3af7c3-d20a-499e-9cf7-c743da6b8ed1\") " pod="openshift-image-registry/node-ca-l59n4" Oct 29 23:13:54.508221 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.507992 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-systemd-units\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.508221 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508048 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:54.508221 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508111 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.508221 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508177 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e2317d5c-4fcc-4027-82a7-911a28143f1a-env-overrides\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.508221 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508223 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ac381e5-012d-42c0-bfa4-1e6e313b694a-crio-socket\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:54.508659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508242 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75sml\" (UniqueName: \"kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml\") pod \"network-check-target-xnlbj\" (UID: \"f1cc6108-50e3-4a4d-855e-c4884e581e2e\") " pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:13:54.508659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508263 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-conf-dir\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.508659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508291 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-slash\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.508659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508399 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec3af7c3-d20a-499e-9cf7-c743da6b8ed1-host\") pod \"node-ca-l59n4\" (UID: \"ec3af7c3-d20a-499e-9cf7-c743da6b8ed1\") " pod="openshift-image-registry/node-ca-l59n4" Oct 29 23:13:54.508659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508424 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14a7a4eb-db41-4943-a17f-6f2f02d55966-cert\") pod \"ingress-canary-pqwqb\" (UID: \"14a7a4eb-db41-4943-a17f-6f2f02d55966\") " pod="openshift-ingress-canary/ingress-canary-pqwqb" Oct 29 23:13:54.508659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508420 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e2317d5c-4fcc-4027-82a7-911a28143f1a-env-overrides\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.508659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508451 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-device-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:13:54.508659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508524 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-grpc-tls\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:54.508659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508552 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d33591ce-f459-4bb1-8fa0-87c608b9616c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:54.508659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508562 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-sys\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.508659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508625 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14a7a4eb-db41-4943-a17f-6f2f02d55966-cert\") pod \"ingress-canary-pqwqb\" (UID: \"14a7a4eb-db41-4943-a17f-6f2f02d55966\") " pod="openshift-ingress-canary/ingress-canary-pqwqb" Oct 29 23:13:54.508659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508638 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec3af7c3-d20a-499e-9cf7-c743da6b8ed1-serviceca\") pod \"node-ca-l59n4\" (UID: \"ec3af7c3-d20a-499e-9cf7-c743da6b8ed1\") " pod="openshift-image-registry/node-ca-l59n4" Oct 29 23:13:54.509257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508674 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2a9a07d-839b-4f06-af7e-4651164dce3f-tmp\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.509257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508727 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2a9a07d-839b-4f06-af7e-4651164dce3f-tmp\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.509257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508748 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxmhl\" (UniqueName: \"kubernetes.io/projected/4ac381e5-012d-42c0-bfa4-1e6e313b694a-kube-api-access-lxmhl\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:54.509257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508760 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-grpc-tls\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:54.509257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508769 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9djk\" (UniqueName: \"kubernetes.io/projected/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-kube-api-access-h9djk\") pod \"prometheus-operator-9cd89b74c-m47cv\" (UID: \"78f5b80d-524a-4d8a-8290-8a6fd7d1faa5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" Oct 29 23:13:54.509257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508785 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzcq7\" (UniqueName: \"kubernetes.io/projected/d33591ce-f459-4bb1-8fa0-87c608b9616c-kube-api-access-nzcq7\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:54.509257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508836 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7138ba89-e1c9-4c07-a833-3ba8f9a54445-konnectivity-ca\") pod \"konnectivity-agent-vnmw9\" (UID: \"7138ba89-e1c9-4c07-a833-3ba8f9a54445\") " pod="kube-system/konnectivity-agent-vnmw9" Oct 29 23:13:54.509257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508856 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-etc-selinux\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:13:54.509257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508877 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-sys-fs\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:13:54.509257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508893 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5a425c1c-3f2d-46ef-895e-0e19f7795633-audit-log\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:54.509257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508939 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfr6k\" (UniqueName: \"kubernetes.io/projected/c7491f84-75c3-4286-90f9-ec4314ac5bf9-kube-api-access-jfr6k\") pod \"node-resolver-k9bgk\" (UID: \"c7491f84-75c3-4286-90f9-ec4314ac5bf9\") " pod="openshift-dns/node-resolver-k9bgk" Oct 29 23:13:54.509257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508961 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-var-lib-kubelet\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.509257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.508977 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-run-systemd\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.509257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509002 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:54.509257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509028 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-kubernetes\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.509257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509040 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5a425c1c-3f2d-46ef-895e-0e19f7795633-audit-log\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:54.509257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509125 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7138ba89-e1c9-4c07-a833-3ba8f9a54445-konnectivity-ca\") pod \"konnectivity-agent-vnmw9\" (UID: \"7138ba89-e1c9-4c07-a833-3ba8f9a54445\") " pod="kube-system/konnectivity-agent-vnmw9" Oct 29 23:13:54.509257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509148 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-daemon-config\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.509257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509177 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-run-netns\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.509257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509199 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-m47cv\" (UID: \"78f5b80d-524a-4d8a-8290-8a6fd7d1faa5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" Oct 29 23:13:54.509257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509214 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-tmp\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:54.509257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509242 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a425c1c-3f2d-46ef-895e-0e19f7795633-client-ca-bundle\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:54.509257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509233 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509277 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwwh4\" (UniqueName: \"kubernetes.io/projected/b2187059-1391-4124-9981-0a203dfe8628-kube-api-access-cwwh4\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509306 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-hostroot\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509315 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-tmp\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509320 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-daemon-config\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509335 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d33591ce-f459-4bb1-8fa0-87c608b9616c-serving-certs-ca-bundle\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509360 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-cni-dir\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509392 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-etc-kubernetes\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509412 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7138ba89-e1c9-4c07-a833-3ba8f9a54445-agent-certs\") pod \"konnectivity-agent-vnmw9\" (UID: \"7138ba89-e1c9-4c07-a833-3ba8f9a54445\") " pod="kube-system/konnectivity-agent-vnmw9" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509418 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-m47cv\" (UID: \"78f5b80d-524a-4d8a-8290-8a6fd7d1faa5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509455 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a425c1c-3f2d-46ef-895e-0e19f7795633-client-ca-bundle\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509455 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509512 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509549 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-cnibin\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509573 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e2317d5c-4fcc-4027-82a7-911a28143f1a-ovnkube-script-lib\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509620 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7138ba89-e1c9-4c07-a833-3ba8f9a54445-agent-certs\") pod \"konnectivity-agent-vnmw9\" (UID: \"7138ba89-e1c9-4c07-a833-3ba8f9a54445\") " pod="kube-system/konnectivity-agent-vnmw9" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509636 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d33591ce-f459-4bb1-8fa0-87c608b9616c-serving-certs-ca-bundle\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509648 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4962406a-baa9-420f-8069-98171dc6bd1d-console-serving-cert\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509728 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509739 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-oauth-serving-cert\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509800 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e2317d5c-4fcc-4027-82a7-911a28143f1a-ovnkube-script-lib\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509824 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-tls\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509918 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwkxq\" (UniqueName: \"kubernetes.io/projected/f2e07092-e461-46b5-a31e-8f2512b34cbd-kube-api-access-cwkxq\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509929 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-oauth-serving-cert\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509942 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d33591ce-f459-4bb1-8fa0-87c608b9616c-metrics-client-ca\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509958 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcxvh\" (UniqueName: \"kubernetes.io/projected/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-kube-api-access-bcxvh\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509995 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4962406a-baa9-420f-8069-98171dc6bd1d-console-serving-cert\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.509989 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-textfile\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.510057 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-textfile\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.510084 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-tls\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.510097 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-systemd\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.510135 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-service-ca\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.510155 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-kubelet\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.510149 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d33591ce-f459-4bb1-8fa0-87c608b9616c-metrics-client-ca\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.510175 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-run-ovn-kubernetes\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.510204 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-system-cni-dir\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.510226 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-m47cv\" (UID: \"78f5b80d-524a-4d8a-8290-8a6fd7d1faa5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.510255 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-federate-client-tls\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.510278 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-service-ca\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:54.510285 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.510300 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7add189-cde4-470f-a543-4dc4a91be859-dbus\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.510401 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-config-volume\") pod \"dns-default-sxpxx\" (UID: \"0fc5618f-b30f-45ce-b070-beed0ecbbbd9\") " pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.510416 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-m47cv\" (UID: \"78f5b80d-524a-4d8a-8290-8a6fd7d1faa5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.510441 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-metrics-tls\") pod \"dns-default-sxpxx\" (UID: \"0fc5618f-b30f-45ce-b070-beed0ecbbbd9\") " pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.510761 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-federate-client-tls\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.510777 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-modprobe-d\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.510911 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-run-multus-certs\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.510926 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-metrics-tls\") pod \"dns-default-sxpxx\" (UID: \"0fc5618f-b30f-45ce-b070-beed0ecbbbd9\") " pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.510965 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-config-volume\") pod \"dns-default-sxpxx\" (UID: \"0fc5618f-b30f-45ce-b070-beed0ecbbbd9\") " pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.510969 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-node-log\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511051 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e2317d5c-4fcc-4027-82a7-911a28143f1a-ovn-node-metrics-cert\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511144 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4962406a-baa9-420f-8069-98171dc6bd1d-console-oauth-config\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511178 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5a425c1c-3f2d-46ef-895e-0e19f7795633-secret-metrics-server-tls\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511210 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs\") pod \"network-metrics-daemon-l78hj\" (UID: \"480d690f-601d-4d63-aaf7-3717d5758230\") " pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511233 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ac381e5-012d-42c0-bfa4-1e6e313b694a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511266 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511301 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-service-ca\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511331 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w2ls\" (UniqueName: \"kubernetes.io/projected/ffb39d83-b282-4ae6-ada1-8250e3d1273c-kube-api-access-8w2ls\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511347 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e2317d5c-4fcc-4027-82a7-911a28143f1a-ovn-node-metrics-cert\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511356 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9rk6\" (UniqueName: \"kubernetes.io/projected/5a425c1c-3f2d-46ef-895e-0e19f7795633-kube-api-access-p9rk6\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511408 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b4b45cd-366a-4e03-8b83-0ad02541bfd6-iptables-alerter-script\") pod \"iptables-alerter-pdsvg\" (UID: \"7b4b45cd-366a-4e03-8b83-0ad02541bfd6\") " pod="openshift-network-operator/iptables-alerter-pdsvg" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511447 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvkrk\" (UniqueName: \"kubernetes.io/projected/b2a9a07d-839b-4f06-af7e-4651164dce3f-kube-api-access-wvkrk\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511483 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-socket-dir-parent\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511512 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-sysconfig\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511546 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-run-netns\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511581 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-var-lib-cni-multus\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511617 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/286e0f07-4271-46b1-bca0-18ed0b12754e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511655 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n6gc\" (UniqueName: \"kubernetes.io/projected/0234d968-7137-4520-8bd1-b26ee1f08885-kube-api-access-6n6gc\") pod \"monitoring-plugin-77f4f76594-rpk9s\" (UID: \"0234d968-7137-4520-8bd1-b26ee1f08885\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-rpk9s" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511684 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-oauth-serving-cert\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511719 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-secret-telemeter-client\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511753 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5a425c1c-3f2d-46ef-895e-0e19f7795633-metrics-server-audit-profiles\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511789 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4962406a-baa9-420f-8069-98171dc6bd1d-console-oauth-config\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511809 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b4b45cd-366a-4e03-8b83-0ad02541bfd6-host-slash\") pod \"iptables-alerter-pdsvg\" (UID: \"7b4b45cd-366a-4e03-8b83-0ad02541bfd6\") " pod="openshift-network-operator/iptables-alerter-pdsvg" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511857 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/286e0f07-4271-46b1-bca0-18ed0b12754e-cni-binary-copy\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:13:54.511948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.511904 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-m47cv\" (UID: \"78f5b80d-524a-4d8a-8290-8a6fd7d1faa5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512007 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a425c1c-3f2d-46ef-895e-0e19f7795633-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512073 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-registration-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512099 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5a425c1c-3f2d-46ef-895e-0e19f7795633-secret-metrics-server-tls\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512155 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-host\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512185 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-run-k8s-cni-cncf-io\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512221 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-run-openvswitch\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512255 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-log-socket\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512288 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-cni-bin\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512289 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-m47cv\" (UID: \"78f5b80d-524a-4d8a-8290-8a6fd7d1faa5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512326 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-telemeter-client-tls\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512351 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-secret-telemeter-client\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512368 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ac381e5-012d-42c0-bfa4-1e6e313b694a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512511 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-service-ca\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512517 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/286e0f07-4271-46b1-bca0-18ed0b12754e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512566 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512604 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-var-lib-kubelet\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512643 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-var-lib-cni-bin\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512681 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-etc-openvswitch\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512693 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-oauth-serving-cert\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512710 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-run\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512720 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5a425c1c-3f2d-46ef-895e-0e19f7795633-metrics-server-audit-profiles\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512744 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-tuned\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512751 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a425c1c-3f2d-46ef-895e-0e19f7795633-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512846 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-tuned\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512967 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/286e0f07-4271-46b1-bca0-18ed0b12754e-cni-binary-copy\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.513000 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.512999 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-tls\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.513041 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.513053 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-wtmp\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.513092 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-console-config\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.513126 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.513183 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-sysctl-d\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.513227 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-tls\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.513236 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/286e0f07-4271-46b1-bca0-18ed0b12754e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.513243 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-telemeter-client-tls\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.513271 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht2fz\" (UniqueName: \"kubernetes.io/projected/14a7a4eb-db41-4943-a17f-6f2f02d55966-kube-api-access-ht2fz\") pod \"ingress-canary-pqwqb\" (UID: \"14a7a4eb-db41-4943-a17f-6f2f02d55966\") " pod="openshift-ingress-canary/ingress-canary-pqwqb" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.513303 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7add189-cde4-470f-a543-4dc4a91be859-original-pull-secret\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.513404 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b4b45cd-366a-4e03-8b83-0ad02541bfd6-iptables-alerter-script\") pod \"iptables-alerter-pdsvg\" (UID: \"7b4b45cd-366a-4e03-8b83-0ad02541bfd6\") " pod="openshift-network-operator/iptables-alerter-pdsvg" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.513470 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-console-config\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:54.513568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.513497 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/286e0f07-4271-46b1-bca0-18ed0b12754e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.513600 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-config\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.513639 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-run-ovn\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.513674 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e2317d5c-4fcc-4027-82a7-911a28143f1a-ovnkube-config\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.513711 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-trusted-ca-bundle\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.513742 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbdwc\" (UniqueName: \"kubernetes.io/projected/7b4b45cd-366a-4e03-8b83-0ad02541bfd6-kube-api-access-qbdwc\") pod \"iptables-alerter-pdsvg\" (UID: \"7b4b45cd-366a-4e03-8b83-0ad02541bfd6\") " pod="openshift-network-operator/iptables-alerter-pdsvg" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.513747 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/480d690f-601d-4d63-aaf7-3717d5758230-metrics-certs\") pod \"network-metrics-daemon-l78hj\" (UID: \"480d690f-601d-4d63-aaf7-3717d5758230\") " pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.513773 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2187059-1391-4124-9981-0a203dfe8628-tmp\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.513806 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2e07092-e461-46b5-a31e-8f2512b34cbd-cni-binary-copy\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.514299 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2e07092-e461-46b5-a31e-8f2512b34cbd-cni-binary-copy\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.514361 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-config\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.514510 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e2317d5c-4fcc-4027-82a7-911a28143f1a-ovnkube-config\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.514555 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2brg\" (UniqueName: \"kubernetes.io/projected/e2317d5c-4fcc-4027-82a7-911a28143f1a-kube-api-access-r2brg\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.514587 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4962406a-baa9-420f-8069-98171dc6bd1d-tmp\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.514619 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2187059-1391-4124-9981-0a203dfe8628-metrics-client-ca\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.514669 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-sysctl-conf\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.514683 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-trusted-ca-bundle\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.514695 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/286e0f07-4271-46b1-bca0-18ed0b12754e-system-cni-dir\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.514727 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-cni-netd\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.514756 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56b29c9c-9fc1-44be-834e-76724afbb2a6-root\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.514768 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4962406a-baa9-420f-8069-98171dc6bd1d-tmp\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.514789 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ac381e5-012d-42c0-bfa4-1e6e313b694a-data-volume\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.514840 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-lib-modules\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.514854 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2187059-1391-4124-9981-0a203dfe8628-tmp\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.514873 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-oauth-config\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.514904 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56b29c9c-9fc1-44be-834e-76724afbb2a6-metrics-client-ca\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.514935 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.514968 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.514996 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-tmp-dir\") pod \"dns-default-sxpxx\" (UID: \"0fc5618f-b30f-45ce-b070-beed0ecbbbd9\") " pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.515149 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ac381e5-012d-42c0-bfa4-1e6e313b694a-data-volume\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.515287 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56b29c9c-9fc1-44be-834e-76724afbb2a6-metrics-client-ca\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:54.515359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.515342 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-oauth-config\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:54.516669 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.515492 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b2187059-1391-4124-9981-0a203dfe8628-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:54.516669 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.515556 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2187059-1391-4124-9981-0a203dfe8628-metrics-client-ca\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:54.516669 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.515684 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d33591ce-f459-4bb1-8fa0-87c608b9616c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:54.516669 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.515697 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-tmp-dir\") pod \"dns-default-sxpxx\" (UID: \"0fc5618f-b30f-45ce-b070-beed0ecbbbd9\") " pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:54.528590 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.528561 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfr6k\" (UniqueName: \"kubernetes.io/projected/c7491f84-75c3-4286-90f9-ec4314ac5bf9-kube-api-access-jfr6k\") pod \"node-resolver-k9bgk\" (UID: \"c7491f84-75c3-4286-90f9-ec4314ac5bf9\") " pod="openshift-dns/node-resolver-k9bgk" Oct 29 23:13:54.528688 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.528592 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6nnh\" (UniqueName: \"kubernetes.io/projected/ec3af7c3-d20a-499e-9cf7-c743da6b8ed1-kube-api-access-k6nnh\") pod \"node-ca-l59n4\" (UID: \"ec3af7c3-d20a-499e-9cf7-c743da6b8ed1\") " pod="openshift-image-registry/node-ca-l59n4" Oct 29 23:13:54.528688 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.528628 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgqr9\" (UniqueName: \"kubernetes.io/projected/0fc5618f-b30f-45ce-b070-beed0ecbbbd9-kube-api-access-vgqr9\") pod \"dns-default-sxpxx\" (UID: \"0fc5618f-b30f-45ce-b070-beed0ecbbbd9\") " pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:54.530486 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.530467 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zsds\" (UniqueName: \"kubernetes.io/projected/480d690f-601d-4d63-aaf7-3717d5758230-kube-api-access-2zsds\") pod \"network-metrics-daemon-l78hj\" (UID: \"480d690f-601d-4d63-aaf7-3717d5758230\") " pod="openshift-multus/network-metrics-daemon-l78hj" Oct 29 23:13:54.530596 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.530488 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw5vc\" (UniqueName: \"kubernetes.io/projected/286e0f07-4271-46b1-bca0-18ed0b12754e-kube-api-access-mw5vc\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:13:54.530742 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.530723 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzcq7\" (UniqueName: \"kubernetes.io/projected/d33591ce-f459-4bb1-8fa0-87c608b9616c-kube-api-access-nzcq7\") pod \"telemeter-client-775f4c9db-dqrhs\" (UID: \"d33591ce-f459-4bb1-8fa0-87c608b9616c\") " pod="openshift-monitoring/telemeter-client-775f4c9db-dqrhs" Oct 29 23:13:54.531008 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.530991 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9djk\" (UniqueName: \"kubernetes.io/projected/78f5b80d-524a-4d8a-8290-8a6fd7d1faa5-kube-api-access-h9djk\") pod \"prometheus-operator-9cd89b74c-m47cv\" (UID: \"78f5b80d-524a-4d8a-8290-8a6fd7d1faa5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-m47cv" Oct 29 23:13:54.532044 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.532027 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75sml\" (UniqueName: \"kubernetes.io/projected/f1cc6108-50e3-4a4d-855e-c4884e581e2e-kube-api-access-75sml\") pod \"network-check-target-xnlbj\" (UID: \"f1cc6108-50e3-4a4d-855e-c4884e581e2e\") " pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:13:54.532211 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.532194 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwwh4\" (UniqueName: \"kubernetes.io/projected/b2187059-1391-4124-9981-0a203dfe8628-kube-api-access-cwwh4\") pod \"thanos-querier-cdc79c9f7-2lxzb\" (UID: \"b2187059-1391-4124-9981-0a203dfe8628\") " pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:54.532298 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.532283 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nfbj\" (UniqueName: \"kubernetes.io/projected/4962406a-baa9-420f-8069-98171dc6bd1d-kube-api-access-4nfbj\") pod \"console-68bc6cfb6b-tw8lp\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:54.532552 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.532533 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxmhl\" (UniqueName: \"kubernetes.io/projected/4ac381e5-012d-42c0-bfa4-1e6e313b694a-kube-api-access-lxmhl\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:54.532587 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.532561 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h5kq\" (UniqueName: \"kubernetes.io/projected/56b29c9c-9fc1-44be-834e-76724afbb2a6-kube-api-access-7h5kq\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:54.534348 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.534332 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9rk6\" (UniqueName: \"kubernetes.io/projected/5a425c1c-3f2d-46ef-895e-0e19f7795633-kube-api-access-p9rk6\") pod \"metrics-server-67998684c5-whnlb\" (UID: \"5a425c1c-3f2d-46ef-895e-0e19f7795633\") " pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:13:54.535414 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.535395 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w2ls\" (UniqueName: \"kubernetes.io/projected/ffb39d83-b282-4ae6-ada1-8250e3d1273c-kube-api-access-8w2ls\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:13:54.535480 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.535465 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwkxq\" (UniqueName: \"kubernetes.io/projected/f2e07092-e461-46b5-a31e-8f2512b34cbd-kube-api-access-cwkxq\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.535512 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.535494 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcxvh\" (UniqueName: \"kubernetes.io/projected/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-kube-api-access-bcxvh\") pod \"console-7848849768-qnlvb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:54.535562 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.535533 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n6gc\" (UniqueName: \"kubernetes.io/projected/0234d968-7137-4520-8bd1-b26ee1f08885-kube-api-access-6n6gc\") pod \"monitoring-plugin-77f4f76594-rpk9s\" (UID: \"0234d968-7137-4520-8bd1-b26ee1f08885\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-rpk9s" Oct 29 23:13:54.536039 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.536022 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvkrk\" (UniqueName: \"kubernetes.io/projected/b2a9a07d-839b-4f06-af7e-4651164dce3f-kube-api-access-wvkrk\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.536665 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.536645 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht2fz\" (UniqueName: \"kubernetes.io/projected/14a7a4eb-db41-4943-a17f-6f2f02d55966-kube-api-access-ht2fz\") pod \"ingress-canary-pqwqb\" (UID: \"14a7a4eb-db41-4943-a17f-6f2f02d55966\") " pod="openshift-ingress-canary/ingress-canary-pqwqb" Oct 29 23:13:54.536726 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.536673 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbdwc\" (UniqueName: \"kubernetes.io/projected/7b4b45cd-366a-4e03-8b83-0ad02541bfd6-kube-api-access-qbdwc\") pod \"iptables-alerter-pdsvg\" (UID: \"7b4b45cd-366a-4e03-8b83-0ad02541bfd6\") " pod="openshift-network-operator/iptables-alerter-pdsvg" Oct 29 23:13:54.537405 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.537389 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2brg\" (UniqueName: \"kubernetes.io/projected/e2317d5c-4fcc-4027-82a7-911a28143f1a-kube-api-access-r2brg\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.577963 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.577937 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7848849768-qnlvb"] Oct 29 23:13:54.615694 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.615622 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-socket-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:13:54.615694 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.615655 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c7491f84-75c3-4286-90f9-ec4314ac5bf9-hosts-file\") pod \"node-resolver-k9bgk\" (UID: \"c7491f84-75c3-4286-90f9-ec4314ac5bf9\") " pod="openshift-dns/node-resolver-k9bgk" Oct 29 23:13:54.615694 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.615673 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/286e0f07-4271-46b1-bca0-18ed0b12754e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:13:54.615910 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.615738 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c7491f84-75c3-4286-90f9-ec4314ac5bf9-hosts-file\") pod \"node-resolver-k9bgk\" (UID: \"c7491f84-75c3-4286-90f9-ec4314ac5bf9\") " pod="openshift-dns/node-resolver-k9bgk" Oct 29 23:13:54.615910 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.615749 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-socket-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:13:54.615910 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.615790 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/286e0f07-4271-46b1-bca0-18ed0b12754e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:13:54.615910 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.615794 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7add189-cde4-470f-a543-4dc4a91be859-kubelet-config\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:54.615910 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.615901 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7add189-cde4-470f-a543-4dc4a91be859-kubelet-config\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:54.616073 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.615942 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-var-lib-openvswitch\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.616073 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.615977 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/286e0f07-4271-46b1-bca0-18ed0b12754e-cnibin\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:13:54.616073 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616016 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-systemd-units\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.616073 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616030 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-var-lib-openvswitch\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.616073 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616049 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.616073 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616064 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-systemd-units\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.616263 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616085 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ac381e5-012d-42c0-bfa4-1e6e313b694a-crio-socket\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:54.616263 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616052 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/286e0f07-4271-46b1-bca0-18ed0b12754e-cnibin\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:13:54.616263 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616114 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-conf-dir\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.616263 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616085 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.616263 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616138 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-slash\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.616263 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616142 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ac381e5-012d-42c0-bfa4-1e6e313b694a-crio-socket\") pod \"insights-runtime-extractor-smjz7\" (UID: \"4ac381e5-012d-42c0-bfa4-1e6e313b694a\") " pod="openshift-insights/insights-runtime-extractor-smjz7" Oct 29 23:13:54.616263 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616168 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec3af7c3-d20a-499e-9cf7-c743da6b8ed1-host\") pod \"node-ca-l59n4\" (UID: \"ec3af7c3-d20a-499e-9cf7-c743da6b8ed1\") " pod="openshift-image-registry/node-ca-l59n4" Oct 29 23:13:54.616263 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616176 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-conf-dir\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.616263 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616193 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-device-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:13:54.616263 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616217 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-sys\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.616263 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616222 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec3af7c3-d20a-499e-9cf7-c743da6b8ed1-host\") pod \"node-ca-l59n4\" (UID: \"ec3af7c3-d20a-499e-9cf7-c743da6b8ed1\") " pod="openshift-image-registry/node-ca-l59n4" Oct 29 23:13:54.616263 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616250 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-device-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:13:54.616263 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616258 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-etc-selinux\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616287 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-sys\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616287 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-sys-fs\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616320 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-var-lib-kubelet\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616329 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-sys-fs\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616288 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-slash\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616330 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-etc-selinux\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616365 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-run-systemd\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616391 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-kubernetes\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616413 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-var-lib-kubelet\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616416 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-run-netns\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616439 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-run-systemd\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616456 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-kubernetes\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616475 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-hostroot\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616477 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-run-netns\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616509 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-cni-dir\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616522 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-hostroot\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616524 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-etc-kubernetes\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616547 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-etc-kubernetes\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616562 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-cni-dir\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616567 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616592 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-cnibin\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616630 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616631 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-systemd\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616658 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-kubelet\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616673 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-run-ovn-kubernetes\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616677 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-systemd\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.616701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616695 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-system-cni-dir\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616717 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7add189-cde4-470f-a543-4dc4a91be859-dbus\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616734 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-run-ovn-kubernetes\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616735 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-cnibin\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616735 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-modprobe-d\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616718 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-kubelet\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616765 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-run-multus-certs\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616788 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-node-log\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616831 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-modprobe-d\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616836 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-socket-dir-parent\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616831 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7add189-cde4-470f-a543-4dc4a91be859-dbus\") pod \"global-pull-secret-syncer-4ctmg\" (UID: \"f7add189-cde4-470f-a543-4dc4a91be859\") " pod="kube-system/global-pull-secret-syncer-4ctmg" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616838 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-node-log\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616856 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-run-multus-certs\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616881 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-sysconfig\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616888 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-multus-socket-dir-parent\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616786 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-system-cni-dir\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616918 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-run-netns\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616950 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-var-lib-cni-multus\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616959 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-sysconfig\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.616986 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-run-netns\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617043 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-var-lib-cni-multus\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617051 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b4b45cd-366a-4e03-8b83-0ad02541bfd6-host-slash\") pod \"iptables-alerter-pdsvg\" (UID: \"7b4b45cd-366a-4e03-8b83-0ad02541bfd6\") " pod="openshift-network-operator/iptables-alerter-pdsvg" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617071 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-registration-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617086 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-host\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617102 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-run-k8s-cni-cncf-io\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617117 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-run-openvswitch\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617131 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-log-socket\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617151 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-cni-bin\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617157 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b4b45cd-366a-4e03-8b83-0ad02541bfd6-host-slash\") pod \"iptables-alerter-pdsvg\" (UID: \"7b4b45cd-366a-4e03-8b83-0ad02541bfd6\") " pod="openshift-network-operator/iptables-alerter-pdsvg" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617163 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-host\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617151 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ffb39d83-b282-4ae6-ada1-8250e3d1273c-registration-dir\") pod \"aws-ebs-csi-driver-node-g2vpp\" (UID: \"ffb39d83-b282-4ae6-ada1-8250e3d1273c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g2vpp" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617174 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-run-k8s-cni-cncf-io\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617198 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-log-socket\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617206 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-cni-bin\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617216 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-var-lib-kubelet\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617177 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-var-lib-kubelet\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617227 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-run-openvswitch\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617247 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-var-lib-cni-bin\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617269 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-etc-openvswitch\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617288 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-run\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617314 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-wtmp\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617320 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2e07092-e461-46b5-a31e-8f2512b34cbd-host-var-lib-cni-bin\") pod \"multus-sk9hv\" (UID: \"f2e07092-e461-46b5-a31e-8f2512b34cbd\") " pod="openshift-multus/multus-sk9hv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617341 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-sysctl-d\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617350 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-run\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617370 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-run-ovn\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617370 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56b29c9c-9fc1-44be-834e-76724afbb2a6-node-exporter-wtmp\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617395 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-sysctl-conf\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617342 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-etc-openvswitch\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617413 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/286e0f07-4271-46b1-bca0-18ed0b12754e-system-cni-dir\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617427 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-cni-netd\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617440 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-run-ovn\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617447 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56b29c9c-9fc1-44be-834e-76724afbb2a6-root\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617449 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-sysctl-d\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617470 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/286e0f07-4271-46b1-bca0-18ed0b12754e-system-cni-dir\") pod \"multus-additional-cni-plugins-psb28\" (UID: \"286e0f07-4271-46b1-bca0-18ed0b12754e\") " pod="openshift-multus/multus-additional-cni-plugins-psb28" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617481 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-lib-modules\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617484 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e2317d5c-4fcc-4027-82a7-911a28143f1a-host-cni-netd\") pod \"ovnkube-node-zbltb\" (UID: \"e2317d5c-4fcc-4027-82a7-911a28143f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617512 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56b29c9c-9fc1-44be-834e-76724afbb2a6-sys\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617520 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-etc-sysctl-conf\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617484 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56b29c9c-9fc1-44be-834e-76724afbb2a6-root\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617578 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56b29c9c-9fc1-44be-834e-76724afbb2a6-sys\") pod \"node-exporter-pz649\" (UID: \"56b29c9c-9fc1-44be-834e-76724afbb2a6\") " pod="openshift-monitoring/node-exporter-pz649" Oct 29 23:13:54.617681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:54.617601 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2a9a07d-839b-4f06-af7e-4651164dce3f-lib-modules\") pod \"tuned-btfzv\" (UID: \"b2a9a07d-839b-4f06-af7e-4651164dce3f\") " pod="openshift-cluster-node-tuning-operator/tuned-btfzv" Oct 29 23:13:55.548251 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:55.548217 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:55.988489 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:55.988413 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sxpxx" Oct 29 23:13:56.296044 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:56.296013 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-cdc79c9f7-2lxzb" Oct 29 23:13:56.456866 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:56.456829 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:13:57.151258 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:57.151221 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:13:57.980599 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:57.980568 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:13:57.980785 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:13:57.980771 6029 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 29 23:14:00.525923 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:00.525887 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:14:00.607766 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:00.607736 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:14:03.218600 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:03.218567 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-rpk9s" Oct 29 23:14:03.560613 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:03.560589 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vnmw9" Oct 29 23:14:04.241713 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:04.241680 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zbltb" Oct 29 23:14:04.250437 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:04.250409 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-67998684c5-whnlb" Oct 29 23:14:07.156860 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.156831 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:14:07.160557 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.160540 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:14:07.389444 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.389415 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b7677896b-lsd4m"] Oct 29 23:14:07.393566 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.393546 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.415290 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.415230 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b7677896b-lsd4m"] Oct 29 23:14:07.525992 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.525954 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5040504a-5fef-4715-986f-dcee46b75258-trusted-ca-bundle\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.525992 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.525996 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pzvf\" (UniqueName: \"kubernetes.io/projected/5040504a-5fef-4715-986f-dcee46b75258-kube-api-access-8pzvf\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.526197 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.526016 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5040504a-5fef-4715-986f-dcee46b75258-tmp\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.526197 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.526034 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5040504a-5fef-4715-986f-dcee46b75258-service-ca\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.526197 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.526177 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5040504a-5fef-4715-986f-dcee46b75258-console-config\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.526294 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.526227 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5040504a-5fef-4715-986f-dcee46b75258-console-serving-cert\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.526294 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.526246 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5040504a-5fef-4715-986f-dcee46b75258-oauth-serving-cert\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.526294 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.526281 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5040504a-5fef-4715-986f-dcee46b75258-console-oauth-config\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.627590 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.627555 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pzvf\" (UniqueName: \"kubernetes.io/projected/5040504a-5fef-4715-986f-dcee46b75258-kube-api-access-8pzvf\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.627590 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.627591 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5040504a-5fef-4715-986f-dcee46b75258-tmp\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.627794 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.627608 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5040504a-5fef-4715-986f-dcee46b75258-service-ca\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.627794 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.627721 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5040504a-5fef-4715-986f-dcee46b75258-console-config\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.627941 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.627800 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5040504a-5fef-4715-986f-dcee46b75258-console-serving-cert\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.627941 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.627851 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5040504a-5fef-4715-986f-dcee46b75258-oauth-serving-cert\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.627941 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.627920 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5040504a-5fef-4715-986f-dcee46b75258-console-oauth-config\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.628105 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.628005 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5040504a-5fef-4715-986f-dcee46b75258-trusted-ca-bundle\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.628105 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.628055 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5040504a-5fef-4715-986f-dcee46b75258-tmp\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.628368 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.628348 6029 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 29 23:14:07.628521 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.628489 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5040504a-5fef-4715-986f-dcee46b75258-console-config\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.628716 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.628696 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5040504a-5fef-4715-986f-dcee46b75258-oauth-serving-cert\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.628853 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.628811 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5040504a-5fef-4715-986f-dcee46b75258-trusted-ca-bundle\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.628953 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.628919 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5040504a-5fef-4715-986f-dcee46b75258-service-ca\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.630460 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.630441 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5040504a-5fef-4715-986f-dcee46b75258-console-serving-cert\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.630700 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.630679 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5040504a-5fef-4715-986f-dcee46b75258-console-oauth-config\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.648974 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.648946 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pzvf\" (UniqueName: \"kubernetes.io/projected/5040504a-5fef-4715-986f-dcee46b75258-kube-api-access-8pzvf\") pod \"console-5b7677896b-lsd4m\" (UID: \"5040504a-5fef-4715-986f-dcee46b75258\") " pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.703484 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.703397 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:07.999148 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:07.999005 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b7677896b-lsd4m"] Oct 29 23:14:08.001434 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:14:08.001403 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5040504a_5fef_4715_986f_dcee46b75258.slice/crio-6264fef2a999a9c5b09bd81eb2b9f872ae04fa1a7dca726ae4dd980b60acf9d2 WatchSource:0}: Error finding container 6264fef2a999a9c5b09bd81eb2b9f872ae04fa1a7dca726ae4dd980b60acf9d2: Status 404 returned error can't find the container with id 6264fef2a999a9c5b09bd81eb2b9f872ae04fa1a7dca726ae4dd980b60acf9d2 Oct 29 23:14:08.496501 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:08.496414 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b7677896b-lsd4m" event={"ID":"5040504a-5fef-4715-986f-dcee46b75258","Type":"ContainerStarted","Data":"c91812f11ec6fd46aa6867bdc350db6cbad1488aaa7b5a80e7695e5c0b596939"} Oct 29 23:14:08.496501 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:08.496477 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b7677896b-lsd4m" event={"ID":"5040504a-5fef-4715-986f-dcee46b75258","Type":"ContainerStarted","Data":"6264fef2a999a9c5b09bd81eb2b9f872ae04fa1a7dca726ae4dd980b60acf9d2"} Oct 29 23:14:08.538297 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:08.538157 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5b7677896b-lsd4m" podStartSLOduration=1.538140012 podStartE2EDuration="1.538140012s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:14:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:14:08.537878116 +0000 UTC m=+15.264128708" watchObservedRunningTime="2026-10-29 23:14:08.538140012 +0000 UTC m=+15.264390605" Oct 29 23:14:08.920509 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:14:08.920472 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:14:11.986232 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:11.986193 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 29 23:14:11.989788 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:11.989765 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.005180 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.005138 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 29 23:14:12.017995 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.017961 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Oct 29 23:14:12.018151 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.017961 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Oct 29 23:14:12.018151 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.017959 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Oct 29 23:14:12.018151 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.017997 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Oct 29 23:14:12.018151 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.018000 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Oct 29 23:14:12.018151 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.018015 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Oct 29 23:14:12.018151 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.018021 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Oct 29 23:14:12.021795 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.021778 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Oct 29 23:14:12.044937 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.044902 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vvv78\"" Oct 29 23:14:12.044937 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.044937 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Oct 29 23:14:12.063055 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.063024 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1af73798-70be-4b5a-ae99-96a2b4d9727c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.063200 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.063061 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1af73798-70be-4b5a-ae99-96a2b4d9727c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.063200 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.063079 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccl9b\" (UniqueName: \"kubernetes.io/projected/1af73798-70be-4b5a-ae99-96a2b4d9727c-kube-api-access-ccl9b\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.063200 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.063143 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1af73798-70be-4b5a-ae99-96a2b4d9727c-config-out\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.063315 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.063262 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1af73798-70be-4b5a-ae99-96a2b4d9727c-config-volume\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.063315 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.063286 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1af73798-70be-4b5a-ae99-96a2b4d9727c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.063315 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.063307 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1af73798-70be-4b5a-ae99-96a2b4d9727c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.063438 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.063334 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1af73798-70be-4b5a-ae99-96a2b4d9727c-web-config\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.063438 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.063399 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1af73798-70be-4b5a-ae99-96a2b4d9727c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.063519 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.063456 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1af73798-70be-4b5a-ae99-96a2b4d9727c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.063519 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.063484 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1af73798-70be-4b5a-ae99-96a2b4d9727c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.063519 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.063507 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1af73798-70be-4b5a-ae99-96a2b4d9727c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.063621 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.063524 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1af73798-70be-4b5a-ae99-96a2b4d9727c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.164275 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.164237 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1af73798-70be-4b5a-ae99-96a2b4d9727c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.164275 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.164281 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1af73798-70be-4b5a-ae99-96a2b4d9727c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.164479 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.164408 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1af73798-70be-4b5a-ae99-96a2b4d9727c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.164479 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.164445 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1af73798-70be-4b5a-ae99-96a2b4d9727c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.164576 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.164556 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1af73798-70be-4b5a-ae99-96a2b4d9727c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.164628 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.164613 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1af73798-70be-4b5a-ae99-96a2b4d9727c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.164682 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.164643 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccl9b\" (UniqueName: \"kubernetes.io/projected/1af73798-70be-4b5a-ae99-96a2b4d9727c-kube-api-access-ccl9b\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.164733 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.164678 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1af73798-70be-4b5a-ae99-96a2b4d9727c-config-out\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.164733 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.164717 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1af73798-70be-4b5a-ae99-96a2b4d9727c-config-volume\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.164880 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.164755 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1af73798-70be-4b5a-ae99-96a2b4d9727c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.164880 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.164795 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1af73798-70be-4b5a-ae99-96a2b4d9727c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.164880 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.164860 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1af73798-70be-4b5a-ae99-96a2b4d9727c-web-config\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.165030 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.164888 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1af73798-70be-4b5a-ae99-96a2b4d9727c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.165030 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.164967 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1af73798-70be-4b5a-ae99-96a2b4d9727c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.165333 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.165291 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1af73798-70be-4b5a-ae99-96a2b4d9727c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.167933 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.167850 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1af73798-70be-4b5a-ae99-96a2b4d9727c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.167933 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.167869 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1af73798-70be-4b5a-ae99-96a2b4d9727c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.167933 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.167869 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1af73798-70be-4b5a-ae99-96a2b4d9727c-config-out\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.168167 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.167953 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1af73798-70be-4b5a-ae99-96a2b4d9727c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.168167 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.168037 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1af73798-70be-4b5a-ae99-96a2b4d9727c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.168282 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.168187 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1af73798-70be-4b5a-ae99-96a2b4d9727c-config-volume\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.168282 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.168266 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1af73798-70be-4b5a-ae99-96a2b4d9727c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.168698 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.168670 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1af73798-70be-4b5a-ae99-96a2b4d9727c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.168777 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.168763 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1af73798-70be-4b5a-ae99-96a2b4d9727c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.169904 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.169883 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1af73798-70be-4b5a-ae99-96a2b4d9727c-web-config\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.185583 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.185561 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccl9b\" (UniqueName: \"kubernetes.io/projected/1af73798-70be-4b5a-ae99-96a2b4d9727c-kube-api-access-ccl9b\") pod \"alertmanager-main-0\" (UID: \"1af73798-70be-4b5a-ae99-96a2b4d9727c\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.315410 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.315372 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:12.644453 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:12.644423 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 29 23:14:12.645439 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:14:12.645418 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1af73798_70be_4b5a_ae99_96a2b4d9727c.slice/crio-bc2d387091b5f49083fb343f09d40ca013a131d2fa85ca6bb1cc86865beec9c6 WatchSource:0}: Error finding container bc2d387091b5f49083fb343f09d40ca013a131d2fa85ca6bb1cc86865beec9c6: Status 404 returned error can't find the container with id bc2d387091b5f49083fb343f09d40ca013a131d2fa85ca6bb1cc86865beec9c6 Oct 29 23:14:13.514862 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:13.514809 6029 generic.go:356] "Generic (PLEG): container finished" podID="1af73798-70be-4b5a-ae99-96a2b4d9727c" containerID="cc5a472016c93f48b60f33548501febafb329f5d1a7140ab637d39e5c733d4ac" exitCode=0 Oct 29 23:14:13.515302 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:13.514878 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1af73798-70be-4b5a-ae99-96a2b4d9727c","Type":"ContainerDied","Data":"cc5a472016c93f48b60f33548501febafb329f5d1a7140ab637d39e5c733d4ac"} Oct 29 23:14:13.515302 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:13.514970 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1af73798-70be-4b5a-ae99-96a2b4d9727c","Type":"ContainerStarted","Data":"bc2d387091b5f49083fb343f09d40ca013a131d2fa85ca6bb1cc86865beec9c6"} Oct 29 23:14:13.516307 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:13.516288 6029 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 29 23:14:15.527261 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:15.527231 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1af73798-70be-4b5a-ae99-96a2b4d9727c","Type":"ContainerStarted","Data":"69429df287ba9eb31199651997ad3c1942d4753f1febba643f58dcae68700c77"} Oct 29 23:14:15.527646 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:15.527290 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1af73798-70be-4b5a-ae99-96a2b4d9727c","Type":"ContainerStarted","Data":"95a180f26c79a15d85d5e0ce61fe6149273cba6bb9ae502b9d861da963420901"} Oct 29 23:14:15.527646 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:15.527316 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1af73798-70be-4b5a-ae99-96a2b4d9727c","Type":"ContainerStarted","Data":"2810cd54feab532c188324d5aa2b36116f62792081b36ba976ff099f9efc561d"} Oct 29 23:14:15.527646 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:15.527340 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1af73798-70be-4b5a-ae99-96a2b4d9727c","Type":"ContainerStarted","Data":"6d0b2882e56e125d5f5cd1081f1ff35292f23807ddd7338fbc0f997e6f94d06f"} Oct 29 23:14:15.527646 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:15.527366 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1af73798-70be-4b5a-ae99-96a2b4d9727c","Type":"ContainerStarted","Data":"f0794fdea3f95a3a8c1d2636988192ac744e54a452c5307faa63089c9778696e"} Oct 29 23:14:15.527646 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:15.527390 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1af73798-70be-4b5a-ae99-96a2b4d9727c","Type":"ContainerStarted","Data":"b7254c43892cbc8a9f564ea36f609f268ba88833786cb6e2b0f75a2d72abcf8b"} Oct 29 23:14:15.605446 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:15.605374 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.2314304 podStartE2EDuration="4.605354803s" totalImagesPullingTime="1.361314786s" totalInitContainerRuntime="12.609617ms" isStatefulPod=false podCreationTimestamp="2026-10-29 23:14:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:14:15.605008564 +0000 UTC m=+22.331259181" watchObservedRunningTime="2026-10-29 23:14:15.605354803 +0000 UTC m=+22.331605397" Oct 29 23:14:17.704145 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:17.704100 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:17.704656 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:17.704174 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:17.709054 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:17.709033 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:18.545357 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:18.545326 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b7677896b-lsd4m" Oct 29 23:14:18.626978 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:18.626952 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68bc6cfb6b-tw8lp"] Oct 29 23:14:20.469960 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:20.469915 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-7848849768-qnlvb" podUID="3c79a781-906d-4a89-9b9e-bbe8caf7ebbb" containerName="console" containerID="cri-o://4af6fa9a3063fca68f0e64a5a64190b9e1cca1457d4d7d9b11bab9fa5370fc61" gracePeriod=15 Oct 29 23:14:20.706683 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:20.706660 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:14:20.741362 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:20.741289 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-oauth-config\") pod \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " Oct 29 23:14:20.741362 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:20.741330 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-oauth-serving-cert\") pod \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " Oct 29 23:14:20.741362 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:20.741352 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-serving-cert\") pod \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " Oct 29 23:14:20.741609 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:20.741375 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-service-ca\") pod \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " Oct 29 23:14:20.741609 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:20.741412 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-config\" (UniqueName: \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-config\") pod \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " Oct 29 23:14:20.741609 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:20.741455 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-kube-api-access-bcxvh\" (UniqueName: \"kubernetes.io/projected/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-kube-api-access-bcxvh\") pod \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " Oct 29 23:14:20.741609 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:20.741510 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-tmp\") pod \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\" (UID: \"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb\") " Oct 29 23:14:20.741961 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:20.741859 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-oauth-serving-cert" pod "3c79a781-906d-4a89-9b9e-bbe8caf7ebbb" (UID: "3c79a781-906d-4a89-9b9e-bbe8caf7ebbb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:14:20.742108 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:20.741963 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-config" pod "3c79a781-906d-4a89-9b9e-bbe8caf7ebbb" (UID: "3c79a781-906d-4a89-9b9e-bbe8caf7ebbb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:14:20.742108 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:20.741971 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-service-ca" pod "3c79a781-906d-4a89-9b9e-bbe8caf7ebbb" (UID: "3c79a781-906d-4a89-9b9e-bbe8caf7ebbb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:14:20.742108 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:20.741943 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-tmp" pod "3c79a781-906d-4a89-9b9e-bbe8caf7ebbb" (UID: "3c79a781-906d-4a89-9b9e-bbe8caf7ebbb"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:14:20.743758 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:20.743736 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-oauth-config" pod "3c79a781-906d-4a89-9b9e-bbe8caf7ebbb" (UID: "3c79a781-906d-4a89-9b9e-bbe8caf7ebbb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:20.743856 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:20.743737 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-kube-api-access-bcxvh" pod "3c79a781-906d-4a89-9b9e-bbe8caf7ebbb" (UID: "3c79a781-906d-4a89-9b9e-bbe8caf7ebbb"). InnerVolumeSpecName "kube-api-access-bcxvh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:14:20.743856 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:20.743805 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-serving-cert" pod "3c79a781-906d-4a89-9b9e-bbe8caf7ebbb" (UID: "3c79a781-906d-4a89-9b9e-bbe8caf7ebbb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:20.842539 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:20.842502 6029 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-config\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.842539 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:20.842533 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcxvh\" (UniqueName: \"kubernetes.io/projected/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-kube-api-access-bcxvh\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.842539 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:20.842542 6029 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-tmp\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.842539 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:20.842551 6029 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-oauth-config\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.842800 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:20.842561 6029 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-oauth-serving-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.842800 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:20.842569 6029 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-console-serving-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.842800 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:20.842577 6029 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb-service-ca\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:14:21.553122 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:21.553088 6029 generic.go:356] "Generic (PLEG): container finished" podID="3c79a781-906d-4a89-9b9e-bbe8caf7ebbb" containerID="4af6fa9a3063fca68f0e64a5a64190b9e1cca1457d4d7d9b11bab9fa5370fc61" exitCode=0 Oct 29 23:14:21.553515 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:21.553153 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7848849768-qnlvb" Oct 29 23:14:21.553515 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:21.553178 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7848849768-qnlvb" event={"ID":"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb","Type":"ContainerDied","Data":"4af6fa9a3063fca68f0e64a5a64190b9e1cca1457d4d7d9b11bab9fa5370fc61"} Oct 29 23:14:21.553515 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:21.553232 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7848849768-qnlvb" event={"ID":"3c79a781-906d-4a89-9b9e-bbe8caf7ebbb","Type":"ContainerDied","Data":"c32e3791a6cbd50c10c65b45d2e5731b965f8cd8f24e1057902c5f3061c2b1c9"} Oct 29 23:14:21.553515 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:21.553252 6029 scope.go:122] "RemoveContainer" containerID="4af6fa9a3063fca68f0e64a5a64190b9e1cca1457d4d7d9b11bab9fa5370fc61" Oct 29 23:14:21.561184 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:21.561164 6029 scope.go:122] "RemoveContainer" containerID="4af6fa9a3063fca68f0e64a5a64190b9e1cca1457d4d7d9b11bab9fa5370fc61" Oct 29 23:14:21.561468 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:14:21.561448 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4af6fa9a3063fca68f0e64a5a64190b9e1cca1457d4d7d9b11bab9fa5370fc61\": container with ID starting with 4af6fa9a3063fca68f0e64a5a64190b9e1cca1457d4d7d9b11bab9fa5370fc61 not found: ID does not exist" containerID="4af6fa9a3063fca68f0e64a5a64190b9e1cca1457d4d7d9b11bab9fa5370fc61" Oct 29 23:14:21.561534 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:21.561477 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4af6fa9a3063fca68f0e64a5a64190b9e1cca1457d4d7d9b11bab9fa5370fc61"} err="failed to get container status \"4af6fa9a3063fca68f0e64a5a64190b9e1cca1457d4d7d9b11bab9fa5370fc61\": rpc error: code = NotFound desc = could not find container \"4af6fa9a3063fca68f0e64a5a64190b9e1cca1457d4d7d9b11bab9fa5370fc61\": container with ID starting with 4af6fa9a3063fca68f0e64a5a64190b9e1cca1457d4d7d9b11bab9fa5370fc61 not found: ID does not exist" Oct 29 23:14:21.609593 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:21.609560 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7848849768-qnlvb"] Oct 29 23:14:21.622427 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:21.622400 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7848849768-qnlvb"] Oct 29 23:14:23.386656 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:23.386621 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3c79a781-906d-4a89-9b9e-bbe8caf7ebbb" path="/var/lib/kubelet/pods/3c79a781-906d-4a89-9b9e-bbe8caf7ebbb/volumes" Oct 29 23:14:30.528973 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:30.528938 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xnlbj" Oct 29 23:14:38.919785 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:14:38.919747 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:14:43.646534 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:43.646474 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-68bc6cfb6b-tw8lp" podUID="4962406a-baa9-420f-8069-98171dc6bd1d" containerName="console" containerID="cri-o://7c8395d795ff11b3126034c4d14074adf4d1c2619ada0ebc56a38b0eb804d2a5" gracePeriod=15 Oct 29 23:14:43.888510 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:43.888485 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:14:44.037718 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.037685 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-oauth-serving-cert\") pod \"4962406a-baa9-420f-8069-98171dc6bd1d\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " Oct 29 23:14:44.037919 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.037734 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4962406a-baa9-420f-8069-98171dc6bd1d-kube-api-access-4nfbj\" (UniqueName: \"kubernetes.io/projected/4962406a-baa9-420f-8069-98171dc6bd1d-kube-api-access-4nfbj\") pod \"4962406a-baa9-420f-8069-98171dc6bd1d\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " Oct 29 23:14:44.037919 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.037756 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-trusted-ca-bundle\") pod \"4962406a-baa9-420f-8069-98171dc6bd1d\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " Oct 29 23:14:44.037919 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.037791 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-service-ca\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-service-ca\") pod \"4962406a-baa9-420f-8069-98171dc6bd1d\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " Oct 29 23:14:44.037919 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.037875 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4962406a-baa9-420f-8069-98171dc6bd1d-tmp\" (UniqueName: \"kubernetes.io/empty-dir/4962406a-baa9-420f-8069-98171dc6bd1d-tmp\") pod \"4962406a-baa9-420f-8069-98171dc6bd1d\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " Oct 29 23:14:44.037919 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.037897 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4962406a-baa9-420f-8069-98171dc6bd1d-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4962406a-baa9-420f-8069-98171dc6bd1d-console-serving-cert\") pod \"4962406a-baa9-420f-8069-98171dc6bd1d\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " Oct 29 23:14:44.038130 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.037936 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4962406a-baa9-420f-8069-98171dc6bd1d-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4962406a-baa9-420f-8069-98171dc6bd1d-console-oauth-config\") pod \"4962406a-baa9-420f-8069-98171dc6bd1d\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " Oct 29 23:14:44.038130 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.037998 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-console-config\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-console-config\") pod \"4962406a-baa9-420f-8069-98171dc6bd1d\" (UID: \"4962406a-baa9-420f-8069-98171dc6bd1d\") " Oct 29 23:14:44.038298 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.038268 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-trusted-ca-bundle" pod "4962406a-baa9-420f-8069-98171dc6bd1d" (UID: "4962406a-baa9-420f-8069-98171dc6bd1d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:14:44.038466 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.038434 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-service-ca" pod "4962406a-baa9-420f-8069-98171dc6bd1d" (UID: "4962406a-baa9-420f-8069-98171dc6bd1d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:14:44.038583 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.038489 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-console-config" pod "4962406a-baa9-420f-8069-98171dc6bd1d" (UID: "4962406a-baa9-420f-8069-98171dc6bd1d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:14:44.038583 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.038508 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4962406a-baa9-420f-8069-98171dc6bd1d-tmp" pod "4962406a-baa9-420f-8069-98171dc6bd1d" (UID: "4962406a-baa9-420f-8069-98171dc6bd1d"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:14:44.038583 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.038539 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-oauth-serving-cert" pod "4962406a-baa9-420f-8069-98171dc6bd1d" (UID: "4962406a-baa9-420f-8069-98171dc6bd1d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:14:44.040202 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.040167 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4962406a-baa9-420f-8069-98171dc6bd1d-console-serving-cert" pod "4962406a-baa9-420f-8069-98171dc6bd1d" (UID: "4962406a-baa9-420f-8069-98171dc6bd1d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:44.040202 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.040179 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4962406a-baa9-420f-8069-98171dc6bd1d-kube-api-access-4nfbj" pod "4962406a-baa9-420f-8069-98171dc6bd1d" (UID: "4962406a-baa9-420f-8069-98171dc6bd1d"). InnerVolumeSpecName "kube-api-access-4nfbj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:14:44.040321 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.040236 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4962406a-baa9-420f-8069-98171dc6bd1d-console-oauth-config" pod "4962406a-baa9-420f-8069-98171dc6bd1d" (UID: "4962406a-baa9-420f-8069-98171dc6bd1d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:44.138631 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.138578 6029 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4962406a-baa9-420f-8069-98171dc6bd1d-tmp\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:14:44.138631 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.138624 6029 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4962406a-baa9-420f-8069-98171dc6bd1d-console-serving-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:14:44.138631 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.138635 6029 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4962406a-baa9-420f-8069-98171dc6bd1d-console-oauth-config\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:14:44.138631 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.138647 6029 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-console-config\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:14:44.138934 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.138656 6029 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-oauth-serving-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:14:44.138934 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.138665 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nfbj\" (UniqueName: \"kubernetes.io/projected/4962406a-baa9-420f-8069-98171dc6bd1d-kube-api-access-4nfbj\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:14:44.138934 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.138676 6029 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-trusted-ca-bundle\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:14:44.138934 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.138684 6029 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4962406a-baa9-420f-8069-98171dc6bd1d-service-ca\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:14:44.638088 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.638053 6029 generic.go:356] "Generic (PLEG): container finished" podID="4962406a-baa9-420f-8069-98171dc6bd1d" containerID="7c8395d795ff11b3126034c4d14074adf4d1c2619ada0ebc56a38b0eb804d2a5" exitCode=0 Oct 29 23:14:44.638261 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.638109 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68bc6cfb6b-tw8lp" Oct 29 23:14:44.638261 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.638140 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68bc6cfb6b-tw8lp" event={"ID":"4962406a-baa9-420f-8069-98171dc6bd1d","Type":"ContainerDied","Data":"7c8395d795ff11b3126034c4d14074adf4d1c2619ada0ebc56a38b0eb804d2a5"} Oct 29 23:14:44.638261 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.638201 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68bc6cfb6b-tw8lp" event={"ID":"4962406a-baa9-420f-8069-98171dc6bd1d","Type":"ContainerDied","Data":"2985ea8f11c7ddad9d09de957a0c93aa4e1ea269c6f72a5b41ce66849eb8f412"} Oct 29 23:14:44.638261 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.638228 6029 scope.go:122] "RemoveContainer" containerID="7c8395d795ff11b3126034c4d14074adf4d1c2619ada0ebc56a38b0eb804d2a5" Oct 29 23:14:44.646556 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.646539 6029 scope.go:122] "RemoveContainer" containerID="7c8395d795ff11b3126034c4d14074adf4d1c2619ada0ebc56a38b0eb804d2a5" Oct 29 23:14:44.646869 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:14:44.646849 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c8395d795ff11b3126034c4d14074adf4d1c2619ada0ebc56a38b0eb804d2a5\": container with ID starting with 7c8395d795ff11b3126034c4d14074adf4d1c2619ada0ebc56a38b0eb804d2a5 not found: ID does not exist" containerID="7c8395d795ff11b3126034c4d14074adf4d1c2619ada0ebc56a38b0eb804d2a5" Oct 29 23:14:44.646919 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.646881 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c8395d795ff11b3126034c4d14074adf4d1c2619ada0ebc56a38b0eb804d2a5"} err="failed to get container status \"7c8395d795ff11b3126034c4d14074adf4d1c2619ada0ebc56a38b0eb804d2a5\": rpc error: code = NotFound desc = could not find container \"7c8395d795ff11b3126034c4d14074adf4d1c2619ada0ebc56a38b0eb804d2a5\": container with ID starting with 7c8395d795ff11b3126034c4d14074adf4d1c2619ada0ebc56a38b0eb804d2a5 not found: ID does not exist" Oct 29 23:14:44.691982 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.691950 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68bc6cfb6b-tw8lp"] Oct 29 23:14:44.705156 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:44.705124 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68bc6cfb6b-tw8lp"] Oct 29 23:14:45.386277 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:14:45.386246 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4962406a-baa9-420f-8069-98171dc6bd1d" path="/var/lib/kubelet/pods/4962406a-baa9-420f-8069-98171dc6bd1d/volumes" Oct 29 23:15:08.919682 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:15:08.919645 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:15:38.920347 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:15:38.920301 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:15:59.394205 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:15:59.394174 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x"] Oct 29 23:15:59.395084 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:15:59.395062 6029 cpu_manager.go:414] "containerMap: removing container" podUID="4962406a-baa9-420f-8069-98171dc6bd1d" containerName="console" Oct 29 23:15:59.395202 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:15:59.395085 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4962406a-baa9-420f-8069-98171dc6bd1d" containerName="console" Oct 29 23:15:59.395202 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:15:59.395097 6029 cpu_manager.go:414] "containerMap: removing container" podUID="3c79a781-906d-4a89-9b9e-bbe8caf7ebbb" containerName="console" Oct 29 23:15:59.395202 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:15:59.395104 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3c79a781-906d-4a89-9b9e-bbe8caf7ebbb" containerName="console" Oct 29 23:15:59.395202 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:15:59.395177 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="4962406a-baa9-420f-8069-98171dc6bd1d" containerName="console" Oct 29 23:15:59.395202 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:15:59.395189 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="3c79a781-906d-4a89-9b9e-bbe8caf7ebbb" containerName="console" Oct 29 23:15:59.398225 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:15:59.398205 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x" Oct 29 23:15:59.428435 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:15:59.428410 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Oct 29 23:15:59.428435 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:15:59.428416 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Oct 29 23:15:59.428600 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:15:59.428439 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-zl9bf\"" Oct 29 23:15:59.429046 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:15:59.429028 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x"] Oct 29 23:15:59.437045 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:15:59.437016 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e91894a6-78b4-4150-9409-7780498d7f81-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x\" (UID: \"e91894a6-78b4-4150-9409-7780498d7f81\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x" Oct 29 23:15:59.437150 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:15:59.437058 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e91894a6-78b4-4150-9409-7780498d7f81-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x\" (UID: \"e91894a6-78b4-4150-9409-7780498d7f81\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x" Oct 29 23:15:59.437150 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:15:59.437135 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc7zh\" (UniqueName: \"kubernetes.io/projected/e91894a6-78b4-4150-9409-7780498d7f81-kube-api-access-gc7zh\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x\" (UID: \"e91894a6-78b4-4150-9409-7780498d7f81\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x" Oct 29 23:15:59.537566 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:15:59.537526 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e91894a6-78b4-4150-9409-7780498d7f81-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x\" (UID: \"e91894a6-78b4-4150-9409-7780498d7f81\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x" Oct 29 23:15:59.537737 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:15:59.537586 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e91894a6-78b4-4150-9409-7780498d7f81-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x\" (UID: \"e91894a6-78b4-4150-9409-7780498d7f81\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x" Oct 29 23:15:59.537737 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:15:59.537655 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc7zh\" (UniqueName: \"kubernetes.io/projected/e91894a6-78b4-4150-9409-7780498d7f81-kube-api-access-gc7zh\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x\" (UID: \"e91894a6-78b4-4150-9409-7780498d7f81\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x" Oct 29 23:15:59.538038 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:15:59.538016 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e91894a6-78b4-4150-9409-7780498d7f81-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x\" (UID: \"e91894a6-78b4-4150-9409-7780498d7f81\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x" Oct 29 23:15:59.538088 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:15:59.538026 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e91894a6-78b4-4150-9409-7780498d7f81-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x\" (UID: \"e91894a6-78b4-4150-9409-7780498d7f81\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x" Oct 29 23:15:59.558435 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:15:59.558408 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc7zh\" (UniqueName: \"kubernetes.io/projected/e91894a6-78b4-4150-9409-7780498d7f81-kube-api-access-gc7zh\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x\" (UID: \"e91894a6-78b4-4150-9409-7780498d7f81\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x" Oct 29 23:15:59.713778 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:15:59.713691 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x" Oct 29 23:16:00.019702 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:00.019681 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x"] Oct 29 23:16:00.021269 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:16:00.021242 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode91894a6_78b4_4150_9409_7780498d7f81.slice/crio-a0b0fda16c4906b80c2a79a46d14326e82efb15bd4e88a788108efa60eedc7dc WatchSource:0}: Error finding container a0b0fda16c4906b80c2a79a46d14326e82efb15bd4e88a788108efa60eedc7dc: Status 404 returned error can't find the container with id a0b0fda16c4906b80c2a79a46d14326e82efb15bd4e88a788108efa60eedc7dc Oct 29 23:16:00.901848 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:00.901793 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x" event={"ID":"e91894a6-78b4-4150-9409-7780498d7f81","Type":"ContainerStarted","Data":"a0b0fda16c4906b80c2a79a46d14326e82efb15bd4e88a788108efa60eedc7dc"} Oct 29 23:16:05.922002 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:05.921914 6029 generic.go:356] "Generic (PLEG): container finished" podID="e91894a6-78b4-4150-9409-7780498d7f81" containerID="21eaa030bb9d564326fbed3618ee8b097dc19bcc02fc951872866de2dfe86037" exitCode=0 Oct 29 23:16:05.922002 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:05.921985 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x" event={"ID":"e91894a6-78b4-4150-9409-7780498d7f81","Type":"ContainerDied","Data":"21eaa030bb9d564326fbed3618ee8b097dc19bcc02fc951872866de2dfe86037"} Oct 29 23:16:07.931031 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:07.930997 6029 generic.go:356] "Generic (PLEG): container finished" podID="e91894a6-78b4-4150-9409-7780498d7f81" containerID="32f5d41f0e27426326b4bfb369743752b51afd82a69b91fb5af537fb29459fab" exitCode=0 Oct 29 23:16:07.931402 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:07.931065 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x" event={"ID":"e91894a6-78b4-4150-9409-7780498d7f81","Type":"ContainerDied","Data":"32f5d41f0e27426326b4bfb369743752b51afd82a69b91fb5af537fb29459fab"} Oct 29 23:16:08.926833 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:16:08.926785 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:16:13.956904 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:13.956868 6029 generic.go:356] "Generic (PLEG): container finished" podID="e91894a6-78b4-4150-9409-7780498d7f81" containerID="4a439b03b8440ec6460ba4c02205fbb9a19d2b909fa3deefd1994c68db1fcdeb" exitCode=0 Oct 29 23:16:13.957310 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:13.956946 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x" event={"ID":"e91894a6-78b4-4150-9409-7780498d7f81","Type":"ContainerDied","Data":"4a439b03b8440ec6460ba4c02205fbb9a19d2b909fa3deefd1994c68db1fcdeb"} Oct 29 23:16:15.085771 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:15.085743 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x" Oct 29 23:16:15.176028 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:15.175997 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e91894a6-78b4-4150-9409-7780498d7f81-kube-api-access-gc7zh\" (UniqueName: \"kubernetes.io/projected/e91894a6-78b4-4150-9409-7780498d7f81-kube-api-access-gc7zh\") pod \"e91894a6-78b4-4150-9409-7780498d7f81\" (UID: \"e91894a6-78b4-4150-9409-7780498d7f81\") " Oct 29 23:16:15.176202 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:15.176056 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e91894a6-78b4-4150-9409-7780498d7f81-bundle\" (UniqueName: \"kubernetes.io/empty-dir/e91894a6-78b4-4150-9409-7780498d7f81-bundle\") pod \"e91894a6-78b4-4150-9409-7780498d7f81\" (UID: \"e91894a6-78b4-4150-9409-7780498d7f81\") " Oct 29 23:16:15.176202 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:15.176134 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e91894a6-78b4-4150-9409-7780498d7f81-util\" (UniqueName: \"kubernetes.io/empty-dir/e91894a6-78b4-4150-9409-7780498d7f81-util\") pod \"e91894a6-78b4-4150-9409-7780498d7f81\" (UID: \"e91894a6-78b4-4150-9409-7780498d7f81\") " Oct 29 23:16:15.176754 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:15.176727 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e91894a6-78b4-4150-9409-7780498d7f81-bundle" pod "e91894a6-78b4-4150-9409-7780498d7f81" (UID: "e91894a6-78b4-4150-9409-7780498d7f81"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:16:15.178373 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:15.178346 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e91894a6-78b4-4150-9409-7780498d7f81-kube-api-access-gc7zh" pod "e91894a6-78b4-4150-9409-7780498d7f81" (UID: "e91894a6-78b4-4150-9409-7780498d7f81"). InnerVolumeSpecName "kube-api-access-gc7zh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:16:15.180361 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:15.180337 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e91894a6-78b4-4150-9409-7780498d7f81-util" pod "e91894a6-78b4-4150-9409-7780498d7f81" (UID: "e91894a6-78b4-4150-9409-7780498d7f81"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:16:15.277092 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:15.277046 6029 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e91894a6-78b4-4150-9409-7780498d7f81-bundle\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:16:15.277092 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:15.277088 6029 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e91894a6-78b4-4150-9409-7780498d7f81-util\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:16:15.277092 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:15.277100 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gc7zh\" (UniqueName: \"kubernetes.io/projected/e91894a6-78b4-4150-9409-7780498d7f81-kube-api-access-gc7zh\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:16:15.965349 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:15.965322 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x" Oct 29 23:16:15.965495 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:15.965321 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnkq9x" event={"ID":"e91894a6-78b4-4150-9409-7780498d7f81","Type":"ContainerDied","Data":"a0b0fda16c4906b80c2a79a46d14326e82efb15bd4e88a788108efa60eedc7dc"} Oct 29 23:16:15.965495 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:15.965445 6029 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0b0fda16c4906b80c2a79a46d14326e82efb15bd4e88a788108efa60eedc7dc" Oct 29 23:16:22.451723 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:22.451693 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-j9hjs"] Oct 29 23:16:22.452143 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:22.452023 6029 cpu_manager.go:414] "containerMap: removing container" podUID="e91894a6-78b4-4150-9409-7780498d7f81" containerName="util" Oct 29 23:16:22.452143 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:22.452035 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e91894a6-78b4-4150-9409-7780498d7f81" containerName="util" Oct 29 23:16:22.452143 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:22.452044 6029 cpu_manager.go:414] "containerMap: removing container" podUID="e91894a6-78b4-4150-9409-7780498d7f81" containerName="pull" Oct 29 23:16:22.452143 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:22.452049 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e91894a6-78b4-4150-9409-7780498d7f81" containerName="pull" Oct 29 23:16:22.452143 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:22.452077 6029 cpu_manager.go:414] "containerMap: removing container" podUID="e91894a6-78b4-4150-9409-7780498d7f81" containerName="extract" Oct 29 23:16:22.452143 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:22.452082 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e91894a6-78b4-4150-9409-7780498d7f81" containerName="extract" Oct 29 23:16:22.452143 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:22.452134 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="e91894a6-78b4-4150-9409-7780498d7f81" containerName="extract" Oct 29 23:16:22.491635 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:22.491603 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-j9hjs"] Oct 29 23:16:22.491804 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:22.491716 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-j9hjs" Oct 29 23:16:22.508467 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:22.508427 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Oct 29 23:16:22.508610 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:22.508513 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-cj6l5\"" Oct 29 23:16:22.508610 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:22.508554 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Oct 29 23:16:22.635987 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:22.635938 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xlmb\" (UniqueName: \"kubernetes.io/projected/10280713-6ed3-41ac-870c-9c7e5b175a54-kube-api-access-9xlmb\") pod \"cert-manager-operator-controller-manager-89fdbf7dc-j9hjs\" (UID: \"10280713-6ed3-41ac-870c-9c7e5b175a54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-j9hjs" Oct 29 23:16:22.635987 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:22.635989 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10280713-6ed3-41ac-870c-9c7e5b175a54-tmp\") pod \"cert-manager-operator-controller-manager-89fdbf7dc-j9hjs\" (UID: \"10280713-6ed3-41ac-870c-9c7e5b175a54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-j9hjs" Oct 29 23:16:22.737079 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:22.736994 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xlmb\" (UniqueName: \"kubernetes.io/projected/10280713-6ed3-41ac-870c-9c7e5b175a54-kube-api-access-9xlmb\") pod \"cert-manager-operator-controller-manager-89fdbf7dc-j9hjs\" (UID: \"10280713-6ed3-41ac-870c-9c7e5b175a54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-j9hjs" Oct 29 23:16:22.737079 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:22.737036 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10280713-6ed3-41ac-870c-9c7e5b175a54-tmp\") pod \"cert-manager-operator-controller-manager-89fdbf7dc-j9hjs\" (UID: \"10280713-6ed3-41ac-870c-9c7e5b175a54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-j9hjs" Oct 29 23:16:22.737423 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:22.737407 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10280713-6ed3-41ac-870c-9c7e5b175a54-tmp\") pod \"cert-manager-operator-controller-manager-89fdbf7dc-j9hjs\" (UID: \"10280713-6ed3-41ac-870c-9c7e5b175a54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-j9hjs" Oct 29 23:16:22.759799 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:22.759762 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xlmb\" (UniqueName: \"kubernetes.io/projected/10280713-6ed3-41ac-870c-9c7e5b175a54-kube-api-access-9xlmb\") pod \"cert-manager-operator-controller-manager-89fdbf7dc-j9hjs\" (UID: \"10280713-6ed3-41ac-870c-9c7e5b175a54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-j9hjs" Oct 29 23:16:22.816367 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:22.816329 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-j9hjs" Oct 29 23:16:23.173599 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:23.173575 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-j9hjs"] Oct 29 23:16:23.175537 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:16:23.175499 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10280713_6ed3_41ac_870c_9c7e5b175a54.slice/crio-c5d7859231b9b1f3a5559f6d6616245c6070c9904698efc56eadc00c56d0eef8 WatchSource:0}: Error finding container c5d7859231b9b1f3a5559f6d6616245c6070c9904698efc56eadc00c56d0eef8: Status 404 returned error can't find the container with id c5d7859231b9b1f3a5559f6d6616245c6070c9904698efc56eadc00c56d0eef8 Oct 29 23:16:23.999312 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:23.999271 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-j9hjs" event={"ID":"10280713-6ed3-41ac-870c-9c7e5b175a54","Type":"ContainerStarted","Data":"c5d7859231b9b1f3a5559f6d6616245c6070c9904698efc56eadc00c56d0eef8"} Oct 29 23:16:26.007836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:26.007782 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-j9hjs" event={"ID":"10280713-6ed3-41ac-870c-9c7e5b175a54","Type":"ContainerStarted","Data":"ea7fbd79682a619a956b2cb7314fb67e613fa5282583497ef81ae1628571341c"} Oct 29 23:16:26.081526 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:26.081463 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-j9hjs" podStartSLOduration=2.250768723 podStartE2EDuration="4.081446326s" totalImagesPullingTime="1.830677603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:16:26.067510334 +0000 UTC m=+152.793760949" watchObservedRunningTime="2026-10-29 23:16:26.081446326 +0000 UTC m=+152.807696919" Oct 29 23:16:26.984359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:26.984326 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x"] Oct 29 23:16:27.004689 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:27.004658 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x" Oct 29 23:16:27.014996 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:27.014971 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x"] Oct 29 23:16:27.028114 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:27.028089 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"61b1ff68c7255ee5c5329fe19a5d96293a9578-ce91a85d-dockercfg-rdbwl\"" Oct 29 23:16:27.028114 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:27.028089 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Oct 29 23:16:27.028278 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:27.028126 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Oct 29 23:16:27.074884 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:27.074843 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e369b621-7e31-4a07-a4e5-1c9b091093d8-util\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x\" (UID: \"e369b621-7e31-4a07-a4e5-1c9b091093d8\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x" Oct 29 23:16:27.075034 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:27.074928 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e369b621-7e31-4a07-a4e5-1c9b091093d8-bundle\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x\" (UID: \"e369b621-7e31-4a07-a4e5-1c9b091093d8\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x" Oct 29 23:16:27.075034 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:27.075002 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt7px\" (UniqueName: \"kubernetes.io/projected/e369b621-7e31-4a07-a4e5-1c9b091093d8-kube-api-access-dt7px\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x\" (UID: \"e369b621-7e31-4a07-a4e5-1c9b091093d8\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x" Oct 29 23:16:27.175567 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:27.175527 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt7px\" (UniqueName: \"kubernetes.io/projected/e369b621-7e31-4a07-a4e5-1c9b091093d8-kube-api-access-dt7px\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x\" (UID: \"e369b621-7e31-4a07-a4e5-1c9b091093d8\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x" Oct 29 23:16:27.175762 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:27.175604 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e369b621-7e31-4a07-a4e5-1c9b091093d8-util\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x\" (UID: \"e369b621-7e31-4a07-a4e5-1c9b091093d8\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x" Oct 29 23:16:27.175762 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:27.175636 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e369b621-7e31-4a07-a4e5-1c9b091093d8-bundle\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x\" (UID: \"e369b621-7e31-4a07-a4e5-1c9b091093d8\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x" Oct 29 23:16:27.176045 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:27.176024 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e369b621-7e31-4a07-a4e5-1c9b091093d8-util\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x\" (UID: \"e369b621-7e31-4a07-a4e5-1c9b091093d8\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x" Oct 29 23:16:27.176097 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:27.176060 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e369b621-7e31-4a07-a4e5-1c9b091093d8-bundle\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x\" (UID: \"e369b621-7e31-4a07-a4e5-1c9b091093d8\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x" Oct 29 23:16:27.202151 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:27.202121 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt7px\" (UniqueName: \"kubernetes.io/projected/e369b621-7e31-4a07-a4e5-1c9b091093d8-kube-api-access-dt7px\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x\" (UID: \"e369b621-7e31-4a07-a4e5-1c9b091093d8\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x" Oct 29 23:16:27.357735 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:27.357694 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x" Oct 29 23:16:27.673315 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:27.673293 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x"] Oct 29 23:16:27.674591 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:16:27.674564 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode369b621_7e31_4a07_a4e5_1c9b091093d8.slice/crio-e4bcdac4ac65db5f45aa1135a8784e6aa8704e7c144f88ee917f6a8581edd6cf WatchSource:0}: Error finding container e4bcdac4ac65db5f45aa1135a8784e6aa8704e7c144f88ee917f6a8581edd6cf: Status 404 returned error can't find the container with id e4bcdac4ac65db5f45aa1135a8784e6aa8704e7c144f88ee917f6a8581edd6cf Oct 29 23:16:28.017859 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:28.017807 6029 generic.go:356] "Generic (PLEG): container finished" podID="e369b621-7e31-4a07-a4e5-1c9b091093d8" containerID="59c2286091528f2da975aa703076473aaf714eba6b30213f49036e1266caea9b" exitCode=0 Oct 29 23:16:28.017859 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:28.017844 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x" event={"ID":"e369b621-7e31-4a07-a4e5-1c9b091093d8","Type":"ContainerDied","Data":"59c2286091528f2da975aa703076473aaf714eba6b30213f49036e1266caea9b"} Oct 29 23:16:28.018278 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:28.017892 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x" event={"ID":"e369b621-7e31-4a07-a4e5-1c9b091093d8","Type":"ContainerStarted","Data":"e4bcdac4ac65db5f45aa1135a8784e6aa8704e7c144f88ee917f6a8581edd6cf"} Oct 29 23:16:29.876316 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:29.876283 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-z52zw"] Oct 29 23:16:29.879782 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:29.879765 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-z52zw" Oct 29 23:16:29.899069 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:29.899041 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Oct 29 23:16:29.909808 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:29.909781 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Oct 29 23:16:29.909808 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:29.909781 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-767ft\"" Oct 29 23:16:29.910756 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:29.910733 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-z52zw"] Oct 29 23:16:29.998423 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:29.998389 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdtwp\" (UniqueName: \"kubernetes.io/projected/aa5cfa7d-c0ab-4a85-a098-b173fd7dfa37-kube-api-access-fdtwp\") pod \"cert-manager-cainjector-5c57bbd4fc-z52zw\" (UID: \"aa5cfa7d-c0ab-4a85-a098-b173fd7dfa37\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-z52zw" Oct 29 23:16:29.998579 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:29.998503 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa5cfa7d-c0ab-4a85-a098-b173fd7dfa37-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-z52zw\" (UID: \"aa5cfa7d-c0ab-4a85-a098-b173fd7dfa37\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-z52zw" Oct 29 23:16:30.028125 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:30.028090 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x" event={"ID":"e369b621-7e31-4a07-a4e5-1c9b091093d8","Type":"ContainerStarted","Data":"00023ee3753372e17c2e1d14a0080a6f649f66df7b57d0bd4cafd2e6846ec8a8"} Oct 29 23:16:30.099322 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:30.099284 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa5cfa7d-c0ab-4a85-a098-b173fd7dfa37-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-z52zw\" (UID: \"aa5cfa7d-c0ab-4a85-a098-b173fd7dfa37\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-z52zw" Oct 29 23:16:30.099495 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:30.099374 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdtwp\" (UniqueName: \"kubernetes.io/projected/aa5cfa7d-c0ab-4a85-a098-b173fd7dfa37-kube-api-access-fdtwp\") pod \"cert-manager-cainjector-5c57bbd4fc-z52zw\" (UID: \"aa5cfa7d-c0ab-4a85-a098-b173fd7dfa37\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-z52zw" Oct 29 23:16:30.120389 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:30.120355 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa5cfa7d-c0ab-4a85-a098-b173fd7dfa37-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-z52zw\" (UID: \"aa5cfa7d-c0ab-4a85-a098-b173fd7dfa37\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-z52zw" Oct 29 23:16:30.120525 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:30.120405 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdtwp\" (UniqueName: \"kubernetes.io/projected/aa5cfa7d-c0ab-4a85-a098-b173fd7dfa37-kube-api-access-fdtwp\") pod \"cert-manager-cainjector-5c57bbd4fc-z52zw\" (UID: \"aa5cfa7d-c0ab-4a85-a098-b173fd7dfa37\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-z52zw" Oct 29 23:16:30.199472 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:30.199404 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-z52zw" Oct 29 23:16:30.491103 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:30.488856 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-z52zw"] Oct 29 23:16:30.491690 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:16:30.491661 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa5cfa7d_c0ab_4a85_a098_b173fd7dfa37.slice/crio-0efcff2c96caef926435cca1fea018b1008deeec952199fb4c998c444ee921a9 WatchSource:0}: Error finding container 0efcff2c96caef926435cca1fea018b1008deeec952199fb4c998c444ee921a9: Status 404 returned error can't find the container with id 0efcff2c96caef926435cca1fea018b1008deeec952199fb4c998c444ee921a9 Oct 29 23:16:31.034657 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:31.034622 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-z52zw" event={"ID":"aa5cfa7d-c0ab-4a85-a098-b173fd7dfa37","Type":"ContainerStarted","Data":"0efcff2c96caef926435cca1fea018b1008deeec952199fb4c998c444ee921a9"} Oct 29 23:16:31.036831 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:31.036781 6029 generic.go:356] "Generic (PLEG): container finished" podID="e369b621-7e31-4a07-a4e5-1c9b091093d8" containerID="00023ee3753372e17c2e1d14a0080a6f649f66df7b57d0bd4cafd2e6846ec8a8" exitCode=0 Oct 29 23:16:31.036981 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:31.036867 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x" event={"ID":"e369b621-7e31-4a07-a4e5-1c9b091093d8","Type":"ContainerDied","Data":"00023ee3753372e17c2e1d14a0080a6f649f66df7b57d0bd4cafd2e6846ec8a8"} Oct 29 23:16:32.043333 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:32.043293 6029 generic.go:356] "Generic (PLEG): container finished" podID="e369b621-7e31-4a07-a4e5-1c9b091093d8" containerID="71b52a4a01e2c0726344262948563eacc8d53d3dce131ed56346c600524fdd90" exitCode=0 Oct 29 23:16:32.043735 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:32.043349 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x" event={"ID":"e369b621-7e31-4a07-a4e5-1c9b091093d8","Type":"ContainerDied","Data":"71b52a4a01e2c0726344262948563eacc8d53d3dce131ed56346c600524fdd90"} Oct 29 23:16:33.195541 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:33.195517 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x" Oct 29 23:16:33.330677 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:33.330649 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e369b621-7e31-4a07-a4e5-1c9b091093d8-bundle\" (UniqueName: \"kubernetes.io/empty-dir/e369b621-7e31-4a07-a4e5-1c9b091093d8-bundle\") pod \"e369b621-7e31-4a07-a4e5-1c9b091093d8\" (UID: \"e369b621-7e31-4a07-a4e5-1c9b091093d8\") " Oct 29 23:16:33.330863 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:33.330703 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e369b621-7e31-4a07-a4e5-1c9b091093d8-util\" (UniqueName: \"kubernetes.io/empty-dir/e369b621-7e31-4a07-a4e5-1c9b091093d8-util\") pod \"e369b621-7e31-4a07-a4e5-1c9b091093d8\" (UID: \"e369b621-7e31-4a07-a4e5-1c9b091093d8\") " Oct 29 23:16:33.330863 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:33.330729 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e369b621-7e31-4a07-a4e5-1c9b091093d8-kube-api-access-dt7px\" (UniqueName: \"kubernetes.io/projected/e369b621-7e31-4a07-a4e5-1c9b091093d8-kube-api-access-dt7px\") pod \"e369b621-7e31-4a07-a4e5-1c9b091093d8\" (UID: \"e369b621-7e31-4a07-a4e5-1c9b091093d8\") " Oct 29 23:16:33.331107 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:33.331084 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e369b621-7e31-4a07-a4e5-1c9b091093d8-bundle" pod "e369b621-7e31-4a07-a4e5-1c9b091093d8" (UID: "e369b621-7e31-4a07-a4e5-1c9b091093d8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:16:33.335875 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:33.335846 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e369b621-7e31-4a07-a4e5-1c9b091093d8-util" pod "e369b621-7e31-4a07-a4e5-1c9b091093d8" (UID: "e369b621-7e31-4a07-a4e5-1c9b091093d8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:16:33.336028 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:33.335971 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e369b621-7e31-4a07-a4e5-1c9b091093d8-kube-api-access-dt7px" pod "e369b621-7e31-4a07-a4e5-1c9b091093d8" (UID: "e369b621-7e31-4a07-a4e5-1c9b091093d8"). InnerVolumeSpecName "kube-api-access-dt7px". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:16:33.432225 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:33.432189 6029 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e369b621-7e31-4a07-a4e5-1c9b091093d8-bundle\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:16:33.432225 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:33.432215 6029 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e369b621-7e31-4a07-a4e5-1c9b091093d8-util\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:16:33.432225 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:33.432224 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dt7px\" (UniqueName: \"kubernetes.io/projected/e369b621-7e31-4a07-a4e5-1c9b091093d8-kube-api-access-dt7px\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:16:33.871787 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:33.871754 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-5q8jd"] Oct 29 23:16:33.872093 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:33.872079 6029 cpu_manager.go:414] "containerMap: removing container" podUID="e369b621-7e31-4a07-a4e5-1c9b091093d8" containerName="util" Oct 29 23:16:33.872145 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:33.872094 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e369b621-7e31-4a07-a4e5-1c9b091093d8" containerName="util" Oct 29 23:16:33.872145 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:33.872108 6029 cpu_manager.go:414] "containerMap: removing container" podUID="e369b621-7e31-4a07-a4e5-1c9b091093d8" containerName="pull" Oct 29 23:16:33.872145 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:33.872112 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e369b621-7e31-4a07-a4e5-1c9b091093d8" containerName="pull" Oct 29 23:16:33.872145 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:33.872121 6029 cpu_manager.go:414] "containerMap: removing container" podUID="e369b621-7e31-4a07-a4e5-1c9b091093d8" containerName="extract" Oct 29 23:16:33.872145 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:33.872126 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e369b621-7e31-4a07-a4e5-1c9b091093d8" containerName="extract" Oct 29 23:16:33.872289 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:33.872170 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="e369b621-7e31-4a07-a4e5-1c9b091093d8" containerName="extract" Oct 29 23:16:33.874970 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:33.874952 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5q8jd" Oct 29 23:16:33.907801 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:33.907772 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-9lg79\"" Oct 29 23:16:33.909428 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:33.909402 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-5q8jd"] Oct 29 23:16:34.039008 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:34.038975 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f215e4ad-1733-4553-bf49-9a26c80df3eb-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-5q8jd\" (UID: \"f215e4ad-1733-4553-bf49-9a26c80df3eb\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5q8jd" Oct 29 23:16:34.039196 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:34.039055 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gphwh\" (UniqueName: \"kubernetes.io/projected/f215e4ad-1733-4553-bf49-9a26c80df3eb-kube-api-access-gphwh\") pod \"cert-manager-webhook-5dbbbf75cc-5q8jd\" (UID: \"f215e4ad-1733-4553-bf49-9a26c80df3eb\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5q8jd" Oct 29 23:16:34.054063 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:34.054036 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x" Oct 29 23:16:34.054063 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:34.054045 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc854b54x" event={"ID":"e369b621-7e31-4a07-a4e5-1c9b091093d8","Type":"ContainerDied","Data":"e4bcdac4ac65db5f45aa1135a8784e6aa8704e7c144f88ee917f6a8581edd6cf"} Oct 29 23:16:34.054218 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:34.054087 6029 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4bcdac4ac65db5f45aa1135a8784e6aa8704e7c144f88ee917f6a8581edd6cf" Oct 29 23:16:34.055549 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:34.055522 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-z52zw" event={"ID":"aa5cfa7d-c0ab-4a85-a098-b173fd7dfa37","Type":"ContainerStarted","Data":"ec5d1f3dd199aa6a25b7dd04a086c9c0b618bdae221ce72fa872e8a42e4ef85e"} Oct 29 23:16:34.097794 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:34.097730 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-z52zw" podStartSLOduration=2.328082105 podStartE2EDuration="5.097711181s" totalImagesPullingTime="2.769629076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:16:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:16:34.097099544 +0000 UTC m=+160.823350138" watchObservedRunningTime="2026-10-29 23:16:34.097711181 +0000 UTC m=+160.823961774" Oct 29 23:16:34.140170 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:34.140092 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gphwh\" (UniqueName: \"kubernetes.io/projected/f215e4ad-1733-4553-bf49-9a26c80df3eb-kube-api-access-gphwh\") pod \"cert-manager-webhook-5dbbbf75cc-5q8jd\" (UID: \"f215e4ad-1733-4553-bf49-9a26c80df3eb\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5q8jd" Oct 29 23:16:34.140332 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:34.140189 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f215e4ad-1733-4553-bf49-9a26c80df3eb-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-5q8jd\" (UID: \"f215e4ad-1733-4553-bf49-9a26c80df3eb\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5q8jd" Oct 29 23:16:34.161269 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:34.161237 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f215e4ad-1733-4553-bf49-9a26c80df3eb-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-5q8jd\" (UID: \"f215e4ad-1733-4553-bf49-9a26c80df3eb\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5q8jd" Oct 29 23:16:34.161416 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:34.161296 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gphwh\" (UniqueName: \"kubernetes.io/projected/f215e4ad-1733-4553-bf49-9a26c80df3eb-kube-api-access-gphwh\") pod \"cert-manager-webhook-5dbbbf75cc-5q8jd\" (UID: \"f215e4ad-1733-4553-bf49-9a26c80df3eb\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5q8jd" Oct 29 23:16:34.186116 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:34.186087 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5q8jd" Oct 29 23:16:34.476442 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:34.476417 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-5q8jd"] Oct 29 23:16:34.477888 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:16:34.477861 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf215e4ad_1733_4553_bf49_9a26c80df3eb.slice/crio-ebbf4eb6d1dd21fbe5bc58d822502ce84321c814cf1d8c75105baf2dc8ee5058 WatchSource:0}: Error finding container ebbf4eb6d1dd21fbe5bc58d822502ce84321c814cf1d8c75105baf2dc8ee5058: Status 404 returned error can't find the container with id ebbf4eb6d1dd21fbe5bc58d822502ce84321c814cf1d8c75105baf2dc8ee5058 Oct 29 23:16:35.060786 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:35.060749 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5q8jd" event={"ID":"f215e4ad-1733-4553-bf49-9a26c80df3eb","Type":"ContainerStarted","Data":"8d32e4f23d320d60d2c8f96addb8e4da54df093d1134e739ea7eee8162873db5"} Oct 29 23:16:35.061006 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:35.060798 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5q8jd" event={"ID":"f215e4ad-1733-4553-bf49-9a26c80df3eb","Type":"ContainerStarted","Data":"ebbf4eb6d1dd21fbe5bc58d822502ce84321c814cf1d8c75105baf2dc8ee5058"} Oct 29 23:16:36.065164 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:36.065134 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5q8jd" Oct 29 23:16:38.920629 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:16:38.920583 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:16:40.675787 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:40.675733 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5q8jd" podStartSLOduration=7.675719067 podStartE2EDuration="7.675719067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:16:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:16:35.1070035 +0000 UTC m=+161.833254091" watchObservedRunningTime="2026-10-29 23:16:40.675719067 +0000 UTC m=+167.401969659" Oct 29 23:16:40.676310 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:40.676122 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-8465994787-4f9m7"] Oct 29 23:16:40.679559 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:40.679537 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-8465994787-4f9m7" Oct 29 23:16:40.696300 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:40.696277 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-fql7r\"" Oct 29 23:16:40.710378 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:40.710344 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Oct 29 23:16:40.710378 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:40.710362 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Oct 29 23:16:40.711804 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:40.711779 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-8465994787-4f9m7"] Oct 29 23:16:40.804509 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:40.804469 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a6b22ab-acca-4c7d-a909-410118fca702-tmp\") pod \"openshift-lws-operator-8465994787-4f9m7\" (UID: \"2a6b22ab-acca-4c7d-a909-410118fca702\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-4f9m7" Oct 29 23:16:40.804662 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:40.804518 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbd4r\" (UniqueName: \"kubernetes.io/projected/2a6b22ab-acca-4c7d-a909-410118fca702-kube-api-access-rbd4r\") pod \"openshift-lws-operator-8465994787-4f9m7\" (UID: \"2a6b22ab-acca-4c7d-a909-410118fca702\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-4f9m7" Oct 29 23:16:40.905929 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:40.905886 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbd4r\" (UniqueName: \"kubernetes.io/projected/2a6b22ab-acca-4c7d-a909-410118fca702-kube-api-access-rbd4r\") pod \"openshift-lws-operator-8465994787-4f9m7\" (UID: \"2a6b22ab-acca-4c7d-a909-410118fca702\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-4f9m7" Oct 29 23:16:40.906059 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:40.906011 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a6b22ab-acca-4c7d-a909-410118fca702-tmp\") pod \"openshift-lws-operator-8465994787-4f9m7\" (UID: \"2a6b22ab-acca-4c7d-a909-410118fca702\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-4f9m7" Oct 29 23:16:40.906446 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:40.906428 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a6b22ab-acca-4c7d-a909-410118fca702-tmp\") pod \"openshift-lws-operator-8465994787-4f9m7\" (UID: \"2a6b22ab-acca-4c7d-a909-410118fca702\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-4f9m7" Oct 29 23:16:40.929943 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:40.929886 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbd4r\" (UniqueName: \"kubernetes.io/projected/2a6b22ab-acca-4c7d-a909-410118fca702-kube-api-access-rbd4r\") pod \"openshift-lws-operator-8465994787-4f9m7\" (UID: \"2a6b22ab-acca-4c7d-a909-410118fca702\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-4f9m7" Oct 29 23:16:40.990205 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:40.990173 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-8465994787-4f9m7" Oct 29 23:16:41.282365 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:41.282343 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-8465994787-4f9m7"] Oct 29 23:16:41.284357 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:16:41.284327 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a6b22ab_acca_4c7d_a909_410118fca702.slice/crio-a0c0e05ac06c994a0ed60277c3492284ea0f2d8189437ab19571421796906d15 WatchSource:0}: Error finding container a0c0e05ac06c994a0ed60277c3492284ea0f2d8189437ab19571421796906d15: Status 404 returned error can't find the container with id a0c0e05ac06c994a0ed60277c3492284ea0f2d8189437ab19571421796906d15 Oct 29 23:16:42.071452 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:42.071423 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5q8jd" Oct 29 23:16:42.091381 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:42.091341 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-8465994787-4f9m7" event={"ID":"2a6b22ab-acca-4c7d-a909-410118fca702","Type":"ContainerStarted","Data":"a0c0e05ac06c994a0ed60277c3492284ea0f2d8189437ab19571421796906d15"} Oct 29 23:16:44.101473 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:44.101437 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-8465994787-4f9m7" event={"ID":"2a6b22ab-acca-4c7d-a909-410118fca702","Type":"ContainerStarted","Data":"493f1471898404b0190c64d27efdb8e02478a79f08056c3730899063edec5152"} Oct 29 23:16:47.219268 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:47.219210 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-8465994787-4f9m7" podStartSLOduration=5.368277051 podStartE2EDuration="7.219193807s" totalImagesPullingTime="1.850916756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:16:44.151522895 +0000 UTC m=+170.877773487" watchObservedRunningTime="2026-10-29 23:16:47.219193807 +0000 UTC m=+173.945444378" Oct 29 23:16:47.219809 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:47.219791 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz"] Oct 29 23:16:47.223410 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:47.223393 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz" Oct 29 23:16:47.240367 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:47.240346 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Oct 29 23:16:47.240468 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:47.240430 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-z4bdc\"" Oct 29 23:16:47.253881 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:47.253856 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34f7927b-7127-46ba-b999-f115e1aeb643-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz\" (UID: \"34f7927b-7127-46ba-b999-f115e1aeb643\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz" Oct 29 23:16:47.254014 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:47.253992 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34f7927b-7127-46ba-b999-f115e1aeb643-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz\" (UID: \"34f7927b-7127-46ba-b999-f115e1aeb643\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz" Oct 29 23:16:47.254064 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:47.254045 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfq9m\" (UniqueName: \"kubernetes.io/projected/34f7927b-7127-46ba-b999-f115e1aeb643-kube-api-access-pfq9m\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz\" (UID: \"34f7927b-7127-46ba-b999-f115e1aeb643\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz" Oct 29 23:16:47.255742 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:47.255718 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz"] Oct 29 23:16:47.340790 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:47.340753 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Oct 29 23:16:47.354670 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:47.354645 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfq9m\" (UniqueName: \"kubernetes.io/projected/34f7927b-7127-46ba-b999-f115e1aeb643-kube-api-access-pfq9m\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz\" (UID: \"34f7927b-7127-46ba-b999-f115e1aeb643\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz" Oct 29 23:16:47.354795 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:47.354676 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34f7927b-7127-46ba-b999-f115e1aeb643-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz\" (UID: \"34f7927b-7127-46ba-b999-f115e1aeb643\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz" Oct 29 23:16:47.354795 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:47.354737 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34f7927b-7127-46ba-b999-f115e1aeb643-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz\" (UID: \"34f7927b-7127-46ba-b999-f115e1aeb643\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz" Oct 29 23:16:47.355082 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:47.355065 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34f7927b-7127-46ba-b999-f115e1aeb643-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz\" (UID: \"34f7927b-7127-46ba-b999-f115e1aeb643\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz" Oct 29 23:16:47.355125 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:47.355104 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34f7927b-7127-46ba-b999-f115e1aeb643-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz\" (UID: \"34f7927b-7127-46ba-b999-f115e1aeb643\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz" Oct 29 23:16:47.376390 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:47.376357 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfq9m\" (UniqueName: \"kubernetes.io/projected/34f7927b-7127-46ba-b999-f115e1aeb643-kube-api-access-pfq9m\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz\" (UID: \"34f7927b-7127-46ba-b999-f115e1aeb643\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz" Oct 29 23:16:47.538898 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:47.538868 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz" Oct 29 23:16:47.845202 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:47.845179 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz"] Oct 29 23:16:47.846409 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:16:47.846383 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34f7927b_7127_46ba_b999_f115e1aeb643.slice/crio-956f30292e00440b3ed94561cb796c8c40fb1f61f93c152cce8b1a7b5debb8d2 WatchSource:0}: Error finding container 956f30292e00440b3ed94561cb796c8c40fb1f61f93c152cce8b1a7b5debb8d2: Status 404 returned error can't find the container with id 956f30292e00440b3ed94561cb796c8c40fb1f61f93c152cce8b1a7b5debb8d2 Oct 29 23:16:48.119843 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:48.119735 6029 generic.go:356] "Generic (PLEG): container finished" podID="34f7927b-7127-46ba-b999-f115e1aeb643" containerID="5d4a02009fb336d98dcf0af551fed6adf2b91a7c1220fb26ef638e6e1a765507" exitCode=0 Oct 29 23:16:48.119997 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:48.119838 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz" event={"ID":"34f7927b-7127-46ba-b999-f115e1aeb643","Type":"ContainerDied","Data":"5d4a02009fb336d98dcf0af551fed6adf2b91a7c1220fb26ef638e6e1a765507"} Oct 29 23:16:48.119997 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:48.119894 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz" event={"ID":"34f7927b-7127-46ba-b999-f115e1aeb643","Type":"ContainerStarted","Data":"956f30292e00440b3ed94561cb796c8c40fb1f61f93c152cce8b1a7b5debb8d2"} Oct 29 23:16:49.125700 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:49.125668 6029 generic.go:356] "Generic (PLEG): container finished" podID="34f7927b-7127-46ba-b999-f115e1aeb643" containerID="b78a6effdea94c921a360d87f1e6b51f76c1b57cdaa8017d4d91ac7bcc695b94" exitCode=0 Oct 29 23:16:49.126094 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:49.125751 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz" event={"ID":"34f7927b-7127-46ba-b999-f115e1aeb643","Type":"ContainerDied","Data":"b78a6effdea94c921a360d87f1e6b51f76c1b57cdaa8017d4d91ac7bcc695b94"} Oct 29 23:16:50.132308 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:50.132271 6029 generic.go:356] "Generic (PLEG): container finished" podID="34f7927b-7127-46ba-b999-f115e1aeb643" containerID="db4a07cd290028241adb6c90320459cb1ade5ae6af3c8827597cd58452d044d9" exitCode=0 Oct 29 23:16:50.132675 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:50.132328 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz" event={"ID":"34f7927b-7127-46ba-b999-f115e1aeb643","Type":"ContainerDied","Data":"db4a07cd290028241adb6c90320459cb1ade5ae6af3c8827597cd58452d044d9"} Oct 29 23:16:51.257892 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:51.257854 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz" Oct 29 23:16:51.290345 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:51.290311 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/34f7927b-7127-46ba-b999-f115e1aeb643-kube-api-access-pfq9m\" (UniqueName: \"kubernetes.io/projected/34f7927b-7127-46ba-b999-f115e1aeb643-kube-api-access-pfq9m\") pod \"34f7927b-7127-46ba-b999-f115e1aeb643\" (UID: \"34f7927b-7127-46ba-b999-f115e1aeb643\") " Oct 29 23:16:51.290500 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:51.290370 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/34f7927b-7127-46ba-b999-f115e1aeb643-bundle\" (UniqueName: \"kubernetes.io/empty-dir/34f7927b-7127-46ba-b999-f115e1aeb643-bundle\") pod \"34f7927b-7127-46ba-b999-f115e1aeb643\" (UID: \"34f7927b-7127-46ba-b999-f115e1aeb643\") " Oct 29 23:16:51.290500 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:51.290415 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/34f7927b-7127-46ba-b999-f115e1aeb643-util\" (UniqueName: \"kubernetes.io/empty-dir/34f7927b-7127-46ba-b999-f115e1aeb643-util\") pod \"34f7927b-7127-46ba-b999-f115e1aeb643\" (UID: \"34f7927b-7127-46ba-b999-f115e1aeb643\") " Oct 29 23:16:51.291023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:51.290999 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34f7927b-7127-46ba-b999-f115e1aeb643-bundle" pod "34f7927b-7127-46ba-b999-f115e1aeb643" (UID: "34f7927b-7127-46ba-b999-f115e1aeb643"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:16:51.292503 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:51.292478 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34f7927b-7127-46ba-b999-f115e1aeb643-kube-api-access-pfq9m" pod "34f7927b-7127-46ba-b999-f115e1aeb643" (UID: "34f7927b-7127-46ba-b999-f115e1aeb643"). InnerVolumeSpecName "kube-api-access-pfq9m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:16:51.295585 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:51.295563 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34f7927b-7127-46ba-b999-f115e1aeb643-util" pod "34f7927b-7127-46ba-b999-f115e1aeb643" (UID: "34f7927b-7127-46ba-b999-f115e1aeb643"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:16:51.391261 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:51.391180 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfq9m\" (UniqueName: \"kubernetes.io/projected/34f7927b-7127-46ba-b999-f115e1aeb643-kube-api-access-pfq9m\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:16:51.391261 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:51.391207 6029 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34f7927b-7127-46ba-b999-f115e1aeb643-bundle\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:16:51.391261 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:51.391217 6029 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34f7927b-7127-46ba-b999-f115e1aeb643-util\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:16:52.142912 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:52.142879 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz" event={"ID":"34f7927b-7127-46ba-b999-f115e1aeb643","Type":"ContainerDied","Data":"956f30292e00440b3ed94561cb796c8c40fb1f61f93c152cce8b1a7b5debb8d2"} Oct 29 23:16:52.143081 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:52.142928 6029 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="956f30292e00440b3ed94561cb796c8c40fb1f61f93c152cce8b1a7b5debb8d2" Oct 29 23:16:52.143081 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:52.142931 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zhwsz" Oct 29 23:16:59.166747 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.166716 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689"] Oct 29 23:16:59.167269 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.167106 6029 cpu_manager.go:414] "containerMap: removing container" podUID="34f7927b-7127-46ba-b999-f115e1aeb643" containerName="pull" Oct 29 23:16:59.167269 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.167120 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="34f7927b-7127-46ba-b999-f115e1aeb643" containerName="pull" Oct 29 23:16:59.167269 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.167134 6029 cpu_manager.go:414] "containerMap: removing container" podUID="34f7927b-7127-46ba-b999-f115e1aeb643" containerName="extract" Oct 29 23:16:59.167269 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.167142 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="34f7927b-7127-46ba-b999-f115e1aeb643" containerName="extract" Oct 29 23:16:59.167269 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.167169 6029 cpu_manager.go:414] "containerMap: removing container" podUID="34f7927b-7127-46ba-b999-f115e1aeb643" containerName="util" Oct 29 23:16:59.167269 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.167174 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="34f7927b-7127-46ba-b999-f115e1aeb643" containerName="util" Oct 29 23:16:59.167269 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.167253 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="34f7927b-7127-46ba-b999-f115e1aeb643" containerName="extract" Oct 29 23:16:59.171767 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.171748 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" Oct 29 23:16:59.189182 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.189156 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Oct 29 23:16:59.189182 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.189157 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Oct 29 23:16:59.202591 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.202564 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Oct 29 23:16:59.202591 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.202564 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Oct 29 23:16:59.202591 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.202592 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-metrics-tls\"" Oct 29 23:16:59.202767 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.202564 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n9h54\"" Oct 29 23:16:59.207344 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.207324 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689"] Oct 29 23:16:59.262464 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.262434 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4b1ce04-621e-4d74-83ca-d81f95cca923-tmp\") pod \"opendatahub-operator-controller-manager-bb7fb9d97-gn689\" (UID: \"a4b1ce04-621e-4d74-83ca-d81f95cca923\") " pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" Oct 29 23:16:59.262645 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.262501 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a4b1ce04-621e-4d74-83ca-d81f95cca923-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb7fb9d97-gn689\" (UID: \"a4b1ce04-621e-4d74-83ca-d81f95cca923\") " pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" Oct 29 23:16:59.262645 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.262528 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a4b1ce04-621e-4d74-83ca-d81f95cca923-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb7fb9d97-gn689\" (UID: \"a4b1ce04-621e-4d74-83ca-d81f95cca923\") " pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" Oct 29 23:16:59.262645 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.262599 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a4b1ce04-621e-4d74-83ca-d81f95cca923-manifests\") pod \"opendatahub-operator-controller-manager-bb7fb9d97-gn689\" (UID: \"a4b1ce04-621e-4d74-83ca-d81f95cca923\") " pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" Oct 29 23:16:59.262645 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.262626 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4b1ce04-621e-4d74-83ca-d81f95cca923-metrics-cert\") pod \"opendatahub-operator-controller-manager-bb7fb9d97-gn689\" (UID: \"a4b1ce04-621e-4d74-83ca-d81f95cca923\") " pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" Oct 29 23:16:59.262833 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.262693 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd49d\" (UniqueName: \"kubernetes.io/projected/a4b1ce04-621e-4d74-83ca-d81f95cca923-kube-api-access-fd49d\") pod \"opendatahub-operator-controller-manager-bb7fb9d97-gn689\" (UID: \"a4b1ce04-621e-4d74-83ca-d81f95cca923\") " pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" Oct 29 23:16:59.363547 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.363511 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4b1ce04-621e-4d74-83ca-d81f95cca923-tmp\") pod \"opendatahub-operator-controller-manager-bb7fb9d97-gn689\" (UID: \"a4b1ce04-621e-4d74-83ca-d81f95cca923\") " pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" Oct 29 23:16:59.363547 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.363552 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a4b1ce04-621e-4d74-83ca-d81f95cca923-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb7fb9d97-gn689\" (UID: \"a4b1ce04-621e-4d74-83ca-d81f95cca923\") " pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" Oct 29 23:16:59.363852 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.363573 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a4b1ce04-621e-4d74-83ca-d81f95cca923-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb7fb9d97-gn689\" (UID: \"a4b1ce04-621e-4d74-83ca-d81f95cca923\") " pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" Oct 29 23:16:59.363852 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.363615 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a4b1ce04-621e-4d74-83ca-d81f95cca923-manifests\") pod \"opendatahub-operator-controller-manager-bb7fb9d97-gn689\" (UID: \"a4b1ce04-621e-4d74-83ca-d81f95cca923\") " pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" Oct 29 23:16:59.363852 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.363645 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4b1ce04-621e-4d74-83ca-d81f95cca923-metrics-cert\") pod \"opendatahub-operator-controller-manager-bb7fb9d97-gn689\" (UID: \"a4b1ce04-621e-4d74-83ca-d81f95cca923\") " pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" Oct 29 23:16:59.363852 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.363697 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd49d\" (UniqueName: \"kubernetes.io/projected/a4b1ce04-621e-4d74-83ca-d81f95cca923-kube-api-access-fd49d\") pod \"opendatahub-operator-controller-manager-bb7fb9d97-gn689\" (UID: \"a4b1ce04-621e-4d74-83ca-d81f95cca923\") " pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" Oct 29 23:16:59.364121 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.364099 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a4b1ce04-621e-4d74-83ca-d81f95cca923-manifests\") pod \"opendatahub-operator-controller-manager-bb7fb9d97-gn689\" (UID: \"a4b1ce04-621e-4d74-83ca-d81f95cca923\") " pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" Oct 29 23:16:59.366149 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.366121 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4b1ce04-621e-4d74-83ca-d81f95cca923-tmp\") pod \"opendatahub-operator-controller-manager-bb7fb9d97-gn689\" (UID: \"a4b1ce04-621e-4d74-83ca-d81f95cca923\") " pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" Oct 29 23:16:59.366311 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.366179 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a4b1ce04-621e-4d74-83ca-d81f95cca923-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb7fb9d97-gn689\" (UID: \"a4b1ce04-621e-4d74-83ca-d81f95cca923\") " pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" Oct 29 23:16:59.366311 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.366267 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a4b1ce04-621e-4d74-83ca-d81f95cca923-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb7fb9d97-gn689\" (UID: \"a4b1ce04-621e-4d74-83ca-d81f95cca923\") " pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" Oct 29 23:16:59.366427 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.366312 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4b1ce04-621e-4d74-83ca-d81f95cca923-metrics-cert\") pod \"opendatahub-operator-controller-manager-bb7fb9d97-gn689\" (UID: \"a4b1ce04-621e-4d74-83ca-d81f95cca923\") " pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" Oct 29 23:16:59.385473 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.385451 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd49d\" (UniqueName: \"kubernetes.io/projected/a4b1ce04-621e-4d74-83ca-d81f95cca923-kube-api-access-fd49d\") pod \"opendatahub-operator-controller-manager-bb7fb9d97-gn689\" (UID: \"a4b1ce04-621e-4d74-83ca-d81f95cca923\") " pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" Oct 29 23:16:59.492385 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.492299 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" Oct 29 23:16:59.828899 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:16:59.828874 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689"] Oct 29 23:16:59.830741 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:16:59.830719 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4b1ce04_621e_4d74_83ca_d81f95cca923.slice/crio-63af71254bb811228f293b19868e56799b4450b0d85a5066e940b40a7ab7d7be WatchSource:0}: Error finding container 63af71254bb811228f293b19868e56799b4450b0d85a5066e940b40a7ab7d7be: Status 404 returned error can't find the container with id 63af71254bb811228f293b19868e56799b4450b0d85a5066e940b40a7ab7d7be Oct 29 23:17:00.176095 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:00.176021 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" event={"ID":"a4b1ce04-621e-4d74-83ca-d81f95cca923","Type":"ContainerStarted","Data":"63af71254bb811228f293b19868e56799b4450b0d85a5066e940b40a7ab7d7be"} Oct 29 23:17:03.194770 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:03.194678 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" event={"ID":"a4b1ce04-621e-4d74-83ca-d81f95cca923","Type":"ContainerStarted","Data":"163e62692c22615c9787b5957364eeaf0956d569f68cfc5f8677d37ba0df8937"} Oct 29 23:17:04.200277 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:04.200199 6029 generic.go:356] "Generic (PLEG): container finished" podID="a4b1ce04-621e-4d74-83ca-d81f95cca923" containerID="163e62692c22615c9787b5957364eeaf0956d569f68cfc5f8677d37ba0df8937" exitCode=0 Oct 29 23:17:04.200650 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:04.200291 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" event={"ID":"a4b1ce04-621e-4d74-83ca-d81f95cca923","Type":"ContainerDied","Data":"163e62692c22615c9787b5957364eeaf0956d569f68cfc5f8677d37ba0df8937"} Oct 29 23:17:05.206375 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:05.206337 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" event={"ID":"a4b1ce04-621e-4d74-83ca-d81f95cca923","Type":"ContainerStarted","Data":"7b979b95dc766fbf6d9ef5ab598d0ea104e3e14b12e3b79d35b04c4cc4baa502"} Oct 29 23:17:05.206912 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:05.206432 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" Oct 29 23:17:05.294930 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:05.294882 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" podStartSLOduration=2.522974776 podStartE2EDuration="6.294867183s" totalImagesPullingTime="3.277413763s" totalInitContainerRuntime="494.478644ms" isStatefulPod=false podCreationTimestamp="2026-10-29 23:16:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:17:05.280189277 +0000 UTC m=+192.006439899" watchObservedRunningTime="2026-10-29 23:17:05.294867183 +0000 UTC m=+192.021117776" Oct 29 23:17:08.919749 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:17:08.919714 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:17:16.212693 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:16.212658 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bb7fb9d97-gn689" Oct 29 23:17:20.604520 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.604487 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg"] Oct 29 23:17:20.612611 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.612586 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:20.629286 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.629263 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Oct 29 23:17:20.629472 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.629453 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Oct 29 23:17:20.629546 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.629478 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Oct 29 23:17:20.642853 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.642809 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Oct 29 23:17:20.642972 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.642856 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Oct 29 23:17:20.642972 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.642878 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Oct 29 23:17:20.642972 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.642880 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fms52\"" Oct 29 23:17:20.645710 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.645688 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg"] Oct 29 23:17:20.753175 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.753143 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ecbfe1be-40aa-4887-9f8e-de2996db8df1-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-75hcg\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:20.753357 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.753193 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-75hcg\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:20.753357 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.753220 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-75hcg\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:20.753357 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.753336 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecbfe1be-40aa-4887-9f8e-de2996db8df1-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-75hcg\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:20.753596 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.753375 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-75hcg\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:20.753596 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.753458 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-75hcg\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:20.753596 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.753486 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r458x\" (UniqueName: \"kubernetes.io/projected/ecbfe1be-40aa-4887-9f8e-de2996db8df1-kube-api-access-r458x\") pod \"istiod-openshift-gateway-7876bfcb74-75hcg\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:20.854836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.854736 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-75hcg\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:20.854836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.854782 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-75hcg\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:20.855052 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.854840 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecbfe1be-40aa-4887-9f8e-de2996db8df1-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-75hcg\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:20.855052 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.854877 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-75hcg\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:20.855052 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.854920 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-75hcg\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:20.855052 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.854950 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r458x\" (UniqueName: \"kubernetes.io/projected/ecbfe1be-40aa-4887-9f8e-de2996db8df1-kube-api-access-r458x\") pod \"istiod-openshift-gateway-7876bfcb74-75hcg\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:20.855052 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.854991 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ecbfe1be-40aa-4887-9f8e-de2996db8df1-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-75hcg\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:20.855506 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.855479 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-75hcg\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:20.857324 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.857299 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-75hcg\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:20.857324 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.857317 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-75hcg\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:20.857520 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.857506 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecbfe1be-40aa-4887-9f8e-de2996db8df1-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-75hcg\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:20.857697 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.857677 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ecbfe1be-40aa-4887-9f8e-de2996db8df1-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-75hcg\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:20.875589 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.875559 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r458x\" (UniqueName: \"kubernetes.io/projected/ecbfe1be-40aa-4887-9f8e-de2996db8df1-kube-api-access-r458x\") pod \"istiod-openshift-gateway-7876bfcb74-75hcg\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:20.875783 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.875764 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-75hcg\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:20.924708 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:20.924672 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:21.233798 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:21.233762 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg"] Oct 29 23:17:21.234969 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:17:21.234943 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecbfe1be_40aa_4887_9f8e_de2996db8df1.slice/crio-6dd9c58ec03f0a873544d2beb62d1e79661ac807b7ea78a3694bc794b045a080 WatchSource:0}: Error finding container 6dd9c58ec03f0a873544d2beb62d1e79661ac807b7ea78a3694bc794b045a080: Status 404 returned error can't find the container with id 6dd9c58ec03f0a873544d2beb62d1e79661ac807b7ea78a3694bc794b045a080 Oct 29 23:17:21.276631 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:21.276591 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" event={"ID":"ecbfe1be-40aa-4887-9f8e-de2996db8df1","Type":"ContainerStarted","Data":"6dd9c58ec03f0a873544d2beb62d1e79661ac807b7ea78a3694bc794b045a080"} Oct 29 23:17:24.339053 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:24.339018 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:17:24.339305 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:24.339088 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:17:25.299764 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:25.299725 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" event={"ID":"ecbfe1be-40aa-4887-9f8e-de2996db8df1","Type":"ContainerStarted","Data":"9538f6088f7e636b44babd97a34d87e6d0076909b6cd0a8f1bf1b417d47aef22"} Oct 29 23:17:25.300013 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:25.299846 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:25.301494 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:25.301461 6029 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-75hcg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 29 23:17:25.301605 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:25.301520 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" podUID="ecbfe1be-40aa-4887-9f8e-de2996db8df1" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 29 23:17:25.362161 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:25.362110 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" podStartSLOduration=2.260828133 podStartE2EDuration="5.362097437s" totalImagesPullingTime="3.101269304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:17:25.361790158 +0000 UTC m=+212.088040751" watchObservedRunningTime="2026-10-29 23:17:25.362097437 +0000 UTC m=+212.088348029" Oct 29 23:17:26.304781 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:17:26.304753 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:17:38.921006 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:17:38.920963 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:18:08.920137 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:18:08.920098 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:18:25.857538 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:25.857503 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg"] Oct 29 23:18:25.858004 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:25.857702 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" podUID="ecbfe1be-40aa-4887-9f8e-de2996db8df1" containerName="discovery" containerID="cri-o://9538f6088f7e636b44babd97a34d87e6d0076909b6cd0a8f1bf1b417d47aef22" gracePeriod=30 Oct 29 23:18:26.101264 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.101236 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:18:26.122705 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.122613 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-csr-dns-cert\") pod \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " Oct 29 23:18:26.122705 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.122691 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-token\" (UniqueName: \"kubernetes.io/projected/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-token\") pod \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " Oct 29 23:18:26.122965 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.122758 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-kubeconfig\") pod \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " Oct 29 23:18:26.122965 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.122787 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-csr-ca-configmap\") pod \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " Oct 29 23:18:26.122965 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.122832 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ecbfe1be-40aa-4887-9f8e-de2996db8df1-cacerts\" (UniqueName: \"kubernetes.io/secret/ecbfe1be-40aa-4887-9f8e-de2996db8df1-cacerts\") pod \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " Oct 29 23:18:26.122965 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.122864 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ecbfe1be-40aa-4887-9f8e-de2996db8df1-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecbfe1be-40aa-4887-9f8e-de2996db8df1-local-certs\") pod \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " Oct 29 23:18:26.122965 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.122912 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ecbfe1be-40aa-4887-9f8e-de2996db8df1-kube-api-access-r458x\" (UniqueName: \"kubernetes.io/projected/ecbfe1be-40aa-4887-9f8e-de2996db8df1-kube-api-access-r458x\") pod \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\" (UID: \"ecbfe1be-40aa-4887-9f8e-de2996db8df1\") " Oct 29 23:18:26.123417 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.123362 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-csr-ca-configmap" pod "ecbfe1be-40aa-4887-9f8e-de2996db8df1" (UID: "ecbfe1be-40aa-4887-9f8e-de2996db8df1"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:18:26.125268 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.125235 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-kubeconfig" pod "ecbfe1be-40aa-4887-9f8e-de2996db8df1" (UID: "ecbfe1be-40aa-4887-9f8e-de2996db8df1"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:18:26.125268 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.125260 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-token" pod "ecbfe1be-40aa-4887-9f8e-de2996db8df1" (UID: "ecbfe1be-40aa-4887-9f8e-de2996db8df1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:18:26.125423 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.125305 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-csr-dns-cert" pod "ecbfe1be-40aa-4887-9f8e-de2996db8df1" (UID: "ecbfe1be-40aa-4887-9f8e-de2996db8df1"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:18:26.125423 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.125353 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecbfe1be-40aa-4887-9f8e-de2996db8df1-local-certs" pod "ecbfe1be-40aa-4887-9f8e-de2996db8df1" (UID: "ecbfe1be-40aa-4887-9f8e-de2996db8df1"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:18:26.125634 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.125609 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecbfe1be-40aa-4887-9f8e-de2996db8df1-cacerts" pod "ecbfe1be-40aa-4887-9f8e-de2996db8df1" (UID: "ecbfe1be-40aa-4887-9f8e-de2996db8df1"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:18:26.125634 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.125621 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecbfe1be-40aa-4887-9f8e-de2996db8df1-kube-api-access-r458x" pod "ecbfe1be-40aa-4887-9f8e-de2996db8df1" (UID: "ecbfe1be-40aa-4887-9f8e-de2996db8df1"). InnerVolumeSpecName "kube-api-access-r458x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:18:26.224494 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.224456 6029 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:18:26.224494 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.224486 6029 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-kubeconfig\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:18:26.224494 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.224498 6029 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-csr-ca-configmap\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:18:26.224739 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.224514 6029 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ecbfe1be-40aa-4887-9f8e-de2996db8df1-cacerts\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:18:26.224739 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.224525 6029 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecbfe1be-40aa-4887-9f8e-de2996db8df1-local-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:18:26.224739 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.224535 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r458x\" (UniqueName: \"kubernetes.io/projected/ecbfe1be-40aa-4887-9f8e-de2996db8df1-kube-api-access-r458x\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:18:26.224739 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.224542 6029 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ecbfe1be-40aa-4887-9f8e-de2996db8df1-istio-csr-dns-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:18:26.576885 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.576844 6029 generic.go:356] "Generic (PLEG): container finished" podID="ecbfe1be-40aa-4887-9f8e-de2996db8df1" containerID="9538f6088f7e636b44babd97a34d87e6d0076909b6cd0a8f1bf1b417d47aef22" exitCode=0 Oct 29 23:18:26.577058 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.576911 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" event={"ID":"ecbfe1be-40aa-4887-9f8e-de2996db8df1","Type":"ContainerDied","Data":"9538f6088f7e636b44babd97a34d87e6d0076909b6cd0a8f1bf1b417d47aef22"} Oct 29 23:18:26.577058 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.576951 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" Oct 29 23:18:26.577058 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.576987 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg" event={"ID":"ecbfe1be-40aa-4887-9f8e-de2996db8df1","Type":"ContainerDied","Data":"6dd9c58ec03f0a873544d2beb62d1e79661ac807b7ea78a3694bc794b045a080"} Oct 29 23:18:26.577058 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.577012 6029 scope.go:122] "RemoveContainer" containerID="9538f6088f7e636b44babd97a34d87e6d0076909b6cd0a8f1bf1b417d47aef22" Oct 29 23:18:26.586526 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.586500 6029 scope.go:122] "RemoveContainer" containerID="9538f6088f7e636b44babd97a34d87e6d0076909b6cd0a8f1bf1b417d47aef22" Oct 29 23:18:26.586791 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:18:26.586772 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9538f6088f7e636b44babd97a34d87e6d0076909b6cd0a8f1bf1b417d47aef22\": container with ID starting with 9538f6088f7e636b44babd97a34d87e6d0076909b6cd0a8f1bf1b417d47aef22 not found: ID does not exist" containerID="9538f6088f7e636b44babd97a34d87e6d0076909b6cd0a8f1bf1b417d47aef22" Oct 29 23:18:26.586899 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.586803 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9538f6088f7e636b44babd97a34d87e6d0076909b6cd0a8f1bf1b417d47aef22"} err="failed to get container status \"9538f6088f7e636b44babd97a34d87e6d0076909b6cd0a8f1bf1b417d47aef22\": rpc error: code = NotFound desc = could not find container \"9538f6088f7e636b44babd97a34d87e6d0076909b6cd0a8f1bf1b417d47aef22\": container with ID starting with 9538f6088f7e636b44babd97a34d87e6d0076909b6cd0a8f1bf1b417d47aef22 not found: ID does not exist" Oct 29 23:18:26.646558 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.646525 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg"] Oct 29 23:18:26.652103 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:26.652072 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-75hcg"] Oct 29 23:18:27.387846 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:27.387799 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ecbfe1be-40aa-4887-9f8e-de2996db8df1" path="/var/lib/kubelet/pods/ecbfe1be-40aa-4887-9f8e-de2996db8df1/volumes" Oct 29 23:18:35.848279 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:35.848201 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bfdd46644-xkbm4"] Oct 29 23:18:35.848654 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:35.848554 6029 cpu_manager.go:414] "containerMap: removing container" podUID="ecbfe1be-40aa-4887-9f8e-de2996db8df1" containerName="discovery" Oct 29 23:18:35.848654 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:35.848568 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ecbfe1be-40aa-4887-9f8e-de2996db8df1" containerName="discovery" Oct 29 23:18:35.848654 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:35.848628 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="ecbfe1be-40aa-4887-9f8e-de2996db8df1" containerName="discovery" Oct 29 23:18:35.851752 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:35.851731 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bfdd46644-xkbm4" Oct 29 23:18:35.873978 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:35.873954 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bfdd46644-xkbm4"] Oct 29 23:18:35.883106 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:35.883048 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Oct 29 23:18:35.883256 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:35.883221 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Oct 29 23:18:35.883256 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:35.883224 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gwcll\"" Oct 29 23:18:35.886447 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:35.886428 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Oct 29 23:18:35.911526 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:35.911498 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eddcdb7f-af69-4b38-a63d-f9a5902643ad-cert\") pod \"lws-controller-manager-6bfdd46644-xkbm4\" (UID: \"eddcdb7f-af69-4b38-a63d-f9a5902643ad\") " pod="openshift-lws-operator/lws-controller-manager-6bfdd46644-xkbm4" Oct 29 23:18:35.911646 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:35.911530 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eddcdb7f-af69-4b38-a63d-f9a5902643ad-metrics-cert\") pod \"lws-controller-manager-6bfdd46644-xkbm4\" (UID: \"eddcdb7f-af69-4b38-a63d-f9a5902643ad\") " pod="openshift-lws-operator/lws-controller-manager-6bfdd46644-xkbm4" Oct 29 23:18:35.911646 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:35.911559 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq7t6\" (UniqueName: \"kubernetes.io/projected/eddcdb7f-af69-4b38-a63d-f9a5902643ad-kube-api-access-tq7t6\") pod \"lws-controller-manager-6bfdd46644-xkbm4\" (UID: \"eddcdb7f-af69-4b38-a63d-f9a5902643ad\") " pod="openshift-lws-operator/lws-controller-manager-6bfdd46644-xkbm4" Oct 29 23:18:35.911733 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:35.911687 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eddcdb7f-af69-4b38-a63d-f9a5902643ad-manager-config\") pod \"lws-controller-manager-6bfdd46644-xkbm4\" (UID: \"eddcdb7f-af69-4b38-a63d-f9a5902643ad\") " pod="openshift-lws-operator/lws-controller-manager-6bfdd46644-xkbm4" Oct 29 23:18:36.012835 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:36.012785 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eddcdb7f-af69-4b38-a63d-f9a5902643ad-cert\") pod \"lws-controller-manager-6bfdd46644-xkbm4\" (UID: \"eddcdb7f-af69-4b38-a63d-f9a5902643ad\") " pod="openshift-lws-operator/lws-controller-manager-6bfdd46644-xkbm4" Oct 29 23:18:36.012835 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:36.012833 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eddcdb7f-af69-4b38-a63d-f9a5902643ad-metrics-cert\") pod \"lws-controller-manager-6bfdd46644-xkbm4\" (UID: \"eddcdb7f-af69-4b38-a63d-f9a5902643ad\") " pod="openshift-lws-operator/lws-controller-manager-6bfdd46644-xkbm4" Oct 29 23:18:36.013104 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:36.012864 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq7t6\" (UniqueName: \"kubernetes.io/projected/eddcdb7f-af69-4b38-a63d-f9a5902643ad-kube-api-access-tq7t6\") pod \"lws-controller-manager-6bfdd46644-xkbm4\" (UID: \"eddcdb7f-af69-4b38-a63d-f9a5902643ad\") " pod="openshift-lws-operator/lws-controller-manager-6bfdd46644-xkbm4" Oct 29 23:18:36.013104 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:36.012895 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eddcdb7f-af69-4b38-a63d-f9a5902643ad-manager-config\") pod \"lws-controller-manager-6bfdd46644-xkbm4\" (UID: \"eddcdb7f-af69-4b38-a63d-f9a5902643ad\") " pod="openshift-lws-operator/lws-controller-manager-6bfdd46644-xkbm4" Oct 29 23:18:36.013594 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:36.013570 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eddcdb7f-af69-4b38-a63d-f9a5902643ad-manager-config\") pod \"lws-controller-manager-6bfdd46644-xkbm4\" (UID: \"eddcdb7f-af69-4b38-a63d-f9a5902643ad\") " pod="openshift-lws-operator/lws-controller-manager-6bfdd46644-xkbm4" Oct 29 23:18:36.015379 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:36.015357 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eddcdb7f-af69-4b38-a63d-f9a5902643ad-cert\") pod \"lws-controller-manager-6bfdd46644-xkbm4\" (UID: \"eddcdb7f-af69-4b38-a63d-f9a5902643ad\") " pod="openshift-lws-operator/lws-controller-manager-6bfdd46644-xkbm4" Oct 29 23:18:36.015520 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:36.015403 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eddcdb7f-af69-4b38-a63d-f9a5902643ad-metrics-cert\") pod \"lws-controller-manager-6bfdd46644-xkbm4\" (UID: \"eddcdb7f-af69-4b38-a63d-f9a5902643ad\") " pod="openshift-lws-operator/lws-controller-manager-6bfdd46644-xkbm4" Oct 29 23:18:36.033303 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:36.033272 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq7t6\" (UniqueName: \"kubernetes.io/projected/eddcdb7f-af69-4b38-a63d-f9a5902643ad-kube-api-access-tq7t6\") pod \"lws-controller-manager-6bfdd46644-xkbm4\" (UID: \"eddcdb7f-af69-4b38-a63d-f9a5902643ad\") " pod="openshift-lws-operator/lws-controller-manager-6bfdd46644-xkbm4" Oct 29 23:18:36.163781 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:36.163694 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bfdd46644-xkbm4" Oct 29 23:18:36.460220 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:36.460056 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bfdd46644-xkbm4"] Oct 29 23:18:36.462628 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:18:36.462598 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeddcdb7f_af69_4b38_a63d_f9a5902643ad.slice/crio-a3b129171519c99233ec05f72af34f74d8d61b134ae142b16019477062df25c1 WatchSource:0}: Error finding container a3b129171519c99233ec05f72af34f74d8d61b134ae142b16019477062df25c1: Status 404 returned error can't find the container with id a3b129171519c99233ec05f72af34f74d8d61b134ae142b16019477062df25c1 Oct 29 23:18:36.626504 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:36.626469 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bfdd46644-xkbm4" event={"ID":"eddcdb7f-af69-4b38-a63d-f9a5902643ad","Type":"ContainerStarted","Data":"a3b129171519c99233ec05f72af34f74d8d61b134ae142b16019477062df25c1"} Oct 29 23:18:38.925596 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:18:38.925559 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:18:39.641537 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:39.641500 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bfdd46644-xkbm4" event={"ID":"eddcdb7f-af69-4b38-a63d-f9a5902643ad","Type":"ContainerStarted","Data":"098946740d3f5b8663b73693afcd76fff9cf097d04da1d0819d007ad3c1c9a47"} Oct 29 23:18:39.641752 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:39.641621 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6bfdd46644-xkbm4" Oct 29 23:18:39.684629 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:39.684573 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6bfdd46644-xkbm4" podStartSLOduration=2.09167263 podStartE2EDuration="4.684557682s" totalImagesPullingTime="2.592885052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:18:39.683934582 +0000 UTC m=+286.410185174" watchObservedRunningTime="2026-10-29 23:18:39.684557682 +0000 UTC m=+286.410808679" Oct 29 23:18:50.648207 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:18:50.648176 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6bfdd46644-xkbm4" Oct 29 23:19:08.920111 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:19:08.920070 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:19:14.211874 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.211838 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd"] Oct 29 23:19:14.215455 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.215437 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd" Oct 29 23:19:14.248454 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.248417 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Oct 29 23:19:14.248708 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.248682 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-k2mvg\"" Oct 29 23:19:14.248857 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.248720 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Oct 29 23:19:14.249680 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.249652 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd"] Oct 29 23:19:14.253139 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.253116 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0695b399-4e46-45dd-9e48-19598bb4e198-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd\" (UID: \"0695b399-4e46-45dd-9e48-19598bb4e198\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd" Oct 29 23:19:14.253235 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.253146 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0695b399-4e46-45dd-9e48-19598bb4e198-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd\" (UID: \"0695b399-4e46-45dd-9e48-19598bb4e198\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd" Oct 29 23:19:14.253235 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.253172 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t8dg\" (UniqueName: \"kubernetes.io/projected/0695b399-4e46-45dd-9e48-19598bb4e198-kube-api-access-4t8dg\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd\" (UID: \"0695b399-4e46-45dd-9e48-19598bb4e198\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd" Oct 29 23:19:14.301475 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.301448 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77"] Oct 29 23:19:14.305058 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.305038 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77" Oct 29 23:19:14.326214 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.326184 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-kcsq9\"" Oct 29 23:19:14.328168 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.328137 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77"] Oct 29 23:19:14.353717 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.353686 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0a8e601-6c5b-4345-aa25-4ef380f049cf-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77\" (UID: \"b0a8e601-6c5b-4345-aa25-4ef380f049cf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77" Oct 29 23:19:14.353898 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.353724 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4rdt\" (UniqueName: \"kubernetes.io/projected/b0a8e601-6c5b-4345-aa25-4ef380f049cf-kube-api-access-h4rdt\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77\" (UID: \"b0a8e601-6c5b-4345-aa25-4ef380f049cf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77" Oct 29 23:19:14.353944 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.353901 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0a8e601-6c5b-4345-aa25-4ef380f049cf-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77\" (UID: \"b0a8e601-6c5b-4345-aa25-4ef380f049cf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77" Oct 29 23:19:14.354001 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.353984 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0695b399-4e46-45dd-9e48-19598bb4e198-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd\" (UID: \"0695b399-4e46-45dd-9e48-19598bb4e198\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd" Oct 29 23:19:14.354036 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.354011 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0695b399-4e46-45dd-9e48-19598bb4e198-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd\" (UID: \"0695b399-4e46-45dd-9e48-19598bb4e198\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd" Oct 29 23:19:14.354036 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.354029 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t8dg\" (UniqueName: \"kubernetes.io/projected/0695b399-4e46-45dd-9e48-19598bb4e198-kube-api-access-4t8dg\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd\" (UID: \"0695b399-4e46-45dd-9e48-19598bb4e198\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd" Oct 29 23:19:14.354373 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.354357 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0695b399-4e46-45dd-9e48-19598bb4e198-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd\" (UID: \"0695b399-4e46-45dd-9e48-19598bb4e198\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd" Oct 29 23:19:14.354436 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.354419 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0695b399-4e46-45dd-9e48-19598bb4e198-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd\" (UID: \"0695b399-4e46-45dd-9e48-19598bb4e198\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd" Oct 29 23:19:14.375862 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.375805 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t8dg\" (UniqueName: \"kubernetes.io/projected/0695b399-4e46-45dd-9e48-19598bb4e198-kube-api-access-4t8dg\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd\" (UID: \"0695b399-4e46-45dd-9e48-19598bb4e198\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd" Oct 29 23:19:14.404796 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.404767 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws"] Oct 29 23:19:14.408283 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.408262 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws" Oct 29 23:19:14.427392 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.427103 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-k2zpg\"" Oct 29 23:19:14.428349 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.428323 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws"] Oct 29 23:19:14.454884 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.454845 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0a8e601-6c5b-4345-aa25-4ef380f049cf-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77\" (UID: \"b0a8e601-6c5b-4345-aa25-4ef380f049cf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77" Oct 29 23:19:14.455119 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.454899 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4ltr\" (UniqueName: \"kubernetes.io/projected/435d72d5-a819-45f0-bb74-35de62dc4539-kube-api-access-j4ltr\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws\" (UID: \"435d72d5-a819-45f0-bb74-35de62dc4539\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws" Oct 29 23:19:14.455739 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.455692 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/435d72d5-a819-45f0-bb74-35de62dc4539-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws\" (UID: \"435d72d5-a819-45f0-bb74-35de62dc4539\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws" Oct 29 23:19:14.455880 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.455743 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0a8e601-6c5b-4345-aa25-4ef380f049cf-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77\" (UID: \"b0a8e601-6c5b-4345-aa25-4ef380f049cf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77" Oct 29 23:19:14.455880 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.455773 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/435d72d5-a819-45f0-bb74-35de62dc4539-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws\" (UID: \"435d72d5-a819-45f0-bb74-35de62dc4539\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws" Oct 29 23:19:14.456059 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.455924 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0a8e601-6c5b-4345-aa25-4ef380f049cf-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77\" (UID: \"b0a8e601-6c5b-4345-aa25-4ef380f049cf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77" Oct 29 23:19:14.457528 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.457504 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0a8e601-6c5b-4345-aa25-4ef380f049cf-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77\" (UID: \"b0a8e601-6c5b-4345-aa25-4ef380f049cf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77" Oct 29 23:19:14.457676 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.457658 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4rdt\" (UniqueName: \"kubernetes.io/projected/b0a8e601-6c5b-4345-aa25-4ef380f049cf-kube-api-access-h4rdt\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77\" (UID: \"b0a8e601-6c5b-4345-aa25-4ef380f049cf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77" Oct 29 23:19:14.481662 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.481591 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4rdt\" (UniqueName: \"kubernetes.io/projected/b0a8e601-6c5b-4345-aa25-4ef380f049cf-kube-api-access-h4rdt\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77\" (UID: \"b0a8e601-6c5b-4345-aa25-4ef380f049cf\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77" Oct 29 23:19:14.510998 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.510965 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz"] Oct 29 23:19:14.514673 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.514656 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz" Oct 29 23:19:14.530776 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.530746 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd" Oct 29 23:19:14.531289 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.531270 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-tr5k6\"" Oct 29 23:19:14.536591 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.536561 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz"] Oct 29 23:19:14.558927 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.558889 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/435d72d5-a819-45f0-bb74-35de62dc4539-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws\" (UID: \"435d72d5-a819-45f0-bb74-35de62dc4539\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws" Oct 29 23:19:14.558927 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.558927 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/435d72d5-a819-45f0-bb74-35de62dc4539-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws\" (UID: \"435d72d5-a819-45f0-bb74-35de62dc4539\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws" Oct 29 23:19:14.559153 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.559039 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58d1f86f-2ef3-4230-b01c-bf56d5bd0865-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz\" (UID: \"58d1f86f-2ef3-4230-b01c-bf56d5bd0865\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz" Oct 29 23:19:14.559153 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.559076 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58d1f86f-2ef3-4230-b01c-bf56d5bd0865-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz\" (UID: \"58d1f86f-2ef3-4230-b01c-bf56d5bd0865\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz" Oct 29 23:19:14.559153 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.559103 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4ltr\" (UniqueName: \"kubernetes.io/projected/435d72d5-a819-45f0-bb74-35de62dc4539-kube-api-access-j4ltr\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws\" (UID: \"435d72d5-a819-45f0-bb74-35de62dc4539\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws" Oct 29 23:19:14.559326 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.559194 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9tbg\" (UniqueName: \"kubernetes.io/projected/58d1f86f-2ef3-4230-b01c-bf56d5bd0865-kube-api-access-f9tbg\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz\" (UID: \"58d1f86f-2ef3-4230-b01c-bf56d5bd0865\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz" Oct 29 23:19:14.559377 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.559322 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/435d72d5-a819-45f0-bb74-35de62dc4539-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws\" (UID: \"435d72d5-a819-45f0-bb74-35de62dc4539\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws" Oct 29 23:19:14.559377 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.559347 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/435d72d5-a819-45f0-bb74-35de62dc4539-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws\" (UID: \"435d72d5-a819-45f0-bb74-35de62dc4539\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws" Oct 29 23:19:14.587757 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.587722 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4ltr\" (UniqueName: \"kubernetes.io/projected/435d72d5-a819-45f0-bb74-35de62dc4539-kube-api-access-j4ltr\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws\" (UID: \"435d72d5-a819-45f0-bb74-35de62dc4539\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws" Oct 29 23:19:14.620978 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.620936 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77" Oct 29 23:19:14.660531 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.660496 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58d1f86f-2ef3-4230-b01c-bf56d5bd0865-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz\" (UID: \"58d1f86f-2ef3-4230-b01c-bf56d5bd0865\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz" Oct 29 23:19:14.660723 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.660568 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9tbg\" (UniqueName: \"kubernetes.io/projected/58d1f86f-2ef3-4230-b01c-bf56d5bd0865-kube-api-access-f9tbg\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz\" (UID: \"58d1f86f-2ef3-4230-b01c-bf56d5bd0865\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz" Oct 29 23:19:14.660723 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.660636 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58d1f86f-2ef3-4230-b01c-bf56d5bd0865-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz\" (UID: \"58d1f86f-2ef3-4230-b01c-bf56d5bd0865\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz" Oct 29 23:19:14.660970 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.660949 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58d1f86f-2ef3-4230-b01c-bf56d5bd0865-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz\" (UID: \"58d1f86f-2ef3-4230-b01c-bf56d5bd0865\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz" Oct 29 23:19:14.661062 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.661034 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58d1f86f-2ef3-4230-b01c-bf56d5bd0865-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz\" (UID: \"58d1f86f-2ef3-4230-b01c-bf56d5bd0865\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz" Oct 29 23:19:14.682208 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.682177 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9tbg\" (UniqueName: \"kubernetes.io/projected/58d1f86f-2ef3-4230-b01c-bf56d5bd0865-kube-api-access-f9tbg\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz\" (UID: \"58d1f86f-2ef3-4230-b01c-bf56d5bd0865\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz" Oct 29 23:19:14.724654 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.724625 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws" Oct 29 23:19:14.826641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.826611 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd"] Oct 29 23:19:14.827392 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:19:14.827365 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0695b399_4e46_45dd_9e48_19598bb4e198.slice/crio-48e1a325a554d8bef7f82e339745c40ff70f2e6ac8d3b5d907b06ae6fdb0c0df WatchSource:0}: Error finding container 48e1a325a554d8bef7f82e339745c40ff70f2e6ac8d3b5d907b06ae6fdb0c0df: Status 404 returned error can't find the container with id 48e1a325a554d8bef7f82e339745c40ff70f2e6ac8d3b5d907b06ae6fdb0c0df Oct 29 23:19:14.830687 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.830663 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz" Oct 29 23:19:14.912846 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:14.912798 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77"] Oct 29 23:19:14.915839 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:19:14.915788 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0a8e601_6c5b_4345_aa25_4ef380f049cf.slice/crio-a4c0a8ce03a72833b74d43ad49ef51dc40ea74acc2a8a74d5df67b39cc21fa87 WatchSource:0}: Error finding container a4c0a8ce03a72833b74d43ad49ef51dc40ea74acc2a8a74d5df67b39cc21fa87: Status 404 returned error can't find the container with id a4c0a8ce03a72833b74d43ad49ef51dc40ea74acc2a8a74d5df67b39cc21fa87 Oct 29 23:19:15.020265 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:15.020237 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws"] Oct 29 23:19:15.021054 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:19:15.021028 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod435d72d5_a819_45f0_bb74_35de62dc4539.slice/crio-e843e7d56c8e9006e059ac08d2b45aea266d5bc3d92438bd05a7be34b0c4006f WatchSource:0}: Error finding container e843e7d56c8e9006e059ac08d2b45aea266d5bc3d92438bd05a7be34b0c4006f: Status 404 returned error can't find the container with id e843e7d56c8e9006e059ac08d2b45aea266d5bc3d92438bd05a7be34b0c4006f Oct 29 23:19:15.129786 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:15.129762 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz"] Oct 29 23:19:15.191745 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:19:15.191709 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58d1f86f_2ef3_4230_b01c_bf56d5bd0865.slice/crio-c1b1e2e58407f7c2d94341aa58e8d422835b87f08980f84af11a88e7728e5a05 WatchSource:0}: Error finding container c1b1e2e58407f7c2d94341aa58e8d422835b87f08980f84af11a88e7728e5a05: Status 404 returned error can't find the container with id c1b1e2e58407f7c2d94341aa58e8d422835b87f08980f84af11a88e7728e5a05 Oct 29 23:19:15.797330 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:15.797297 6029 generic.go:356] "Generic (PLEG): container finished" podID="435d72d5-a819-45f0-bb74-35de62dc4539" containerID="593cdef77b22b3ce7bcf9df756d98df8a2cce339da4bff31809a766099cc246b" exitCode=0 Oct 29 23:19:15.797753 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:15.797372 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws" event={"ID":"435d72d5-a819-45f0-bb74-35de62dc4539","Type":"ContainerDied","Data":"593cdef77b22b3ce7bcf9df756d98df8a2cce339da4bff31809a766099cc246b"} Oct 29 23:19:15.797753 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:15.797413 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws" event={"ID":"435d72d5-a819-45f0-bb74-35de62dc4539","Type":"ContainerStarted","Data":"e843e7d56c8e9006e059ac08d2b45aea266d5bc3d92438bd05a7be34b0c4006f"} Oct 29 23:19:15.798581 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:15.798563 6029 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 29 23:19:15.798894 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:15.798874 6029 generic.go:356] "Generic (PLEG): container finished" podID="b0a8e601-6c5b-4345-aa25-4ef380f049cf" containerID="b68c718436842817f1fad071bfceffb571acbbeb257a78053b0e4d991a7101e9" exitCode=0 Oct 29 23:19:15.798980 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:15.798952 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77" event={"ID":"b0a8e601-6c5b-4345-aa25-4ef380f049cf","Type":"ContainerDied","Data":"b68c718436842817f1fad071bfceffb571acbbeb257a78053b0e4d991a7101e9"} Oct 29 23:19:15.799035 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:15.798994 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77" event={"ID":"b0a8e601-6c5b-4345-aa25-4ef380f049cf","Type":"ContainerStarted","Data":"a4c0a8ce03a72833b74d43ad49ef51dc40ea74acc2a8a74d5df67b39cc21fa87"} Oct 29 23:19:15.800583 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:15.800558 6029 generic.go:356] "Generic (PLEG): container finished" podID="0695b399-4e46-45dd-9e48-19598bb4e198" containerID="dd0be8aa96c230f82bf7d7a99833632534547f237f5a3dce4734de38d91018d3" exitCode=0 Oct 29 23:19:15.800737 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:15.800681 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd" event={"ID":"0695b399-4e46-45dd-9e48-19598bb4e198","Type":"ContainerDied","Data":"dd0be8aa96c230f82bf7d7a99833632534547f237f5a3dce4734de38d91018d3"} Oct 29 23:19:15.800737 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:15.800722 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd" event={"ID":"0695b399-4e46-45dd-9e48-19598bb4e198","Type":"ContainerStarted","Data":"48e1a325a554d8bef7f82e339745c40ff70f2e6ac8d3b5d907b06ae6fdb0c0df"} Oct 29 23:19:15.802257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:15.802235 6029 generic.go:356] "Generic (PLEG): container finished" podID="58d1f86f-2ef3-4230-b01c-bf56d5bd0865" containerID="174edf80368e6447fae9002221d9907e57c016c9be3716703c14589c8b6cfd71" exitCode=0 Oct 29 23:19:15.802446 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:15.802296 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz" event={"ID":"58d1f86f-2ef3-4230-b01c-bf56d5bd0865","Type":"ContainerDied","Data":"174edf80368e6447fae9002221d9907e57c016c9be3716703c14589c8b6cfd71"} Oct 29 23:19:15.802446 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:15.802322 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz" event={"ID":"58d1f86f-2ef3-4230-b01c-bf56d5bd0865","Type":"ContainerStarted","Data":"c1b1e2e58407f7c2d94341aa58e8d422835b87f08980f84af11a88e7728e5a05"} Oct 29 23:19:16.808444 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:16.808412 6029 generic.go:356] "Generic (PLEG): container finished" podID="58d1f86f-2ef3-4230-b01c-bf56d5bd0865" containerID="e01e17d123c535b699f2e083ed54eac4aa689ca0e69f789e1ee57320cc091595" exitCode=0 Oct 29 23:19:16.808845 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:16.808500 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz" event={"ID":"58d1f86f-2ef3-4230-b01c-bf56d5bd0865","Type":"ContainerDied","Data":"e01e17d123c535b699f2e083ed54eac4aa689ca0e69f789e1ee57320cc091595"} Oct 29 23:19:16.810553 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:16.810533 6029 generic.go:356] "Generic (PLEG): container finished" podID="435d72d5-a819-45f0-bb74-35de62dc4539" containerID="1df05438dde024554c347e2283d38c2758aa76dbc4b9da93772b7c6bdc11dde1" exitCode=0 Oct 29 23:19:16.810656 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:16.810595 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws" event={"ID":"435d72d5-a819-45f0-bb74-35de62dc4539","Type":"ContainerDied","Data":"1df05438dde024554c347e2283d38c2758aa76dbc4b9da93772b7c6bdc11dde1"} Oct 29 23:19:16.812529 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:16.812506 6029 generic.go:356] "Generic (PLEG): container finished" podID="0695b399-4e46-45dd-9e48-19598bb4e198" containerID="9e60926601ae56b4d0fe867415ec850c4d64c4c589c1137a74a6de38ac205266" exitCode=0 Oct 29 23:19:16.812585 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:16.812563 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd" event={"ID":"0695b399-4e46-45dd-9e48-19598bb4e198","Type":"ContainerDied","Data":"9e60926601ae56b4d0fe867415ec850c4d64c4c589c1137a74a6de38ac205266"} Oct 29 23:19:17.818564 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:17.818522 6029 generic.go:356] "Generic (PLEG): container finished" podID="58d1f86f-2ef3-4230-b01c-bf56d5bd0865" containerID="4c82d6b3a199c1bf56fae95af327f49d92c2249e2b2ea9ae23aab6218320ee1d" exitCode=0 Oct 29 23:19:17.818989 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:17.818602 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz" event={"ID":"58d1f86f-2ef3-4230-b01c-bf56d5bd0865","Type":"ContainerDied","Data":"4c82d6b3a199c1bf56fae95af327f49d92c2249e2b2ea9ae23aab6218320ee1d"} Oct 29 23:19:17.820660 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:17.820636 6029 generic.go:356] "Generic (PLEG): container finished" podID="435d72d5-a819-45f0-bb74-35de62dc4539" containerID="41d28dc2302c0fd1f6c144ffbb80be5f71dfc8595a44fa4c7a50e8b115ab8d38" exitCode=0 Oct 29 23:19:17.820800 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:17.820677 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws" event={"ID":"435d72d5-a819-45f0-bb74-35de62dc4539","Type":"ContainerDied","Data":"41d28dc2302c0fd1f6c144ffbb80be5f71dfc8595a44fa4c7a50e8b115ab8d38"} Oct 29 23:19:17.822327 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:17.822310 6029 generic.go:356] "Generic (PLEG): container finished" podID="b0a8e601-6c5b-4345-aa25-4ef380f049cf" containerID="7bd742117dfb2f4e6c5025039b995b46af7c9d40b263fe347b52f3c812d178f4" exitCode=0 Oct 29 23:19:17.822425 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:17.822372 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77" event={"ID":"b0a8e601-6c5b-4345-aa25-4ef380f049cf","Type":"ContainerDied","Data":"7bd742117dfb2f4e6c5025039b995b46af7c9d40b263fe347b52f3c812d178f4"} Oct 29 23:19:17.824897 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:17.824876 6029 generic.go:356] "Generic (PLEG): container finished" podID="0695b399-4e46-45dd-9e48-19598bb4e198" containerID="c707a9c95d3f4b8e8ee9e41be59e4ae52f762e92c0ebccf60270c419087a78b1" exitCode=0 Oct 29 23:19:17.824998 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:17.824957 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd" event={"ID":"0695b399-4e46-45dd-9e48-19598bb4e198","Type":"ContainerDied","Data":"c707a9c95d3f4b8e8ee9e41be59e4ae52f762e92c0ebccf60270c419087a78b1"} Oct 29 23:19:18.831223 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:18.831187 6029 generic.go:356] "Generic (PLEG): container finished" podID="b0a8e601-6c5b-4345-aa25-4ef380f049cf" containerID="9e6ab8552572edd3d1def1774bf5117a7c8cb4e21d65e41640162216b7bb2152" exitCode=0 Oct 29 23:19:18.831674 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:18.831252 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77" event={"ID":"b0a8e601-6c5b-4345-aa25-4ef380f049cf","Type":"ContainerDied","Data":"9e6ab8552572edd3d1def1774bf5117a7c8cb4e21d65e41640162216b7bb2152"} Oct 29 23:19:18.964130 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:18.964097 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd" Oct 29 23:19:18.998278 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:18.998255 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0695b399-4e46-45dd-9e48-19598bb4e198-bundle\" (UniqueName: \"kubernetes.io/empty-dir/0695b399-4e46-45dd-9e48-19598bb4e198-bundle\") pod \"0695b399-4e46-45dd-9e48-19598bb4e198\" (UID: \"0695b399-4e46-45dd-9e48-19598bb4e198\") " Oct 29 23:19:18.998372 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:18.998304 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0695b399-4e46-45dd-9e48-19598bb4e198-util\" (UniqueName: \"kubernetes.io/empty-dir/0695b399-4e46-45dd-9e48-19598bb4e198-util\") pod \"0695b399-4e46-45dd-9e48-19598bb4e198\" (UID: \"0695b399-4e46-45dd-9e48-19598bb4e198\") " Oct 29 23:19:18.998372 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:18.998327 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0695b399-4e46-45dd-9e48-19598bb4e198-kube-api-access-4t8dg\" (UniqueName: \"kubernetes.io/projected/0695b399-4e46-45dd-9e48-19598bb4e198-kube-api-access-4t8dg\") pod \"0695b399-4e46-45dd-9e48-19598bb4e198\" (UID: \"0695b399-4e46-45dd-9e48-19598bb4e198\") " Oct 29 23:19:18.998892 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:18.998862 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0695b399-4e46-45dd-9e48-19598bb4e198-bundle" pod "0695b399-4e46-45dd-9e48-19598bb4e198" (UID: "0695b399-4e46-45dd-9e48-19598bb4e198"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:19:19.000503 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.000480 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0695b399-4e46-45dd-9e48-19598bb4e198-kube-api-access-4t8dg" pod "0695b399-4e46-45dd-9e48-19598bb4e198" (UID: "0695b399-4e46-45dd-9e48-19598bb4e198"). InnerVolumeSpecName "kube-api-access-4t8dg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:19:19.003860 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.003837 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0695b399-4e46-45dd-9e48-19598bb4e198-util" pod "0695b399-4e46-45dd-9e48-19598bb4e198" (UID: "0695b399-4e46-45dd-9e48-19598bb4e198"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:19:19.013535 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.013510 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz" Oct 29 23:19:19.016487 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.016469 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws" Oct 29 23:19:19.099596 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.099512 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/58d1f86f-2ef3-4230-b01c-bf56d5bd0865-kube-api-access-f9tbg\" (UniqueName: \"kubernetes.io/projected/58d1f86f-2ef3-4230-b01c-bf56d5bd0865-kube-api-access-f9tbg\") pod \"58d1f86f-2ef3-4230-b01c-bf56d5bd0865\" (UID: \"58d1f86f-2ef3-4230-b01c-bf56d5bd0865\") " Oct 29 23:19:19.099753 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.099611 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/58d1f86f-2ef3-4230-b01c-bf56d5bd0865-util\" (UniqueName: \"kubernetes.io/empty-dir/58d1f86f-2ef3-4230-b01c-bf56d5bd0865-util\") pod \"58d1f86f-2ef3-4230-b01c-bf56d5bd0865\" (UID: \"58d1f86f-2ef3-4230-b01c-bf56d5bd0865\") " Oct 29 23:19:19.099753 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.099652 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/435d72d5-a819-45f0-bb74-35de62dc4539-kube-api-access-j4ltr\" (UniqueName: \"kubernetes.io/projected/435d72d5-a819-45f0-bb74-35de62dc4539-kube-api-access-j4ltr\") pod \"435d72d5-a819-45f0-bb74-35de62dc4539\" (UID: \"435d72d5-a819-45f0-bb74-35de62dc4539\") " Oct 29 23:19:19.099753 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.099682 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/435d72d5-a819-45f0-bb74-35de62dc4539-util\" (UniqueName: \"kubernetes.io/empty-dir/435d72d5-a819-45f0-bb74-35de62dc4539-util\") pod \"435d72d5-a819-45f0-bb74-35de62dc4539\" (UID: \"435d72d5-a819-45f0-bb74-35de62dc4539\") " Oct 29 23:19:19.099753 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.099741 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/58d1f86f-2ef3-4230-b01c-bf56d5bd0865-bundle\" (UniqueName: \"kubernetes.io/empty-dir/58d1f86f-2ef3-4230-b01c-bf56d5bd0865-bundle\") pod \"58d1f86f-2ef3-4230-b01c-bf56d5bd0865\" (UID: \"58d1f86f-2ef3-4230-b01c-bf56d5bd0865\") " Oct 29 23:19:19.100000 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.099772 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/435d72d5-a819-45f0-bb74-35de62dc4539-bundle\" (UniqueName: \"kubernetes.io/empty-dir/435d72d5-a819-45f0-bb74-35de62dc4539-bundle\") pod \"435d72d5-a819-45f0-bb74-35de62dc4539\" (UID: \"435d72d5-a819-45f0-bb74-35de62dc4539\") " Oct 29 23:19:19.100077 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.100060 6029 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0695b399-4e46-45dd-9e48-19598bb4e198-util\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:19:19.100132 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.100084 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4t8dg\" (UniqueName: \"kubernetes.io/projected/0695b399-4e46-45dd-9e48-19598bb4e198-kube-api-access-4t8dg\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:19:19.100132 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.100099 6029 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0695b399-4e46-45dd-9e48-19598bb4e198-bundle\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:19:19.100649 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.100604 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/435d72d5-a819-45f0-bb74-35de62dc4539-bundle" pod "435d72d5-a819-45f0-bb74-35de62dc4539" (UID: "435d72d5-a819-45f0-bb74-35de62dc4539"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:19:19.100781 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.100661 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58d1f86f-2ef3-4230-b01c-bf56d5bd0865-bundle" pod "58d1f86f-2ef3-4230-b01c-bf56d5bd0865" (UID: "58d1f86f-2ef3-4230-b01c-bf56d5bd0865"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:19:19.102326 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.102299 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/435d72d5-a819-45f0-bb74-35de62dc4539-kube-api-access-j4ltr" pod "435d72d5-a819-45f0-bb74-35de62dc4539" (UID: "435d72d5-a819-45f0-bb74-35de62dc4539"). InnerVolumeSpecName "kube-api-access-j4ltr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:19:19.102802 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.102782 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58d1f86f-2ef3-4230-b01c-bf56d5bd0865-kube-api-access-f9tbg" pod "58d1f86f-2ef3-4230-b01c-bf56d5bd0865" (UID: "58d1f86f-2ef3-4230-b01c-bf56d5bd0865"). InnerVolumeSpecName "kube-api-access-f9tbg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:19:19.105712 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.105691 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58d1f86f-2ef3-4230-b01c-bf56d5bd0865-util" pod "58d1f86f-2ef3-4230-b01c-bf56d5bd0865" (UID: "58d1f86f-2ef3-4230-b01c-bf56d5bd0865"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:19:19.106192 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.106173 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/435d72d5-a819-45f0-bb74-35de62dc4539-util" pod "435d72d5-a819-45f0-bb74-35de62dc4539" (UID: "435d72d5-a819-45f0-bb74-35de62dc4539"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:19:19.201362 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.201325 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9tbg\" (UniqueName: \"kubernetes.io/projected/58d1f86f-2ef3-4230-b01c-bf56d5bd0865-kube-api-access-f9tbg\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:19:19.201362 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.201357 6029 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58d1f86f-2ef3-4230-b01c-bf56d5bd0865-util\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:19:19.201362 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.201367 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4ltr\" (UniqueName: \"kubernetes.io/projected/435d72d5-a819-45f0-bb74-35de62dc4539-kube-api-access-j4ltr\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:19:19.201592 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.201376 6029 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/435d72d5-a819-45f0-bb74-35de62dc4539-util\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:19:19.201592 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.201384 6029 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58d1f86f-2ef3-4230-b01c-bf56d5bd0865-bundle\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:19:19.201592 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.201391 6029 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/435d72d5-a819-45f0-bb74-35de62dc4539-bundle\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:19:19.837779 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.837749 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws" event={"ID":"435d72d5-a819-45f0-bb74-35de62dc4539","Type":"ContainerDied","Data":"e843e7d56c8e9006e059ac08d2b45aea266d5bc3d92438bd05a7be34b0c4006f"} Oct 29 23:19:19.837779 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.837765 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cbwtws" Oct 29 23:19:19.838256 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.837794 6029 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e843e7d56c8e9006e059ac08d2b45aea266d5bc3d92438bd05a7be34b0c4006f" Oct 29 23:19:19.839766 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.839747 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd" Oct 29 23:19:19.839983 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.839950 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7jfdvd" event={"ID":"0695b399-4e46-45dd-9e48-19598bb4e198","Type":"ContainerDied","Data":"48e1a325a554d8bef7f82e339745c40ff70f2e6ac8d3b5d907b06ae6fdb0c0df"} Oct 29 23:19:19.840042 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.839994 6029 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48e1a325a554d8bef7f82e339745c40ff70f2e6ac8d3b5d907b06ae6fdb0c0df" Oct 29 23:19:19.842154 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.842130 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz" event={"ID":"58d1f86f-2ef3-4230-b01c-bf56d5bd0865","Type":"ContainerDied","Data":"c1b1e2e58407f7c2d94341aa58e8d422835b87f08980f84af11a88e7728e5a05"} Oct 29 23:19:19.842241 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.842161 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aw4sfz" Oct 29 23:19:19.842241 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.842173 6029 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1b1e2e58407f7c2d94341aa58e8d422835b87f08980f84af11a88e7728e5a05" Oct 29 23:19:19.961796 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:19.961775 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77" Oct 29 23:19:20.008157 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:20.008130 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b0a8e601-6c5b-4345-aa25-4ef380f049cf-util\" (UniqueName: \"kubernetes.io/empty-dir/b0a8e601-6c5b-4345-aa25-4ef380f049cf-util\") pod \"b0a8e601-6c5b-4345-aa25-4ef380f049cf\" (UID: \"b0a8e601-6c5b-4345-aa25-4ef380f049cf\") " Oct 29 23:19:20.008318 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:20.008172 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b0a8e601-6c5b-4345-aa25-4ef380f049cf-bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0a8e601-6c5b-4345-aa25-4ef380f049cf-bundle\") pod \"b0a8e601-6c5b-4345-aa25-4ef380f049cf\" (UID: \"b0a8e601-6c5b-4345-aa25-4ef380f049cf\") " Oct 29 23:19:20.008318 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:20.008281 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b0a8e601-6c5b-4345-aa25-4ef380f049cf-kube-api-access-h4rdt\" (UniqueName: \"kubernetes.io/projected/b0a8e601-6c5b-4345-aa25-4ef380f049cf-kube-api-access-h4rdt\") pod \"b0a8e601-6c5b-4345-aa25-4ef380f049cf\" (UID: \"b0a8e601-6c5b-4345-aa25-4ef380f049cf\") " Oct 29 23:19:20.008809 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:20.008778 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0a8e601-6c5b-4345-aa25-4ef380f049cf-bundle" pod "b0a8e601-6c5b-4345-aa25-4ef380f049cf" (UID: "b0a8e601-6c5b-4345-aa25-4ef380f049cf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:19:20.010499 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:20.010476 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0a8e601-6c5b-4345-aa25-4ef380f049cf-kube-api-access-h4rdt" pod "b0a8e601-6c5b-4345-aa25-4ef380f049cf" (UID: "b0a8e601-6c5b-4345-aa25-4ef380f049cf"). InnerVolumeSpecName "kube-api-access-h4rdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:19:20.017647 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:20.017618 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0a8e601-6c5b-4345-aa25-4ef380f049cf-util" pod "b0a8e601-6c5b-4345-aa25-4ef380f049cf" (UID: "b0a8e601-6c5b-4345-aa25-4ef380f049cf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:19:20.109284 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:20.109199 6029 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0a8e601-6c5b-4345-aa25-4ef380f049cf-util\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:19:20.109284 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:20.109227 6029 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0a8e601-6c5b-4345-aa25-4ef380f049cf-bundle\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:19:20.109284 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:20.109237 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4rdt\" (UniqueName: \"kubernetes.io/projected/b0a8e601-6c5b-4345-aa25-4ef380f049cf-kube-api-access-h4rdt\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:19:20.848772 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:20.848741 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77" event={"ID":"b0a8e601-6c5b-4345-aa25-4ef380f049cf","Type":"ContainerDied","Data":"a4c0a8ce03a72833b74d43ad49ef51dc40ea74acc2a8a74d5df67b39cc21fa87"} Oct 29 23:19:20.849216 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:20.848792 6029 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4c0a8ce03a72833b74d43ad49ef51dc40ea74acc2a8a74d5df67b39cc21fa87" Oct 29 23:19:20.849216 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:20.848747 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xsh77" Oct 29 23:19:32.550950 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.550921 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx"] Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551240 6029 cpu_manager.go:414] "containerMap: removing container" podUID="0695b399-4e46-45dd-9e48-19598bb4e198" containerName="extract" Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551251 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0695b399-4e46-45dd-9e48-19598bb4e198" containerName="extract" Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551265 6029 cpu_manager.go:414] "containerMap: removing container" podUID="435d72d5-a819-45f0-bb74-35de62dc4539" containerName="extract" Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551270 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="435d72d5-a819-45f0-bb74-35de62dc4539" containerName="extract" Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551282 6029 cpu_manager.go:414] "containerMap: removing container" podUID="58d1f86f-2ef3-4230-b01c-bf56d5bd0865" containerName="pull" Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551288 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58d1f86f-2ef3-4230-b01c-bf56d5bd0865" containerName="pull" Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551294 6029 cpu_manager.go:414] "containerMap: removing container" podUID="0695b399-4e46-45dd-9e48-19598bb4e198" containerName="pull" Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551299 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0695b399-4e46-45dd-9e48-19598bb4e198" containerName="pull" Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551308 6029 cpu_manager.go:414] "containerMap: removing container" podUID="58d1f86f-2ef3-4230-b01c-bf56d5bd0865" containerName="extract" Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551314 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58d1f86f-2ef3-4230-b01c-bf56d5bd0865" containerName="extract" Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551323 6029 cpu_manager.go:414] "containerMap: removing container" podUID="0695b399-4e46-45dd-9e48-19598bb4e198" containerName="util" Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551328 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0695b399-4e46-45dd-9e48-19598bb4e198" containerName="util" Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551333 6029 cpu_manager.go:414] "containerMap: removing container" podUID="435d72d5-a819-45f0-bb74-35de62dc4539" containerName="util" Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551337 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="435d72d5-a819-45f0-bb74-35de62dc4539" containerName="util" Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551345 6029 cpu_manager.go:414] "containerMap: removing container" podUID="b0a8e601-6c5b-4345-aa25-4ef380f049cf" containerName="pull" Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551350 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b0a8e601-6c5b-4345-aa25-4ef380f049cf" containerName="pull" Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551357 6029 cpu_manager.go:414] "containerMap: removing container" podUID="435d72d5-a819-45f0-bb74-35de62dc4539" containerName="pull" Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551361 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="435d72d5-a819-45f0-bb74-35de62dc4539" containerName="pull" Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551368 6029 cpu_manager.go:414] "containerMap: removing container" podUID="b0a8e601-6c5b-4345-aa25-4ef380f049cf" containerName="extract" Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551372 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b0a8e601-6c5b-4345-aa25-4ef380f049cf" containerName="extract" Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551384 6029 cpu_manager.go:414] "containerMap: removing container" podUID="58d1f86f-2ef3-4230-b01c-bf56d5bd0865" containerName="util" Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551388 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58d1f86f-2ef3-4230-b01c-bf56d5bd0865" containerName="util" Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551395 6029 cpu_manager.go:414] "containerMap: removing container" podUID="b0a8e601-6c5b-4345-aa25-4ef380f049cf" containerName="util" Oct 29 23:19:32.551432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551399 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b0a8e601-6c5b-4345-aa25-4ef380f049cf" containerName="util" Oct 29 23:19:32.552162 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551448 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="0695b399-4e46-45dd-9e48-19598bb4e198" containerName="extract" Oct 29 23:19:32.552162 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551456 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="435d72d5-a819-45f0-bb74-35de62dc4539" containerName="extract" Oct 29 23:19:32.552162 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551463 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="58d1f86f-2ef3-4230-b01c-bf56d5bd0865" containerName="extract" Oct 29 23:19:32.552162 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.551470 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="b0a8e601-6c5b-4345-aa25-4ef380f049cf" containerName="extract" Oct 29 23:19:32.554864 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.554847 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" Oct 29 23:19:32.573849 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.573804 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx"] Oct 29 23:19:32.584111 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.584075 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Oct 29 23:19:32.585701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.585681 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Oct 29 23:19:32.585793 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.585778 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bldxg\"" Oct 29 23:19:32.615830 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.615793 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88nlb\" (UniqueName: \"kubernetes.io/projected/b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca-kube-api-access-88nlb\") pod \"kuadrant-operator-controller-manager-6b6fb56846-5mmtx\" (UID: \"b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" Oct 29 23:19:32.615997 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.615973 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-5mmtx\" (UID: \"b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" Oct 29 23:19:32.716938 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.716902 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-5mmtx\" (UID: \"b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" Oct 29 23:19:32.717148 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.716955 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88nlb\" (UniqueName: \"kubernetes.io/projected/b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca-kube-api-access-88nlb\") pod \"kuadrant-operator-controller-manager-6b6fb56846-5mmtx\" (UID: \"b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" Oct 29 23:19:32.717374 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.717348 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-5mmtx\" (UID: \"b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" Oct 29 23:19:32.749467 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.749430 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88nlb\" (UniqueName: \"kubernetes.io/projected/b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca-kube-api-access-88nlb\") pod \"kuadrant-operator-controller-manager-6b6fb56846-5mmtx\" (UID: \"b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" Oct 29 23:19:32.867562 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:32.867473 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" Oct 29 23:19:33.188390 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:33.188368 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx"] Oct 29 23:19:33.189947 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:19:33.189916 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3694f4e_cb3e_4d07_9fe4_a23d3176a5ca.slice/crio-6de4e4e6f3b202b907ec2ad923f791a96943e23a509c8c0359da342beadc7b40 WatchSource:0}: Error finding container 6de4e4e6f3b202b907ec2ad923f791a96943e23a509c8c0359da342beadc7b40: Status 404 returned error can't find the container with id 6de4e4e6f3b202b907ec2ad923f791a96943e23a509c8c0359da342beadc7b40 Oct 29 23:19:33.912379 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:33.912304 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" event={"ID":"b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca","Type":"ContainerStarted","Data":"6de4e4e6f3b202b907ec2ad923f791a96943e23a509c8c0359da342beadc7b40"} Oct 29 23:19:37.936176 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:37.936141 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" event={"ID":"b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca","Type":"ContainerStarted","Data":"31123acc3feec5c630ff49893fa2c785391f4522225b6f681b214fc8e6699750"} Oct 29 23:19:37.936572 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:37.936376 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" Oct 29 23:19:38.013302 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:38.013245 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" podStartSLOduration=1.876972278 podStartE2EDuration="6.013228926s" totalImagesPullingTime="4.136256648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:19:37.997660171 +0000 UTC m=+344.723910764" watchObservedRunningTime="2026-10-29 23:19:38.013228926 +0000 UTC m=+344.739479517" Oct 29 23:19:38.920398 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:19:38.920362 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:19:40.385798 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:40.385766 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-jt4xc"] Oct 29 23:19:40.389763 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:40.389743 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jt4xc" Oct 29 23:19:40.412892 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:40.412863 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-jt4xc"] Oct 29 23:19:40.425265 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:40.425233 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Oct 29 23:19:40.425399 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:40.425309 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Oct 29 23:19:40.425399 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:40.425337 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2q4jt\"" Oct 29 23:19:40.487049 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:40.487009 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd27x\" (UniqueName: \"kubernetes.io/projected/447608da-ac32-4cbc-9e92-1c9a24eddd8a-kube-api-access-dd27x\") pod \"kuadrant-console-plugin-66c4fb575d-jt4xc\" (UID: \"447608da-ac32-4cbc-9e92-1c9a24eddd8a\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jt4xc" Oct 29 23:19:40.487049 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:40.487052 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/447608da-ac32-4cbc-9e92-1c9a24eddd8a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-jt4xc\" (UID: \"447608da-ac32-4cbc-9e92-1c9a24eddd8a\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jt4xc" Oct 29 23:19:40.487255 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:40.487121 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/447608da-ac32-4cbc-9e92-1c9a24eddd8a-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-jt4xc\" (UID: \"447608da-ac32-4cbc-9e92-1c9a24eddd8a\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jt4xc" Oct 29 23:19:40.587636 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:40.587592 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd27x\" (UniqueName: \"kubernetes.io/projected/447608da-ac32-4cbc-9e92-1c9a24eddd8a-kube-api-access-dd27x\") pod \"kuadrant-console-plugin-66c4fb575d-jt4xc\" (UID: \"447608da-ac32-4cbc-9e92-1c9a24eddd8a\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jt4xc" Oct 29 23:19:40.587636 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:40.587637 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/447608da-ac32-4cbc-9e92-1c9a24eddd8a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-jt4xc\" (UID: \"447608da-ac32-4cbc-9e92-1c9a24eddd8a\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jt4xc" Oct 29 23:19:40.587960 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:40.587663 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/447608da-ac32-4cbc-9e92-1c9a24eddd8a-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-jt4xc\" (UID: \"447608da-ac32-4cbc-9e92-1c9a24eddd8a\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jt4xc" Oct 29 23:19:40.588380 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:40.588350 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/447608da-ac32-4cbc-9e92-1c9a24eddd8a-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-jt4xc\" (UID: \"447608da-ac32-4cbc-9e92-1c9a24eddd8a\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jt4xc" Oct 29 23:19:40.590056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:40.590032 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/447608da-ac32-4cbc-9e92-1c9a24eddd8a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-jt4xc\" (UID: \"447608da-ac32-4cbc-9e92-1c9a24eddd8a\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jt4xc" Oct 29 23:19:40.610564 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:40.610538 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd27x\" (UniqueName: \"kubernetes.io/projected/447608da-ac32-4cbc-9e92-1c9a24eddd8a-kube-api-access-dd27x\") pod \"kuadrant-console-plugin-66c4fb575d-jt4xc\" (UID: \"447608da-ac32-4cbc-9e92-1c9a24eddd8a\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jt4xc" Oct 29 23:19:40.701413 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:40.701325 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jt4xc" Oct 29 23:19:40.994628 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:40.994601 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-jt4xc"] Oct 29 23:19:40.995310 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:19:40.995281 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod447608da_ac32_4cbc_9e92_1c9a24eddd8a.slice/crio-bc70ed9137a6d26210de1189ac0374f90eb890b2b24967aa8183fbc7a4260deb WatchSource:0}: Error finding container bc70ed9137a6d26210de1189ac0374f90eb890b2b24967aa8183fbc7a4260deb: Status 404 returned error can't find the container with id bc70ed9137a6d26210de1189ac0374f90eb890b2b24967aa8183fbc7a4260deb Oct 29 23:19:41.957056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:41.957013 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jt4xc" event={"ID":"447608da-ac32-4cbc-9e92-1c9a24eddd8a","Type":"ContainerStarted","Data":"bc70ed9137a6d26210de1189ac0374f90eb890b2b24967aa8183fbc7a4260deb"} Oct 29 23:19:45.979047 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:45.979006 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jt4xc" event={"ID":"447608da-ac32-4cbc-9e92-1c9a24eddd8a","Type":"ContainerStarted","Data":"8f5fbc87d7c5e2c00e255c7d57ba8aeb54dc19ad30559328b0151c37d4c819b6"} Oct 29 23:19:46.019113 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:46.019057 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jt4xc" podStartSLOduration=1.884511689 podStartE2EDuration="6.019041189s" totalImagesPullingTime="4.1345295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:19:46.018640093 +0000 UTC m=+352.744890685" watchObservedRunningTime="2026-10-29 23:19:46.019041189 +0000 UTC m=+352.745291780" Oct 29 23:19:48.943267 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:48.943234 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" Oct 29 23:19:51.803622 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:51.803590 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-624x2"] Oct 29 23:19:51.808578 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:51.808561 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-624x2" Oct 29 23:19:51.820014 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:51.819990 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-624x2"] Oct 29 23:19:51.991661 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:51.991621 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-922bb\" (UniqueName: \"kubernetes.io/projected/900bc0cb-2689-45fd-bca7-7b3c3659d5cc-kube-api-access-922bb\") pod \"kuadrant-operator-controller-manager-858bb878d8-624x2\" (UID: \"900bc0cb-2689-45fd-bca7-7b3c3659d5cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-624x2" Oct 29 23:19:51.991661 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:51.991659 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/900bc0cb-2689-45fd-bca7-7b3c3659d5cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-858bb878d8-624x2\" (UID: \"900bc0cb-2689-45fd-bca7-7b3c3659d5cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-624x2" Oct 29 23:19:52.092636 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.092541 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-922bb\" (UniqueName: \"kubernetes.io/projected/900bc0cb-2689-45fd-bca7-7b3c3659d5cc-kube-api-access-922bb\") pod \"kuadrant-operator-controller-manager-858bb878d8-624x2\" (UID: \"900bc0cb-2689-45fd-bca7-7b3c3659d5cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-624x2" Oct 29 23:19:52.092636 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.092583 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/900bc0cb-2689-45fd-bca7-7b3c3659d5cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-858bb878d8-624x2\" (UID: \"900bc0cb-2689-45fd-bca7-7b3c3659d5cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-624x2" Oct 29 23:19:52.092984 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.092964 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/900bc0cb-2689-45fd-bca7-7b3c3659d5cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-858bb878d8-624x2\" (UID: \"900bc0cb-2689-45fd-bca7-7b3c3659d5cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-624x2" Oct 29 23:19:52.112993 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.112963 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-922bb\" (UniqueName: \"kubernetes.io/projected/900bc0cb-2689-45fd-bca7-7b3c3659d5cc-kube-api-access-922bb\") pod \"kuadrant-operator-controller-manager-858bb878d8-624x2\" (UID: \"900bc0cb-2689-45fd-bca7-7b3c3659d5cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-624x2" Oct 29 23:19:52.121476 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.121455 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-624x2" Oct 29 23:19:52.433645 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.433619 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-624x2"] Oct 29 23:19:52.434594 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:19:52.434564 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod900bc0cb_2689_45fd_bca7_7b3c3659d5cc.slice/crio-a4dd333e2b53b50525d62e3dd4af15d00e467786a98806eef3aeb5dee98daad5 WatchSource:0}: Error finding container a4dd333e2b53b50525d62e3dd4af15d00e467786a98806eef3aeb5dee98daad5: Status 404 returned error can't find the container with id a4dd333e2b53b50525d62e3dd4af15d00e467786a98806eef3aeb5dee98daad5 Oct 29 23:19:52.587538 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.587506 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx"] Oct 29 23:19:52.587704 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.587677 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" podUID="b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca" containerName="manager" containerID="cri-o://31123acc3feec5c630ff49893fa2c785391f4522225b6f681b214fc8e6699750" gracePeriod=2 Oct 29 23:19:52.593772 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.593745 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx"] Oct 29 23:19:52.602842 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:19:52.602800 6029 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b6fb56846-5mmtx\" is forbidden: User \"system:node:ip-10-0-138-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-163.ec2.internal' and this object" podUID="b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" Oct 29 23:19:52.616130 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.616074 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj"] Oct 29 23:19:52.616449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.616434 6029 cpu_manager.go:414] "containerMap: removing container" podUID="b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca" containerName="manager" Oct 29 23:19:52.616449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.616448 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca" containerName="manager" Oct 29 23:19:52.616591 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.616513 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca" containerName="manager" Oct 29 23:19:52.619590 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.619570 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-624x2"] Oct 29 23:19:52.619748 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.619675 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj" Oct 29 23:19:52.623554 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.623528 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-624x2"] Oct 29 23:19:52.641477 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.641453 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl"] Oct 29 23:19:52.641844 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.641806 6029 cpu_manager.go:414] "containerMap: removing container" podUID="900bc0cb-2689-45fd-bca7-7b3c3659d5cc" containerName="manager" Oct 29 23:19:52.641890 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.641847 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="900bc0cb-2689-45fd-bca7-7b3c3659d5cc" containerName="manager" Oct 29 23:19:52.641933 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.641923 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="900bc0cb-2689-45fd-bca7-7b3c3659d5cc" containerName="manager" Oct 29 23:19:52.644839 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.644806 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl" Oct 29 23:19:52.653213 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.653184 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj"] Oct 29 23:19:52.675809 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.675778 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl"] Oct 29 23:19:52.688069 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:19:52.687989 6029 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b6fb56846-5mmtx\" is forbidden: User \"system:node:ip-10-0-138-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-163.ec2.internal' and this object" podUID="b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" Oct 29 23:19:52.702837 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:19:52.702783 6029 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b6fb56846-5mmtx\" is forbidden: User \"system:node:ip-10-0-138-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-163.ec2.internal' and this object" podUID="b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" Oct 29 23:19:52.798072 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.798037 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sskcr\" (UniqueName: \"kubernetes.io/projected/0a9641b9-9cfa-4a3f-b2cb-adac746c67ac-kube-api-access-sskcr\") pod \"kuadrant-operator-controller-manager-6b6fb56846-wjhkj\" (UID: \"0a9641b9-9cfa-4a3f-b2cb-adac746c67ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj" Oct 29 23:19:52.798212 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.798088 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a9641b9-9cfa-4a3f-b2cb-adac746c67ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-wjhkj\" (UID: \"0a9641b9-9cfa-4a3f-b2cb-adac746c67ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj" Oct 29 23:19:52.798279 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.798227 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9rrb\" (UniqueName: \"kubernetes.io/projected/bdab193c-a1f7-4993-b5cd-bc2d84752d24-kube-api-access-s9rrb\") pod \"kuadrant-operator-controller-manager-858bb878d8-74rxl\" (UID: \"bdab193c-a1f7-4993-b5cd-bc2d84752d24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl" Oct 29 23:19:52.798337 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.798277 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdab193c-a1f7-4993-b5cd-bc2d84752d24-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-858bb878d8-74rxl\" (UID: \"bdab193c-a1f7-4993-b5cd-bc2d84752d24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl" Oct 29 23:19:52.832359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.832333 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" Oct 29 23:19:52.847278 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:19:52.847253 6029 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b6fb56846-5mmtx\" is forbidden: User \"system:node:ip-10-0-138-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-163.ec2.internal' and this object" podUID="b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" Oct 29 23:19:52.899719 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.899682 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sskcr\" (UniqueName: \"kubernetes.io/projected/0a9641b9-9cfa-4a3f-b2cb-adac746c67ac-kube-api-access-sskcr\") pod \"kuadrant-operator-controller-manager-6b6fb56846-wjhkj\" (UID: \"0a9641b9-9cfa-4a3f-b2cb-adac746c67ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj" Oct 29 23:19:52.899719 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.899731 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a9641b9-9cfa-4a3f-b2cb-adac746c67ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-wjhkj\" (UID: \"0a9641b9-9cfa-4a3f-b2cb-adac746c67ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj" Oct 29 23:19:52.899990 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.899770 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9rrb\" (UniqueName: \"kubernetes.io/projected/bdab193c-a1f7-4993-b5cd-bc2d84752d24-kube-api-access-s9rrb\") pod \"kuadrant-operator-controller-manager-858bb878d8-74rxl\" (UID: \"bdab193c-a1f7-4993-b5cd-bc2d84752d24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl" Oct 29 23:19:52.899990 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.899801 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdab193c-a1f7-4993-b5cd-bc2d84752d24-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-858bb878d8-74rxl\" (UID: \"bdab193c-a1f7-4993-b5cd-bc2d84752d24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl" Oct 29 23:19:52.900247 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.900226 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdab193c-a1f7-4993-b5cd-bc2d84752d24-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-858bb878d8-74rxl\" (UID: \"bdab193c-a1f7-4993-b5cd-bc2d84752d24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl" Oct 29 23:19:52.900311 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.900227 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a9641b9-9cfa-4a3f-b2cb-adac746c67ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-wjhkj\" (UID: \"0a9641b9-9cfa-4a3f-b2cb-adac746c67ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj" Oct 29 23:19:52.921063 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.921036 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sskcr\" (UniqueName: \"kubernetes.io/projected/0a9641b9-9cfa-4a3f-b2cb-adac746c67ac-kube-api-access-sskcr\") pod \"kuadrant-operator-controller-manager-6b6fb56846-wjhkj\" (UID: \"0a9641b9-9cfa-4a3f-b2cb-adac746c67ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj" Oct 29 23:19:52.921177 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.921071 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9rrb\" (UniqueName: \"kubernetes.io/projected/bdab193c-a1f7-4993-b5cd-bc2d84752d24-kube-api-access-s9rrb\") pod \"kuadrant-operator-controller-manager-858bb878d8-74rxl\" (UID: \"bdab193c-a1f7-4993-b5cd-bc2d84752d24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl" Oct 29 23:19:52.968966 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.968895 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj" Oct 29 23:19:52.975487 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:52.975470 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl" Oct 29 23:19:53.000375 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:53.000341 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca-kube-api-access-88nlb\" (UniqueName: \"kubernetes.io/projected/b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca-kube-api-access-88nlb\") pod \"b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca\" (UID: \"b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca\") " Oct 29 23:19:53.000526 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:53.000452 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca-extensions-socket-volume\") pod \"b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca\" (UID: \"b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca\") " Oct 29 23:19:53.001136 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:53.001099 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca-extensions-socket-volume" pod "b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca" (UID: "b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:19:53.002529 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:53.002507 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca-kube-api-access-88nlb" pod "b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca" (UID: "b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca"). InnerVolumeSpecName "kube-api-access-88nlb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:19:53.016580 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:53.016542 6029 generic.go:356] "Generic (PLEG): container finished" podID="b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca" containerID="31123acc3feec5c630ff49893fa2c785391f4522225b6f681b214fc8e6699750" exitCode=0 Oct 29 23:19:53.016762 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:53.016589 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" Oct 29 23:19:53.016762 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:53.016632 6029 scope.go:122] "RemoveContainer" containerID="31123acc3feec5c630ff49893fa2c785391f4522225b6f681b214fc8e6699750" Oct 29 23:19:53.031854 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:19:53.031755 6029 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b6fb56846-5mmtx\" is forbidden: User \"system:node:ip-10-0-138-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-163.ec2.internal' and this object" podUID="b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" Oct 29 23:19:53.041119 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:53.040808 6029 scope.go:122] "RemoveContainer" containerID="31123acc3feec5c630ff49893fa2c785391f4522225b6f681b214fc8e6699750" Oct 29 23:19:53.041448 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:19:53.041414 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31123acc3feec5c630ff49893fa2c785391f4522225b6f681b214fc8e6699750\": container with ID starting with 31123acc3feec5c630ff49893fa2c785391f4522225b6f681b214fc8e6699750 not found: ID does not exist" containerID="31123acc3feec5c630ff49893fa2c785391f4522225b6f681b214fc8e6699750" Oct 29 23:19:53.041535 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:53.041466 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31123acc3feec5c630ff49893fa2c785391f4522225b6f681b214fc8e6699750"} err="failed to get container status \"31123acc3feec5c630ff49893fa2c785391f4522225b6f681b214fc8e6699750\": rpc error: code = NotFound desc = could not find container \"31123acc3feec5c630ff49893fa2c785391f4522225b6f681b214fc8e6699750\": container with ID starting with 31123acc3feec5c630ff49893fa2c785391f4522225b6f681b214fc8e6699750 not found: ID does not exist" Oct 29 23:19:53.046725 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:19:53.046691 6029 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b6fb56846-5mmtx\" is forbidden: User \"system:node:ip-10-0-138-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-163.ec2.internal' and this object" podUID="b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" Oct 29 23:19:53.061502 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:19:53.061471 6029 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-858bb878d8-624x2\" is forbidden: User \"system:node:ip-10-0-138-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-163.ec2.internal' and this object" podUID="900bc0cb-2689-45fd-bca7-7b3c3659d5cc" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-624x2" Oct 29 23:19:53.076548 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:19:53.076515 6029 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b6fb56846-5mmtx\" is forbidden: User \"system:node:ip-10-0-138-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-163.ec2.internal' and this object" podUID="b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" Oct 29 23:19:53.091526 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:19:53.091496 6029 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-858bb878d8-624x2\" is forbidden: User \"system:node:ip-10-0-138-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-163.ec2.internal' and this object" podUID="900bc0cb-2689-45fd-bca7-7b3c3659d5cc" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-624x2" Oct 29 23:19:53.101969 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:53.101939 6029 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca-extensions-socket-volume\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:19:53.102080 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:53.101972 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88nlb\" (UniqueName: \"kubernetes.io/projected/b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca-kube-api-access-88nlb\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:19:53.280713 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:53.280685 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj"] Oct 29 23:19:53.281852 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:19:53.281826 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a9641b9_9cfa_4a3f_b2cb_adac746c67ac.slice/crio-bf5224e5b20dd4d7e84b425ecefafde8fb3575d2edaefcc03878d9c33c40b214 WatchSource:0}: Error finding container bf5224e5b20dd4d7e84b425ecefafde8fb3575d2edaefcc03878d9c33c40b214: Status 404 returned error can't find the container with id bf5224e5b20dd4d7e84b425ecefafde8fb3575d2edaefcc03878d9c33c40b214 Oct 29 23:19:53.293655 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:53.293625 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl"] Oct 29 23:19:53.294594 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:19:53.294572 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdab193c_a1f7_4993_b5cd_bc2d84752d24.slice/crio-6a1a89a4b15731153a0af7378107131474170a94bbb0c85e111ed73ffc7e0d94 WatchSource:0}: Error finding container 6a1a89a4b15731153a0af7378107131474170a94bbb0c85e111ed73ffc7e0d94: Status 404 returned error can't find the container with id 6a1a89a4b15731153a0af7378107131474170a94bbb0c85e111ed73ffc7e0d94 Oct 29 23:19:53.387063 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:53.387032 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca" path="/var/lib/kubelet/pods/b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca/volumes" Oct 29 23:19:53.398606 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:19:53.398570 6029 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b6fb56846-5mmtx\" is forbidden: User \"system:node:ip-10-0-138-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-163.ec2.internal' and this object" podUID="b3694f4e-cb3e-4d07-9fe4-a23d3176a5ca" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-5mmtx" Oct 29 23:19:53.413442 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:19:53.413411 6029 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-858bb878d8-624x2\" is forbidden: User \"system:node:ip-10-0-138-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-163.ec2.internal' and this object" podUID="900bc0cb-2689-45fd-bca7-7b3c3659d5cc" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-624x2" Oct 29 23:19:54.029843 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:54.029794 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl" event={"ID":"bdab193c-a1f7-4993-b5cd-bc2d84752d24","Type":"ContainerStarted","Data":"27f203563a500ab75845c3ef32f72a22bf99356d238877b7ca7d66d4be6b7636"} Oct 29 23:19:54.030461 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:54.030433 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl" Oct 29 23:19:54.030588 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:54.030475 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl" event={"ID":"bdab193c-a1f7-4993-b5cd-bc2d84752d24","Type":"ContainerStarted","Data":"6a1a89a4b15731153a0af7378107131474170a94bbb0c85e111ed73ffc7e0d94"} Oct 29 23:19:54.032105 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:54.032081 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj" event={"ID":"0a9641b9-9cfa-4a3f-b2cb-adac746c67ac","Type":"ContainerStarted","Data":"52a90fdf071620c29423c48393cbab9b8fc60388c38a1110faa323100b7a48a4"} Oct 29 23:19:54.032202 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:54.032133 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj" event={"ID":"0a9641b9-9cfa-4a3f-b2cb-adac746c67ac","Type":"ContainerStarted","Data":"bf5224e5b20dd4d7e84b425ecefafde8fb3575d2edaefcc03878d9c33c40b214"} Oct 29 23:19:54.032202 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:54.032186 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj" Oct 29 23:19:54.032332 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:54.032273 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-624x2" podUID="900bc0cb-2689-45fd-bca7-7b3c3659d5cc" containerName="manager" containerID="cri-o://2259e225d4009a3e5246e77638a30cf7d4423f36aff6c95581cd45da02b178bb" gracePeriod=2 Oct 29 23:19:54.103826 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:54.103769 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl" podStartSLOduration=2.10375471 podStartE2EDuration="2.10375471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:19:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:19:54.101714926 +0000 UTC m=+360.827965521" watchObservedRunningTime="2026-10-29 23:19:54.10375471 +0000 UTC m=+360.830005370" Oct 29 23:19:54.158044 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:54.157996 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj" podStartSLOduration=2.157978863 podStartE2EDuration="2.157978863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:19:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:19:54.157695132 +0000 UTC m=+360.883945725" watchObservedRunningTime="2026-10-29 23:19:54.157978863 +0000 UTC m=+360.884229454" Oct 29 23:19:54.287021 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:54.286956 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-624x2" Oct 29 23:19:54.302340 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:19:54.302307 6029 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-858bb878d8-624x2\" is forbidden: User \"system:node:ip-10-0-138-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-163.ec2.internal' and this object" podUID="900bc0cb-2689-45fd-bca7-7b3c3659d5cc" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-624x2" Oct 29 23:19:54.413955 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:54.413919 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/900bc0cb-2689-45fd-bca7-7b3c3659d5cc-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/900bc0cb-2689-45fd-bca7-7b3c3659d5cc-extensions-socket-volume\") pod \"900bc0cb-2689-45fd-bca7-7b3c3659d5cc\" (UID: \"900bc0cb-2689-45fd-bca7-7b3c3659d5cc\") " Oct 29 23:19:54.413955 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:54.413955 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/900bc0cb-2689-45fd-bca7-7b3c3659d5cc-kube-api-access-922bb\" (UniqueName: \"kubernetes.io/projected/900bc0cb-2689-45fd-bca7-7b3c3659d5cc-kube-api-access-922bb\") pod \"900bc0cb-2689-45fd-bca7-7b3c3659d5cc\" (UID: \"900bc0cb-2689-45fd-bca7-7b3c3659d5cc\") " Oct 29 23:19:54.414221 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:54.414196 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/900bc0cb-2689-45fd-bca7-7b3c3659d5cc-extensions-socket-volume" pod "900bc0cb-2689-45fd-bca7-7b3c3659d5cc" (UID: "900bc0cb-2689-45fd-bca7-7b3c3659d5cc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:19:54.416099 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:54.416078 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/900bc0cb-2689-45fd-bca7-7b3c3659d5cc-kube-api-access-922bb" pod "900bc0cb-2689-45fd-bca7-7b3c3659d5cc" (UID: "900bc0cb-2689-45fd-bca7-7b3c3659d5cc"). InnerVolumeSpecName "kube-api-access-922bb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:19:54.515411 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:54.515383 6029 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/900bc0cb-2689-45fd-bca7-7b3c3659d5cc-extensions-socket-volume\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:19:54.515411 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:54.515404 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-922bb\" (UniqueName: \"kubernetes.io/projected/900bc0cb-2689-45fd-bca7-7b3c3659d5cc-kube-api-access-922bb\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:19:55.044798 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:55.044763 6029 generic.go:356] "Generic (PLEG): container finished" podID="900bc0cb-2689-45fd-bca7-7b3c3659d5cc" containerID="2259e225d4009a3e5246e77638a30cf7d4423f36aff6c95581cd45da02b178bb" exitCode=2 Oct 29 23:19:55.045250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:55.044833 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-624x2" Oct 29 23:19:55.045250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:55.044863 6029 scope.go:122] "RemoveContainer" containerID="2259e225d4009a3e5246e77638a30cf7d4423f36aff6c95581cd45da02b178bb" Oct 29 23:19:55.054004 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:55.053977 6029 scope.go:122] "RemoveContainer" containerID="2259e225d4009a3e5246e77638a30cf7d4423f36aff6c95581cd45da02b178bb" Oct 29 23:19:55.054265 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:19:55.054246 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2259e225d4009a3e5246e77638a30cf7d4423f36aff6c95581cd45da02b178bb\": container with ID starting with 2259e225d4009a3e5246e77638a30cf7d4423f36aff6c95581cd45da02b178bb not found: ID does not exist" containerID="2259e225d4009a3e5246e77638a30cf7d4423f36aff6c95581cd45da02b178bb" Oct 29 23:19:55.054309 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:55.054274 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2259e225d4009a3e5246e77638a30cf7d4423f36aff6c95581cd45da02b178bb"} err="failed to get container status \"2259e225d4009a3e5246e77638a30cf7d4423f36aff6c95581cd45da02b178bb\": rpc error: code = NotFound desc = could not find container \"2259e225d4009a3e5246e77638a30cf7d4423f36aff6c95581cd45da02b178bb\": container with ID starting with 2259e225d4009a3e5246e77638a30cf7d4423f36aff6c95581cd45da02b178bb not found: ID does not exist" Oct 29 23:19:55.060196 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:19:55.060173 6029 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-858bb878d8-624x2\" is forbidden: User \"system:node:ip-10-0-138-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-163.ec2.internal' and this object" podUID="900bc0cb-2689-45fd-bca7-7b3c3659d5cc" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-624x2" Oct 29 23:19:55.074871 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:19:55.074847 6029 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-858bb878d8-624x2\" is forbidden: User \"system:node:ip-10-0-138-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-163.ec2.internal' and this object" podUID="900bc0cb-2689-45fd-bca7-7b3c3659d5cc" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-624x2" Oct 29 23:19:55.387124 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:19:55.387047 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="900bc0cb-2689-45fd-bca7-7b3c3659d5cc" path="/var/lib/kubelet/pods/900bc0cb-2689-45fd-bca7-7b3c3659d5cc/volumes" Oct 29 23:20:05.047688 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:05.047619 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj" Oct 29 23:20:06.052830 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:06.052794 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl" Oct 29 23:20:06.154424 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:06.154383 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj"] Oct 29 23:20:06.154594 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:06.154568 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj" podUID="0a9641b9-9cfa-4a3f-b2cb-adac746c67ac" containerName="manager" containerID="cri-o://52a90fdf071620c29423c48393cbab9b8fc60388c38a1110faa323100b7a48a4" gracePeriod=10 Oct 29 23:20:06.406711 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:06.406679 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj" Oct 29 23:20:06.443075 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:06.443037 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx"] Oct 29 23:20:06.443460 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:06.443444 6029 cpu_manager.go:414] "containerMap: removing container" podUID="0a9641b9-9cfa-4a3f-b2cb-adac746c67ac" containerName="manager" Oct 29 23:20:06.443529 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:06.443461 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0a9641b9-9cfa-4a3f-b2cb-adac746c67ac" containerName="manager" Oct 29 23:20:06.443570 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:06.443544 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="0a9641b9-9cfa-4a3f-b2cb-adac746c67ac" containerName="manager" Oct 29 23:20:06.447041 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:06.447023 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx" Oct 29 23:20:06.476433 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:06.476402 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx"] Oct 29 23:20:06.497317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:06.497279 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6386da02-f1c3-4158-81f9-675f84da4261-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-rw8fx\" (UID: \"6386da02-f1c3-4158-81f9-675f84da4261\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx" Oct 29 23:20:06.497498 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:06.497355 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtj7z\" (UniqueName: \"kubernetes.io/projected/6386da02-f1c3-4158-81f9-675f84da4261-kube-api-access-mtj7z\") pod \"kuadrant-operator-controller-manager-57bb9bfff-rw8fx\" (UID: \"6386da02-f1c3-4158-81f9-675f84da4261\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx" Oct 29 23:20:06.598037 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:06.597957 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0a9641b9-9cfa-4a3f-b2cb-adac746c67ac-kube-api-access-sskcr\" (UniqueName: \"kubernetes.io/projected/0a9641b9-9cfa-4a3f-b2cb-adac746c67ac-kube-api-access-sskcr\") pod \"0a9641b9-9cfa-4a3f-b2cb-adac746c67ac\" (UID: \"0a9641b9-9cfa-4a3f-b2cb-adac746c67ac\") " Oct 29 23:20:06.598037 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:06.598006 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0a9641b9-9cfa-4a3f-b2cb-adac746c67ac-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a9641b9-9cfa-4a3f-b2cb-adac746c67ac-extensions-socket-volume\") pod \"0a9641b9-9cfa-4a3f-b2cb-adac746c67ac\" (UID: \"0a9641b9-9cfa-4a3f-b2cb-adac746c67ac\") " Oct 29 23:20:06.598220 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:06.598098 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtj7z\" (UniqueName: \"kubernetes.io/projected/6386da02-f1c3-4158-81f9-675f84da4261-kube-api-access-mtj7z\") pod \"kuadrant-operator-controller-manager-57bb9bfff-rw8fx\" (UID: \"6386da02-f1c3-4158-81f9-675f84da4261\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx" Oct 29 23:20:06.598220 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:06.598145 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6386da02-f1c3-4158-81f9-675f84da4261-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-rw8fx\" (UID: \"6386da02-f1c3-4158-81f9-675f84da4261\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx" Oct 29 23:20:06.598452 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:06.598420 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a9641b9-9cfa-4a3f-b2cb-adac746c67ac-extensions-socket-volume" pod "0a9641b9-9cfa-4a3f-b2cb-adac746c67ac" (UID: "0a9641b9-9cfa-4a3f-b2cb-adac746c67ac"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:20:06.598584 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:06.598564 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6386da02-f1c3-4158-81f9-675f84da4261-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-rw8fx\" (UID: \"6386da02-f1c3-4158-81f9-675f84da4261\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx" Oct 29 23:20:06.600217 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:06.600189 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a9641b9-9cfa-4a3f-b2cb-adac746c67ac-kube-api-access-sskcr" pod "0a9641b9-9cfa-4a3f-b2cb-adac746c67ac" (UID: "0a9641b9-9cfa-4a3f-b2cb-adac746c67ac"). InnerVolumeSpecName "kube-api-access-sskcr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:20:06.618667 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:06.618637 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtj7z\" (UniqueName: \"kubernetes.io/projected/6386da02-f1c3-4158-81f9-675f84da4261-kube-api-access-mtj7z\") pod \"kuadrant-operator-controller-manager-57bb9bfff-rw8fx\" (UID: \"6386da02-f1c3-4158-81f9-675f84da4261\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx" Oct 29 23:20:06.699330 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:06.699288 6029 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a9641b9-9cfa-4a3f-b2cb-adac746c67ac-extensions-socket-volume\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:20:06.699330 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:06.699321 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sskcr\" (UniqueName: \"kubernetes.io/projected/0a9641b9-9cfa-4a3f-b2cb-adac746c67ac-kube-api-access-sskcr\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:20:06.760154 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:06.760121 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx" Oct 29 23:20:07.093222 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:07.093182 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx"] Oct 29 23:20:07.094272 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:20:07.094248 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6386da02_f1c3_4158_81f9_675f84da4261.slice/crio-36ffaab7995318580f11a36bab4eb216a7c3888b8f4fbbab538240be9ccf9dcb WatchSource:0}: Error finding container 36ffaab7995318580f11a36bab4eb216a7c3888b8f4fbbab538240be9ccf9dcb: Status 404 returned error can't find the container with id 36ffaab7995318580f11a36bab4eb216a7c3888b8f4fbbab538240be9ccf9dcb Oct 29 23:20:07.103110 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:07.103080 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx" event={"ID":"6386da02-f1c3-4158-81f9-675f84da4261","Type":"ContainerStarted","Data":"36ffaab7995318580f11a36bab4eb216a7c3888b8f4fbbab538240be9ccf9dcb"} Oct 29 23:20:07.110886 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:07.110856 6029 generic.go:356] "Generic (PLEG): container finished" podID="0a9641b9-9cfa-4a3f-b2cb-adac746c67ac" containerID="52a90fdf071620c29423c48393cbab9b8fc60388c38a1110faa323100b7a48a4" exitCode=0 Oct 29 23:20:07.110997 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:07.110899 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj" event={"ID":"0a9641b9-9cfa-4a3f-b2cb-adac746c67ac","Type":"ContainerDied","Data":"52a90fdf071620c29423c48393cbab9b8fc60388c38a1110faa323100b7a48a4"} Oct 29 23:20:07.110997 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:07.110914 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj" Oct 29 23:20:07.110997 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:07.110969 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj" event={"ID":"0a9641b9-9cfa-4a3f-b2cb-adac746c67ac","Type":"ContainerDied","Data":"bf5224e5b20dd4d7e84b425ecefafde8fb3575d2edaefcc03878d9c33c40b214"} Oct 29 23:20:07.110997 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:07.110992 6029 scope.go:122] "RemoveContainer" containerID="52a90fdf071620c29423c48393cbab9b8fc60388c38a1110faa323100b7a48a4" Oct 29 23:20:07.121929 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:07.121911 6029 scope.go:122] "RemoveContainer" containerID="52a90fdf071620c29423c48393cbab9b8fc60388c38a1110faa323100b7a48a4" Oct 29 23:20:07.122208 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:20:07.122188 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52a90fdf071620c29423c48393cbab9b8fc60388c38a1110faa323100b7a48a4\": container with ID starting with 52a90fdf071620c29423c48393cbab9b8fc60388c38a1110faa323100b7a48a4 not found: ID does not exist" containerID="52a90fdf071620c29423c48393cbab9b8fc60388c38a1110faa323100b7a48a4" Oct 29 23:20:07.122262 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:07.122218 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a90fdf071620c29423c48393cbab9b8fc60388c38a1110faa323100b7a48a4"} err="failed to get container status \"52a90fdf071620c29423c48393cbab9b8fc60388c38a1110faa323100b7a48a4\": rpc error: code = NotFound desc = could not find container \"52a90fdf071620c29423c48393cbab9b8fc60388c38a1110faa323100b7a48a4\": container with ID starting with 52a90fdf071620c29423c48393cbab9b8fc60388c38a1110faa323100b7a48a4 not found: ID does not exist" Oct 29 23:20:07.175449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:07.175414 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj"] Oct 29 23:20:07.179507 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:07.179482 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-wjhkj"] Oct 29 23:20:07.387827 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:07.387721 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0a9641b9-9cfa-4a3f-b2cb-adac746c67ac" path="/var/lib/kubelet/pods/0a9641b9-9cfa-4a3f-b2cb-adac746c67ac/volumes" Oct 29 23:20:08.117181 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:08.117143 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx" event={"ID":"6386da02-f1c3-4158-81f9-675f84da4261","Type":"ContainerStarted","Data":"2e68494d7f12d8f5dbd41c089aad63f131c6cfeacef0c76432f5f0e9e80fb5cd"} Oct 29 23:20:08.117681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:08.117256 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx" Oct 29 23:20:08.192295 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:08.192243 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx" podStartSLOduration=2.192228499 podStartE2EDuration="2.192228499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:20:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:20:08.17747338 +0000 UTC m=+374.903723977" watchObservedRunningTime="2026-10-29 23:20:08.192228499 +0000 UTC m=+374.918479086" Oct 29 23:20:08.920734 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:20:08.920699 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:20:19.125777 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:19.125745 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx" Oct 29 23:20:19.219052 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:19.219015 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl"] Oct 29 23:20:19.219312 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:19.219288 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl" podUID="bdab193c-a1f7-4993-b5cd-bc2d84752d24" containerName="manager" containerID="cri-o://27f203563a500ab75845c3ef32f72a22bf99356d238877b7ca7d66d4be6b7636" gracePeriod=10 Oct 29 23:20:19.460346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:19.460324 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl" Oct 29 23:20:19.507234 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:19.507201 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bdab193c-a1f7-4993-b5cd-bc2d84752d24-kube-api-access-s9rrb\" (UniqueName: \"kubernetes.io/projected/bdab193c-a1f7-4993-b5cd-bc2d84752d24-kube-api-access-s9rrb\") pod \"bdab193c-a1f7-4993-b5cd-bc2d84752d24\" (UID: \"bdab193c-a1f7-4993-b5cd-bc2d84752d24\") " Oct 29 23:20:19.507411 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:19.507322 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bdab193c-a1f7-4993-b5cd-bc2d84752d24-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdab193c-a1f7-4993-b5cd-bc2d84752d24-extensions-socket-volume\") pod \"bdab193c-a1f7-4993-b5cd-bc2d84752d24\" (UID: \"bdab193c-a1f7-4993-b5cd-bc2d84752d24\") " Oct 29 23:20:19.507706 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:19.507681 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdab193c-a1f7-4993-b5cd-bc2d84752d24-extensions-socket-volume" pod "bdab193c-a1f7-4993-b5cd-bc2d84752d24" (UID: "bdab193c-a1f7-4993-b5cd-bc2d84752d24"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:20:19.509361 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:19.509332 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdab193c-a1f7-4993-b5cd-bc2d84752d24-kube-api-access-s9rrb" pod "bdab193c-a1f7-4993-b5cd-bc2d84752d24" (UID: "bdab193c-a1f7-4993-b5cd-bc2d84752d24"). InnerVolumeSpecName "kube-api-access-s9rrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:20:19.608071 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:19.608037 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9rrb\" (UniqueName: \"kubernetes.io/projected/bdab193c-a1f7-4993-b5cd-bc2d84752d24-kube-api-access-s9rrb\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:20:19.608071 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:19.608064 6029 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdab193c-a1f7-4993-b5cd-bc2d84752d24-extensions-socket-volume\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:20:20.178946 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:20.178912 6029 generic.go:356] "Generic (PLEG): container finished" podID="bdab193c-a1f7-4993-b5cd-bc2d84752d24" containerID="27f203563a500ab75845c3ef32f72a22bf99356d238877b7ca7d66d4be6b7636" exitCode=0 Oct 29 23:20:20.178946 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:20.178951 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl" event={"ID":"bdab193c-a1f7-4993-b5cd-bc2d84752d24","Type":"ContainerDied","Data":"27f203563a500ab75845c3ef32f72a22bf99356d238877b7ca7d66d4be6b7636"} Oct 29 23:20:20.179443 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:20.178963 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl" Oct 29 23:20:20.179443 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:20.178992 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl" event={"ID":"bdab193c-a1f7-4993-b5cd-bc2d84752d24","Type":"ContainerDied","Data":"6a1a89a4b15731153a0af7378107131474170a94bbb0c85e111ed73ffc7e0d94"} Oct 29 23:20:20.179443 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:20.179013 6029 scope.go:122] "RemoveContainer" containerID="27f203563a500ab75845c3ef32f72a22bf99356d238877b7ca7d66d4be6b7636" Oct 29 23:20:20.192885 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:20.192863 6029 scope.go:122] "RemoveContainer" containerID="27f203563a500ab75845c3ef32f72a22bf99356d238877b7ca7d66d4be6b7636" Oct 29 23:20:20.193191 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:20:20.193169 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27f203563a500ab75845c3ef32f72a22bf99356d238877b7ca7d66d4be6b7636\": container with ID starting with 27f203563a500ab75845c3ef32f72a22bf99356d238877b7ca7d66d4be6b7636 not found: ID does not exist" containerID="27f203563a500ab75845c3ef32f72a22bf99356d238877b7ca7d66d4be6b7636" Oct 29 23:20:20.193267 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:20.193200 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27f203563a500ab75845c3ef32f72a22bf99356d238877b7ca7d66d4be6b7636"} err="failed to get container status \"27f203563a500ab75845c3ef32f72a22bf99356d238877b7ca7d66d4be6b7636\": rpc error: code = NotFound desc = could not find container \"27f203563a500ab75845c3ef32f72a22bf99356d238877b7ca7d66d4be6b7636\": container with ID starting with 27f203563a500ab75845c3ef32f72a22bf99356d238877b7ca7d66d4be6b7636 not found: ID does not exist" Oct 29 23:20:20.258916 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:20.258886 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl"] Oct 29 23:20:20.281717 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:20.281682 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-74rxl"] Oct 29 23:20:21.387379 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:21.387345 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bdab193c-a1f7-4993-b5cd-bc2d84752d24" path="/var/lib/kubelet/pods/bdab193c-a1f7-4993-b5cd-bc2d84752d24/volumes" Oct 29 23:20:36.945186 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:36.945148 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-lwfbh"] Oct 29 23:20:36.945665 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:36.945492 6029 cpu_manager.go:414] "containerMap: removing container" podUID="bdab193c-a1f7-4993-b5cd-bc2d84752d24" containerName="manager" Oct 29 23:20:36.945665 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:36.945502 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bdab193c-a1f7-4993-b5cd-bc2d84752d24" containerName="manager" Oct 29 23:20:36.945665 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:36.945561 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="bdab193c-a1f7-4993-b5cd-bc2d84752d24" containerName="manager" Oct 29 23:20:36.948270 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:36.948254 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-lwfbh" Oct 29 23:20:36.964399 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:36.964376 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Oct 29 23:20:36.969334 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:36.969309 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-lwfbh"] Oct 29 23:20:37.058104 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:37.058066 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c5f4ffa6-977b-4334-91aa-3733a4ca2e43-config-file\") pod \"limitador-limitador-74dfcfb894-lwfbh\" (UID: \"c5f4ffa6-977b-4334-91aa-3733a4ca2e43\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-lwfbh" Oct 29 23:20:37.058257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:37.058190 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h56t\" (UniqueName: \"kubernetes.io/projected/c5f4ffa6-977b-4334-91aa-3733a4ca2e43-kube-api-access-4h56t\") pod \"limitador-limitador-74dfcfb894-lwfbh\" (UID: \"c5f4ffa6-977b-4334-91aa-3733a4ca2e43\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-lwfbh" Oct 29 23:20:37.080008 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:37.079977 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-lwfbh"] Oct 29 23:20:37.159362 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:37.159332 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h56t\" (UniqueName: \"kubernetes.io/projected/c5f4ffa6-977b-4334-91aa-3733a4ca2e43-kube-api-access-4h56t\") pod \"limitador-limitador-74dfcfb894-lwfbh\" (UID: \"c5f4ffa6-977b-4334-91aa-3733a4ca2e43\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-lwfbh" Oct 29 23:20:37.159529 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:37.159400 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c5f4ffa6-977b-4334-91aa-3733a4ca2e43-config-file\") pod \"limitador-limitador-74dfcfb894-lwfbh\" (UID: \"c5f4ffa6-977b-4334-91aa-3733a4ca2e43\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-lwfbh" Oct 29 23:20:37.160018 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:37.159998 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c5f4ffa6-977b-4334-91aa-3733a4ca2e43-config-file\") pod \"limitador-limitador-74dfcfb894-lwfbh\" (UID: \"c5f4ffa6-977b-4334-91aa-3733a4ca2e43\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-lwfbh" Oct 29 23:20:37.180199 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:37.180169 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h56t\" (UniqueName: \"kubernetes.io/projected/c5f4ffa6-977b-4334-91aa-3733a4ca2e43-kube-api-access-4h56t\") pod \"limitador-limitador-74dfcfb894-lwfbh\" (UID: \"c5f4ffa6-977b-4334-91aa-3733a4ca2e43\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-lwfbh" Oct 29 23:20:37.260240 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:37.260202 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-lwfbh" Oct 29 23:20:37.552769 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:37.552735 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-lwfbh"] Oct 29 23:20:37.553793 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:20:37.553768 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5f4ffa6_977b_4334_91aa_3733a4ca2e43.slice/crio-ec1f258cfd9ca875e303be4196a679587b9c737aa8f114151611993ace743d03 WatchSource:0}: Error finding container ec1f258cfd9ca875e303be4196a679587b9c737aa8f114151611993ace743d03: Status 404 returned error can't find the container with id ec1f258cfd9ca875e303be4196a679587b9c737aa8f114151611993ace743d03 Oct 29 23:20:37.811786 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:37.811705 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-bf6t8"] Oct 29 23:20:37.816261 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:37.816243 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-bf6t8" Oct 29 23:20:37.834400 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:37.834372 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-bf6t8"] Oct 29 23:20:37.866379 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:37.866350 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhh26\" (UniqueName: \"kubernetes.io/projected/949674c0-f5a9-4d8f-8898-2c70e4113aaf-kube-api-access-bhh26\") pod \"authorino-57f7f8659f-bf6t8\" (UID: \"949674c0-f5a9-4d8f-8898-2c70e4113aaf\") " pod="kuadrant-system/authorino-57f7f8659f-bf6t8" Oct 29 23:20:37.869075 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:37.869054 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-x56px\"" Oct 29 23:20:37.967662 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:37.967623 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhh26\" (UniqueName: \"kubernetes.io/projected/949674c0-f5a9-4d8f-8898-2c70e4113aaf-kube-api-access-bhh26\") pod \"authorino-57f7f8659f-bf6t8\" (UID: \"949674c0-f5a9-4d8f-8898-2c70e4113aaf\") " pod="kuadrant-system/authorino-57f7f8659f-bf6t8" Oct 29 23:20:37.989983 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:37.989946 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhh26\" (UniqueName: \"kubernetes.io/projected/949674c0-f5a9-4d8f-8898-2c70e4113aaf-kube-api-access-bhh26\") pod \"authorino-57f7f8659f-bf6t8\" (UID: \"949674c0-f5a9-4d8f-8898-2c70e4113aaf\") " pod="kuadrant-system/authorino-57f7f8659f-bf6t8" Oct 29 23:20:38.128148 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:38.128066 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-bf6t8" Oct 29 23:20:38.273243 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:38.273203 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-lwfbh" event={"ID":"c5f4ffa6-977b-4334-91aa-3733a4ca2e43","Type":"ContainerStarted","Data":"ec1f258cfd9ca875e303be4196a679587b9c737aa8f114151611993ace743d03"} Oct 29 23:20:38.385774 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:38.385706 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-m7s4k"] Oct 29 23:20:38.389351 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:38.389325 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-m7s4k" Oct 29 23:20:38.411155 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:38.411130 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-m7s4k"] Oct 29 23:20:38.422828 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:38.422797 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-bf6t8"] Oct 29 23:20:38.425636 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:20:38.425610 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod949674c0_f5a9_4d8f_8898_2c70e4113aaf.slice/crio-00cf5bc9e655b2f9c8b2c288a705cedf212a1d19e7c1b2c5249f5b4ff1936bb2 WatchSource:0}: Error finding container 00cf5bc9e655b2f9c8b2c288a705cedf212a1d19e7c1b2c5249f5b4ff1936bb2: Status 404 returned error can't find the container with id 00cf5bc9e655b2f9c8b2c288a705cedf212a1d19e7c1b2c5249f5b4ff1936bb2 Oct 29 23:20:38.472357 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:38.472322 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8kpk\" (UniqueName: \"kubernetes.io/projected/95fc4b12-ffc3-490d-9bb1-9c124c291fa4-kube-api-access-n8kpk\") pod \"authorino-56c6c9ddd5-m7s4k\" (UID: \"95fc4b12-ffc3-490d-9bb1-9c124c291fa4\") " pod="kuadrant-system/authorino-56c6c9ddd5-m7s4k" Oct 29 23:20:38.573839 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:38.573699 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8kpk\" (UniqueName: \"kubernetes.io/projected/95fc4b12-ffc3-490d-9bb1-9c124c291fa4-kube-api-access-n8kpk\") pod \"authorino-56c6c9ddd5-m7s4k\" (UID: \"95fc4b12-ffc3-490d-9bb1-9c124c291fa4\") " pod="kuadrant-system/authorino-56c6c9ddd5-m7s4k" Oct 29 23:20:38.597381 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:38.597341 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8kpk\" (UniqueName: \"kubernetes.io/projected/95fc4b12-ffc3-490d-9bb1-9c124c291fa4-kube-api-access-n8kpk\") pod \"authorino-56c6c9ddd5-m7s4k\" (UID: \"95fc4b12-ffc3-490d-9bb1-9c124c291fa4\") " pod="kuadrant-system/authorino-56c6c9ddd5-m7s4k" Oct 29 23:20:38.703257 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:38.703220 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-m7s4k" Oct 29 23:20:38.920647 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:20:38.920553 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:20:38.997921 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:38.997891 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-m7s4k"] Oct 29 23:20:38.999325 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:20:38.999296 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95fc4b12_ffc3_490d_9bb1_9c124c291fa4.slice/crio-f0300cfba8eee3e934de3c9bf5e301210a9ca3fa3edfb4d45e3656a0719f7c18 WatchSource:0}: Error finding container f0300cfba8eee3e934de3c9bf5e301210a9ca3fa3edfb4d45e3656a0719f7c18: Status 404 returned error can't find the container with id f0300cfba8eee3e934de3c9bf5e301210a9ca3fa3edfb4d45e3656a0719f7c18 Oct 29 23:20:39.281651 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:39.281609 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-bf6t8" event={"ID":"949674c0-f5a9-4d8f-8898-2c70e4113aaf","Type":"ContainerStarted","Data":"00cf5bc9e655b2f9c8b2c288a705cedf212a1d19e7c1b2c5249f5b4ff1936bb2"} Oct 29 23:20:39.283599 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:39.283564 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-lwfbh" event={"ID":"c5f4ffa6-977b-4334-91aa-3733a4ca2e43","Type":"ContainerStarted","Data":"e2123d1f8ff4695d2bc3e0151c6dffa5c8d243f5c0ced795109b6ead9eae4de0"} Oct 29 23:20:39.283762 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:39.283718 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-lwfbh" Oct 29 23:20:39.284996 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:39.284962 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-m7s4k" event={"ID":"95fc4b12-ffc3-490d-9bb1-9c124c291fa4","Type":"ContainerStarted","Data":"f0300cfba8eee3e934de3c9bf5e301210a9ca3fa3edfb4d45e3656a0719f7c18"} Oct 29 23:20:39.327236 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:39.327182 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-lwfbh" podStartSLOduration=2.280890774 podStartE2EDuration="3.327168524s" totalImagesPullingTime="1.04627775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:20:39.325847844 +0000 UTC m=+406.052098437" watchObservedRunningTime="2026-10-29 23:20:39.327168524 +0000 UTC m=+406.053419116" Oct 29 23:20:40.292279 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:40.292244 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-bf6t8" event={"ID":"949674c0-f5a9-4d8f-8898-2c70e4113aaf","Type":"ContainerStarted","Data":"409f71357b40f14cdb8cc745156ce15fb9e67980f37817387078e56fc9f4a14f"} Oct 29 23:20:40.332795 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:40.332735 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-bf6t8" podStartSLOduration=1.632670523 podStartE2EDuration="3.332714196s" totalImagesPullingTime="1.700043673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:20:40.331885384 +0000 UTC m=+407.058135977" watchObservedRunningTime="2026-10-29 23:20:40.332714196 +0000 UTC m=+407.058964788" Oct 29 23:20:41.299198 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:41.299154 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-m7s4k" event={"ID":"95fc4b12-ffc3-490d-9bb1-9c124c291fa4","Type":"ContainerStarted","Data":"c8dbd98d5b31e5ad117b5fe280f26a68d544c4103675b559aceacb17e2d2f474"} Oct 29 23:20:41.339906 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:41.339852 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-m7s4k" podStartSLOduration=1.904768215 podStartE2EDuration="3.339836758s" totalImagesPullingTime="1.435068543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:20:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:20:41.33913777 +0000 UTC m=+408.065388364" watchObservedRunningTime="2026-10-29 23:20:41.339836758 +0000 UTC m=+408.066087344" Oct 29 23:20:41.364700 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:41.364661 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-bf6t8"] Oct 29 23:20:42.304303 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:42.304263 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-bf6t8" podUID="949674c0-f5a9-4d8f-8898-2c70e4113aaf" containerName="authorino" containerID="cri-o://409f71357b40f14cdb8cc745156ce15fb9e67980f37817387078e56fc9f4a14f" gracePeriod=30 Oct 29 23:20:42.546472 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:42.546446 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-bf6t8" Oct 29 23:20:42.611842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:42.611744 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/949674c0-f5a9-4d8f-8898-2c70e4113aaf-kube-api-access-bhh26\" (UniqueName: \"kubernetes.io/projected/949674c0-f5a9-4d8f-8898-2c70e4113aaf-kube-api-access-bhh26\") pod \"949674c0-f5a9-4d8f-8898-2c70e4113aaf\" (UID: \"949674c0-f5a9-4d8f-8898-2c70e4113aaf\") " Oct 29 23:20:42.613875 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:42.613837 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/949674c0-f5a9-4d8f-8898-2c70e4113aaf-kube-api-access-bhh26" pod "949674c0-f5a9-4d8f-8898-2c70e4113aaf" (UID: "949674c0-f5a9-4d8f-8898-2c70e4113aaf"). InnerVolumeSpecName "kube-api-access-bhh26". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:20:42.713138 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:42.713102 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhh26\" (UniqueName: \"kubernetes.io/projected/949674c0-f5a9-4d8f-8898-2c70e4113aaf-kube-api-access-bhh26\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:20:43.310894 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:43.310849 6029 generic.go:356] "Generic (PLEG): container finished" podID="949674c0-f5a9-4d8f-8898-2c70e4113aaf" containerID="409f71357b40f14cdb8cc745156ce15fb9e67980f37817387078e56fc9f4a14f" exitCode=0 Oct 29 23:20:43.311365 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:43.310946 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-bf6t8" Oct 29 23:20:43.311365 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:43.310962 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-bf6t8" event={"ID":"949674c0-f5a9-4d8f-8898-2c70e4113aaf","Type":"ContainerDied","Data":"409f71357b40f14cdb8cc745156ce15fb9e67980f37817387078e56fc9f4a14f"} Oct 29 23:20:43.311365 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:43.311008 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-bf6t8" event={"ID":"949674c0-f5a9-4d8f-8898-2c70e4113aaf","Type":"ContainerDied","Data":"00cf5bc9e655b2f9c8b2c288a705cedf212a1d19e7c1b2c5249f5b4ff1936bb2"} Oct 29 23:20:43.311365 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:43.311034 6029 scope.go:122] "RemoveContainer" containerID="409f71357b40f14cdb8cc745156ce15fb9e67980f37817387078e56fc9f4a14f" Oct 29 23:20:43.319744 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:43.319730 6029 scope.go:122] "RemoveContainer" containerID="409f71357b40f14cdb8cc745156ce15fb9e67980f37817387078e56fc9f4a14f" Oct 29 23:20:43.320095 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:20:43.320077 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"409f71357b40f14cdb8cc745156ce15fb9e67980f37817387078e56fc9f4a14f\": container with ID starting with 409f71357b40f14cdb8cc745156ce15fb9e67980f37817387078e56fc9f4a14f not found: ID does not exist" containerID="409f71357b40f14cdb8cc745156ce15fb9e67980f37817387078e56fc9f4a14f" Oct 29 23:20:43.320139 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:43.320103 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"409f71357b40f14cdb8cc745156ce15fb9e67980f37817387078e56fc9f4a14f"} err="failed to get container status \"409f71357b40f14cdb8cc745156ce15fb9e67980f37817387078e56fc9f4a14f\": rpc error: code = NotFound desc = could not find container \"409f71357b40f14cdb8cc745156ce15fb9e67980f37817387078e56fc9f4a14f\": container with ID starting with 409f71357b40f14cdb8cc745156ce15fb9e67980f37817387078e56fc9f4a14f not found: ID does not exist" Oct 29 23:20:43.366952 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:43.366919 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-bf6t8"] Oct 29 23:20:43.369059 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:43.369037 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-bf6t8"] Oct 29 23:20:43.388073 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:43.388045 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="949674c0-f5a9-4d8f-8898-2c70e4113aaf" path="/var/lib/kubelet/pods/949674c0-f5a9-4d8f-8898-2c70e4113aaf/volumes" Oct 29 23:20:50.293526 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:50.293497 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-lwfbh" Oct 29 23:20:51.357484 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:51.357452 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-lwfbh"] Oct 29 23:20:51.357932 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:51.357620 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-lwfbh" podUID="c5f4ffa6-977b-4334-91aa-3733a4ca2e43" containerName="limitador" containerID="cri-o://e2123d1f8ff4695d2bc3e0151c6dffa5c8d243f5c0ced795109b6ead9eae4de0" gracePeriod=30 Oct 29 23:20:51.918562 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:51.918499 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-lwfbh" Oct 29 23:20:52.096053 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:52.096019 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5f4ffa6-977b-4334-91aa-3733a4ca2e43-kube-api-access-4h56t\" (UniqueName: \"kubernetes.io/projected/c5f4ffa6-977b-4334-91aa-3733a4ca2e43-kube-api-access-4h56t\") pod \"c5f4ffa6-977b-4334-91aa-3733a4ca2e43\" (UID: \"c5f4ffa6-977b-4334-91aa-3733a4ca2e43\") " Oct 29 23:20:52.096231 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:52.096089 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c5f4ffa6-977b-4334-91aa-3733a4ca2e43-config-file\" (UniqueName: \"kubernetes.io/configmap/c5f4ffa6-977b-4334-91aa-3733a4ca2e43-config-file\") pod \"c5f4ffa6-977b-4334-91aa-3733a4ca2e43\" (UID: \"c5f4ffa6-977b-4334-91aa-3733a4ca2e43\") " Oct 29 23:20:52.096474 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:52.096448 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5f4ffa6-977b-4334-91aa-3733a4ca2e43-config-file" pod "c5f4ffa6-977b-4334-91aa-3733a4ca2e43" (UID: "c5f4ffa6-977b-4334-91aa-3733a4ca2e43"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:20:52.098128 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:52.098107 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5f4ffa6-977b-4334-91aa-3733a4ca2e43-kube-api-access-4h56t" pod "c5f4ffa6-977b-4334-91aa-3733a4ca2e43" (UID: "c5f4ffa6-977b-4334-91aa-3733a4ca2e43"). InnerVolumeSpecName "kube-api-access-4h56t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:20:52.197563 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:52.197466 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4h56t\" (UniqueName: \"kubernetes.io/projected/c5f4ffa6-977b-4334-91aa-3733a4ca2e43-kube-api-access-4h56t\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:20:52.197563 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:52.197505 6029 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c5f4ffa6-977b-4334-91aa-3733a4ca2e43-config-file\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:20:52.357365 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:52.357331 6029 generic.go:356] "Generic (PLEG): container finished" podID="c5f4ffa6-977b-4334-91aa-3733a4ca2e43" containerID="e2123d1f8ff4695d2bc3e0151c6dffa5c8d243f5c0ced795109b6ead9eae4de0" exitCode=0 Oct 29 23:20:52.357519 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:52.357379 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-lwfbh" Oct 29 23:20:52.357519 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:52.357399 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-lwfbh" event={"ID":"c5f4ffa6-977b-4334-91aa-3733a4ca2e43","Type":"ContainerDied","Data":"e2123d1f8ff4695d2bc3e0151c6dffa5c8d243f5c0ced795109b6ead9eae4de0"} Oct 29 23:20:52.357519 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:52.357443 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-lwfbh" event={"ID":"c5f4ffa6-977b-4334-91aa-3733a4ca2e43","Type":"ContainerDied","Data":"ec1f258cfd9ca875e303be4196a679587b9c737aa8f114151611993ace743d03"} Oct 29 23:20:52.357519 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:52.357465 6029 scope.go:122] "RemoveContainer" containerID="e2123d1f8ff4695d2bc3e0151c6dffa5c8d243f5c0ced795109b6ead9eae4de0" Oct 29 23:20:52.365977 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:52.365958 6029 scope.go:122] "RemoveContainer" containerID="e2123d1f8ff4695d2bc3e0151c6dffa5c8d243f5c0ced795109b6ead9eae4de0" Oct 29 23:20:52.366262 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:20:52.366244 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2123d1f8ff4695d2bc3e0151c6dffa5c8d243f5c0ced795109b6ead9eae4de0\": container with ID starting with e2123d1f8ff4695d2bc3e0151c6dffa5c8d243f5c0ced795109b6ead9eae4de0 not found: ID does not exist" containerID="e2123d1f8ff4695d2bc3e0151c6dffa5c8d243f5c0ced795109b6ead9eae4de0" Oct 29 23:20:52.366304 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:52.366273 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2123d1f8ff4695d2bc3e0151c6dffa5c8d243f5c0ced795109b6ead9eae4de0"} err="failed to get container status \"e2123d1f8ff4695d2bc3e0151c6dffa5c8d243f5c0ced795109b6ead9eae4de0\": rpc error: code = NotFound desc = could not find container \"e2123d1f8ff4695d2bc3e0151c6dffa5c8d243f5c0ced795109b6ead9eae4de0\": container with ID starting with e2123d1f8ff4695d2bc3e0151c6dffa5c8d243f5c0ced795109b6ead9eae4de0 not found: ID does not exist" Oct 29 23:20:52.413158 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:52.413127 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-lwfbh"] Oct 29 23:20:52.419417 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:52.419394 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-lwfbh"] Oct 29 23:20:53.387861 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:53.387828 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c5f4ffa6-977b-4334-91aa-3733a4ca2e43" path="/var/lib/kubelet/pods/c5f4ffa6-977b-4334-91aa-3733a4ca2e43/volumes" Oct 29 23:20:58.468868 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:58.468833 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-88hwr"] Oct 29 23:20:58.469259 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:58.469175 6029 cpu_manager.go:414] "containerMap: removing container" podUID="c5f4ffa6-977b-4334-91aa-3733a4ca2e43" containerName="limitador" Oct 29 23:20:58.469259 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:58.469186 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c5f4ffa6-977b-4334-91aa-3733a4ca2e43" containerName="limitador" Oct 29 23:20:58.469259 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:58.469218 6029 cpu_manager.go:414] "containerMap: removing container" podUID="949674c0-f5a9-4d8f-8898-2c70e4113aaf" containerName="authorino" Oct 29 23:20:58.469259 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:58.469224 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="949674c0-f5a9-4d8f-8898-2c70e4113aaf" containerName="authorino" Oct 29 23:20:58.469386 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:58.469287 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="949674c0-f5a9-4d8f-8898-2c70e4113aaf" containerName="authorino" Oct 29 23:20:58.469386 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:58.469296 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="c5f4ffa6-977b-4334-91aa-3733a4ca2e43" containerName="limitador" Oct 29 23:20:58.473757 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:58.473740 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-88hwr" Oct 29 23:20:58.495073 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:58.495041 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 29 23:20:58.504968 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:58.504935 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Oct 29 23:20:58.505116 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:58.505047 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 29 23:20:58.505162 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:58.505116 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-j2vbf\"" Oct 29 23:20:58.506594 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:58.506572 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-88hwr"] Oct 29 23:20:58.648503 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:58.648467 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzllg\" (UniqueName: \"kubernetes.io/projected/7c1cdf4b-97ef-4c4e-a94d-e45a64dc08c8-kube-api-access-qzllg\") pod \"postgres-7cdbf6dc44-88hwr\" (UID: \"7c1cdf4b-97ef-4c4e-a94d-e45a64dc08c8\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-88hwr" Oct 29 23:20:58.648658 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:58.648527 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7c1cdf4b-97ef-4c4e-a94d-e45a64dc08c8-data\") pod \"postgres-7cdbf6dc44-88hwr\" (UID: \"7c1cdf4b-97ef-4c4e-a94d-e45a64dc08c8\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-88hwr" Oct 29 23:20:58.749994 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:58.749966 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzllg\" (UniqueName: \"kubernetes.io/projected/7c1cdf4b-97ef-4c4e-a94d-e45a64dc08c8-kube-api-access-qzllg\") pod \"postgres-7cdbf6dc44-88hwr\" (UID: \"7c1cdf4b-97ef-4c4e-a94d-e45a64dc08c8\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-88hwr" Oct 29 23:20:58.750147 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:58.750022 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7c1cdf4b-97ef-4c4e-a94d-e45a64dc08c8-data\") pod \"postgres-7cdbf6dc44-88hwr\" (UID: \"7c1cdf4b-97ef-4c4e-a94d-e45a64dc08c8\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-88hwr" Oct 29 23:20:58.750393 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:58.750376 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7c1cdf4b-97ef-4c4e-a94d-e45a64dc08c8-data\") pod \"postgres-7cdbf6dc44-88hwr\" (UID: \"7c1cdf4b-97ef-4c4e-a94d-e45a64dc08c8\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-88hwr" Oct 29 23:20:58.771653 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:58.771623 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzllg\" (UniqueName: \"kubernetes.io/projected/7c1cdf4b-97ef-4c4e-a94d-e45a64dc08c8-kube-api-access-qzllg\") pod \"postgres-7cdbf6dc44-88hwr\" (UID: \"7c1cdf4b-97ef-4c4e-a94d-e45a64dc08c8\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-88hwr" Oct 29 23:20:58.787462 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:58.787433 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-88hwr" Oct 29 23:20:59.105022 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:59.104993 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-88hwr"] Oct 29 23:20:59.106229 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:20:59.106204 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c1cdf4b_97ef_4c4e_a94d_e45a64dc08c8.slice/crio-39e109de5d96153aeb12d3d3e939eb279e41c91899ee0af68f34938d61b0b4e3 WatchSource:0}: Error finding container 39e109de5d96153aeb12d3d3e939eb279e41c91899ee0af68f34938d61b0b4e3: Status 404 returned error can't find the container with id 39e109de5d96153aeb12d3d3e939eb279e41c91899ee0af68f34938d61b0b4e3 Oct 29 23:20:59.391266 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:20:59.391189 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-88hwr" event={"ID":"7c1cdf4b-97ef-4c4e-a94d-e45a64dc08c8","Type":"ContainerStarted","Data":"39e109de5d96153aeb12d3d3e939eb279e41c91899ee0af68f34938d61b0b4e3"} Oct 29 23:21:04.422213 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:04.422175 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-88hwr" event={"ID":"7c1cdf4b-97ef-4c4e-a94d-e45a64dc08c8","Type":"ContainerStarted","Data":"33ba0cd4dd4d451328745d7f1cb93bbc64036b28ad3ad033238707a78975fb22"} Oct 29 23:21:04.422612 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:04.422274 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-88hwr" Oct 29 23:21:04.465539 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:04.465487 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-88hwr" podStartSLOduration=1.7698666539999999 podStartE2EDuration="6.465475245s" totalImagesPullingTime="4.695608591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:20:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:21:04.464631474 +0000 UTC m=+431.190882069" watchObservedRunningTime="2026-10-29 23:21:04.465475245 +0000 UTC m=+431.191725878" Oct 29 23:21:08.920586 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:21:08.920548 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:21:10.455718 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:10.455688 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-88hwr" Oct 29 23:21:11.231460 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.231426 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-tqqll"] Oct 29 23:21:11.244560 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.244527 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-tqqll" Oct 29 23:21:11.253990 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.253963 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-tqqll"] Oct 29 23:21:11.364687 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.364650 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zhqq\" (UniqueName: \"kubernetes.io/projected/76e39381-76df-4dcc-9e8c-51222cf22dee-kube-api-access-7zhqq\") pod \"authorino-6f6944bcdd-tqqll\" (UID: \"76e39381-76df-4dcc-9e8c-51222cf22dee\") " pod="kuadrant-system/authorino-6f6944bcdd-tqqll" Oct 29 23:21:11.397379 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.397349 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-tqqll"] Oct 29 23:21:11.397600 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:21:11.397582 6029 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7zhqq], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6f6944bcdd-tqqll" podUID="76e39381-76df-4dcc-9e8c-51222cf22dee" Oct 29 23:21:11.423923 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.423878 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-hbklq"] Oct 29 23:21:11.455848 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.455806 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-tqqll" Oct 29 23:21:11.465314 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.465282 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zhqq\" (UniqueName: \"kubernetes.io/projected/76e39381-76df-4dcc-9e8c-51222cf22dee-kube-api-access-7zhqq\") pod \"authorino-6f6944bcdd-tqqll\" (UID: \"76e39381-76df-4dcc-9e8c-51222cf22dee\") " pod="kuadrant-system/authorino-6f6944bcdd-tqqll" Oct 29 23:21:11.480361 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.480327 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-hbklq"] Oct 29 23:21:11.480515 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.480421 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-hbklq" Oct 29 23:21:11.486266 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.486192 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zhqq\" (UniqueName: \"kubernetes.io/projected/76e39381-76df-4dcc-9e8c-51222cf22dee-kube-api-access-7zhqq\") pod \"authorino-6f6944bcdd-tqqll\" (UID: \"76e39381-76df-4dcc-9e8c-51222cf22dee\") " pod="kuadrant-system/authorino-6f6944bcdd-tqqll" Oct 29 23:21:11.486911 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.486893 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-tqqll" Oct 29 23:21:11.496708 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.496677 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Oct 29 23:21:11.566735 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.566697 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/76e39381-76df-4dcc-9e8c-51222cf22dee-kube-api-access-7zhqq\" (UniqueName: \"kubernetes.io/projected/76e39381-76df-4dcc-9e8c-51222cf22dee-kube-api-access-7zhqq\") pod \"76e39381-76df-4dcc-9e8c-51222cf22dee\" (UID: \"76e39381-76df-4dcc-9e8c-51222cf22dee\") " Oct 29 23:21:11.566952 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.566837 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsd7v\" (UniqueName: \"kubernetes.io/projected/237af21d-a2aa-44e2-a54c-35795aedc496-kube-api-access-wsd7v\") pod \"authorino-6889cbd8c4-hbklq\" (UID: \"237af21d-a2aa-44e2-a54c-35795aedc496\") " pod="kuadrant-system/authorino-6889cbd8c4-hbklq" Oct 29 23:21:11.567023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.566976 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/237af21d-a2aa-44e2-a54c-35795aedc496-tls-cert\") pod \"authorino-6889cbd8c4-hbklq\" (UID: \"237af21d-a2aa-44e2-a54c-35795aedc496\") " pod="kuadrant-system/authorino-6889cbd8c4-hbklq" Oct 29 23:21:11.568986 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.568954 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76e39381-76df-4dcc-9e8c-51222cf22dee-kube-api-access-7zhqq" pod "76e39381-76df-4dcc-9e8c-51222cf22dee" (UID: "76e39381-76df-4dcc-9e8c-51222cf22dee"). InnerVolumeSpecName "kube-api-access-7zhqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:21:11.581210 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.581183 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-hbklq"] Oct 29 23:21:11.581413 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:21:11.581396 6029 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-wsd7v tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6889cbd8c4-hbklq" podUID="237af21d-a2aa-44e2-a54c-35795aedc496" Oct 29 23:21:11.615987 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.615951 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5fb764f489-bt8lv"] Oct 29 23:21:11.645842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.645737 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5fb764f489-bt8lv"] Oct 29 23:21:11.646029 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.645891 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5fb764f489-bt8lv" Oct 29 23:21:11.668196 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.668162 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/237af21d-a2aa-44e2-a54c-35795aedc496-tls-cert\") pod \"authorino-6889cbd8c4-hbklq\" (UID: \"237af21d-a2aa-44e2-a54c-35795aedc496\") " pod="kuadrant-system/authorino-6889cbd8c4-hbklq" Oct 29 23:21:11.668344 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.668203 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsd7v\" (UniqueName: \"kubernetes.io/projected/237af21d-a2aa-44e2-a54c-35795aedc496-kube-api-access-wsd7v\") pod \"authorino-6889cbd8c4-hbklq\" (UID: \"237af21d-a2aa-44e2-a54c-35795aedc496\") " pod="kuadrant-system/authorino-6889cbd8c4-hbklq" Oct 29 23:21:11.668344 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.668249 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zhqq\" (UniqueName: \"kubernetes.io/projected/76e39381-76df-4dcc-9e8c-51222cf22dee-kube-api-access-7zhqq\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:21:11.671000 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.670973 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/237af21d-a2aa-44e2-a54c-35795aedc496-tls-cert\") pod \"authorino-6889cbd8c4-hbklq\" (UID: \"237af21d-a2aa-44e2-a54c-35795aedc496\") " pod="kuadrant-system/authorino-6889cbd8c4-hbklq" Oct 29 23:21:11.692557 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.692524 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsd7v\" (UniqueName: \"kubernetes.io/projected/237af21d-a2aa-44e2-a54c-35795aedc496-kube-api-access-wsd7v\") pod \"authorino-6889cbd8c4-hbklq\" (UID: \"237af21d-a2aa-44e2-a54c-35795aedc496\") " pod="kuadrant-system/authorino-6889cbd8c4-hbklq" Oct 29 23:21:11.769108 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.769075 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ffw8\" (UniqueName: \"kubernetes.io/projected/c1644939-c94a-4397-969d-c658f04984ce-kube-api-access-5ffw8\") pod \"authorino-5fb764f489-bt8lv\" (UID: \"c1644939-c94a-4397-969d-c658f04984ce\") " pod="kuadrant-system/authorino-5fb764f489-bt8lv" Oct 29 23:21:11.769308 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.769203 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c1644939-c94a-4397-969d-c658f04984ce-tls-cert\") pod \"authorino-5fb764f489-bt8lv\" (UID: \"c1644939-c94a-4397-969d-c658f04984ce\") " pod="kuadrant-system/authorino-5fb764f489-bt8lv" Oct 29 23:21:11.870410 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.870372 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c1644939-c94a-4397-969d-c658f04984ce-tls-cert\") pod \"authorino-5fb764f489-bt8lv\" (UID: \"c1644939-c94a-4397-969d-c658f04984ce\") " pod="kuadrant-system/authorino-5fb764f489-bt8lv" Oct 29 23:21:11.870582 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.870434 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ffw8\" (UniqueName: \"kubernetes.io/projected/c1644939-c94a-4397-969d-c658f04984ce-kube-api-access-5ffw8\") pod \"authorino-5fb764f489-bt8lv\" (UID: \"c1644939-c94a-4397-969d-c658f04984ce\") " pod="kuadrant-system/authorino-5fb764f489-bt8lv" Oct 29 23:21:11.872951 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.872927 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c1644939-c94a-4397-969d-c658f04984ce-tls-cert\") pod \"authorino-5fb764f489-bt8lv\" (UID: \"c1644939-c94a-4397-969d-c658f04984ce\") " pod="kuadrant-system/authorino-5fb764f489-bt8lv" Oct 29 23:21:11.891170 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.891142 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ffw8\" (UniqueName: \"kubernetes.io/projected/c1644939-c94a-4397-969d-c658f04984ce-kube-api-access-5ffw8\") pod \"authorino-5fb764f489-bt8lv\" (UID: \"c1644939-c94a-4397-969d-c658f04984ce\") " pod="kuadrant-system/authorino-5fb764f489-bt8lv" Oct 29 23:21:11.967030 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:11.966993 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5fb764f489-bt8lv" Oct 29 23:21:12.315089 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:12.315062 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5fb764f489-bt8lv"] Oct 29 23:21:12.316639 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:21:12.316606 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1644939_c94a_4397_969d_c658f04984ce.slice/crio-3c4fbba7ba87583a00e91032195811b2d59047543f1d14ccdb4bb2666c2db269 WatchSource:0}: Error finding container 3c4fbba7ba87583a00e91032195811b2d59047543f1d14ccdb4bb2666c2db269: Status 404 returned error can't find the container with id 3c4fbba7ba87583a00e91032195811b2d59047543f1d14ccdb4bb2666c2db269 Oct 29 23:21:12.467003 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:12.466963 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5fb764f489-bt8lv" event={"ID":"c1644939-c94a-4397-969d-c658f04984ce","Type":"ContainerStarted","Data":"3c4fbba7ba87583a00e91032195811b2d59047543f1d14ccdb4bb2666c2db269"} Oct 29 23:21:12.467003 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:12.466983 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-hbklq" Oct 29 23:21:12.467541 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:12.467013 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-tqqll" Oct 29 23:21:12.477565 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:12.477522 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-hbklq" Oct 29 23:21:12.577857 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:12.577771 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/237af21d-a2aa-44e2-a54c-35795aedc496-tls-cert\" (UniqueName: \"kubernetes.io/secret/237af21d-a2aa-44e2-a54c-35795aedc496-tls-cert\") pod \"237af21d-a2aa-44e2-a54c-35795aedc496\" (UID: \"237af21d-a2aa-44e2-a54c-35795aedc496\") " Oct 29 23:21:12.578000 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:12.577901 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/237af21d-a2aa-44e2-a54c-35795aedc496-kube-api-access-wsd7v\" (UniqueName: \"kubernetes.io/projected/237af21d-a2aa-44e2-a54c-35795aedc496-kube-api-access-wsd7v\") pod \"237af21d-a2aa-44e2-a54c-35795aedc496\" (UID: \"237af21d-a2aa-44e2-a54c-35795aedc496\") " Oct 29 23:21:12.580042 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:12.580010 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/237af21d-a2aa-44e2-a54c-35795aedc496-tls-cert" pod "237af21d-a2aa-44e2-a54c-35795aedc496" (UID: "237af21d-a2aa-44e2-a54c-35795aedc496"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:21:12.580159 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:12.580064 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/237af21d-a2aa-44e2-a54c-35795aedc496-kube-api-access-wsd7v" pod "237af21d-a2aa-44e2-a54c-35795aedc496" (UID: "237af21d-a2aa-44e2-a54c-35795aedc496"). InnerVolumeSpecName "kube-api-access-wsd7v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:21:12.586602 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:12.586570 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-tqqll"] Oct 29 23:21:12.590307 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:12.590279 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-tqqll"] Oct 29 23:21:12.679153 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:12.679119 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsd7v\" (UniqueName: \"kubernetes.io/projected/237af21d-a2aa-44e2-a54c-35795aedc496-kube-api-access-wsd7v\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:21:12.679153 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:12.679149 6029 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/237af21d-a2aa-44e2-a54c-35795aedc496-tls-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:21:13.387384 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:13.387354 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="76e39381-76df-4dcc-9e8c-51222cf22dee" path="/var/lib/kubelet/pods/76e39381-76df-4dcc-9e8c-51222cf22dee/volumes" Oct 29 23:21:13.472743 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:13.472705 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5fb764f489-bt8lv" event={"ID":"c1644939-c94a-4397-969d-c658f04984ce","Type":"ContainerStarted","Data":"d8fca75e583d7868b6bac803f9f5c7f2798bcac0b8e94517005869c6e6fa5c5f"} Oct 29 23:21:13.473141 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:13.472834 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-hbklq" Oct 29 23:21:13.514247 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:13.514198 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-5fb764f489-bt8lv" podStartSLOduration=1.982261891 podStartE2EDuration="2.514185045s" totalImagesPullingTime="531.923154ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:21:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:21:13.51272554 +0000 UTC m=+440.238976129" watchObservedRunningTime="2026-10-29 23:21:13.514185045 +0000 UTC m=+440.240435638" Oct 29 23:21:13.541352 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:13.541315 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-m7s4k"] Oct 29 23:21:13.541575 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:13.541546 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-m7s4k" podUID="95fc4b12-ffc3-490d-9bb1-9c124c291fa4" containerName="authorino" containerID="cri-o://c8dbd98d5b31e5ad117b5fe280f26a68d544c4103675b559aceacb17e2d2f474" gracePeriod=30 Oct 29 23:21:13.575780 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:13.575753 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-hbklq"] Oct 29 23:21:13.585045 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:13.585010 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-hbklq"] Oct 29 23:21:13.789790 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:13.789765 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-m7s4k" Oct 29 23:21:13.890368 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:13.890334 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/95fc4b12-ffc3-490d-9bb1-9c124c291fa4-kube-api-access-n8kpk\" (UniqueName: \"kubernetes.io/projected/95fc4b12-ffc3-490d-9bb1-9c124c291fa4-kube-api-access-n8kpk\") pod \"95fc4b12-ffc3-490d-9bb1-9c124c291fa4\" (UID: \"95fc4b12-ffc3-490d-9bb1-9c124c291fa4\") " Oct 29 23:21:13.892463 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:13.892432 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95fc4b12-ffc3-490d-9bb1-9c124c291fa4-kube-api-access-n8kpk" pod "95fc4b12-ffc3-490d-9bb1-9c124c291fa4" (UID: "95fc4b12-ffc3-490d-9bb1-9c124c291fa4"). InnerVolumeSpecName "kube-api-access-n8kpk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:21:13.991110 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:13.991027 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8kpk\" (UniqueName: \"kubernetes.io/projected/95fc4b12-ffc3-490d-9bb1-9c124c291fa4-kube-api-access-n8kpk\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:21:14.479685 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:14.479649 6029 generic.go:356] "Generic (PLEG): container finished" podID="95fc4b12-ffc3-490d-9bb1-9c124c291fa4" containerID="c8dbd98d5b31e5ad117b5fe280f26a68d544c4103675b559aceacb17e2d2f474" exitCode=0 Oct 29 23:21:14.480120 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:14.479695 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-m7s4k" Oct 29 23:21:14.480120 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:14.479734 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-m7s4k" event={"ID":"95fc4b12-ffc3-490d-9bb1-9c124c291fa4","Type":"ContainerDied","Data":"c8dbd98d5b31e5ad117b5fe280f26a68d544c4103675b559aceacb17e2d2f474"} Oct 29 23:21:14.480120 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:14.479776 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-m7s4k" event={"ID":"95fc4b12-ffc3-490d-9bb1-9c124c291fa4","Type":"ContainerDied","Data":"f0300cfba8eee3e934de3c9bf5e301210a9ca3fa3edfb4d45e3656a0719f7c18"} Oct 29 23:21:14.480120 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:14.479796 6029 scope.go:122] "RemoveContainer" containerID="c8dbd98d5b31e5ad117b5fe280f26a68d544c4103675b559aceacb17e2d2f474" Oct 29 23:21:14.489245 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:14.489226 6029 scope.go:122] "RemoveContainer" containerID="c8dbd98d5b31e5ad117b5fe280f26a68d544c4103675b559aceacb17e2d2f474" Oct 29 23:21:14.489527 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:21:14.489506 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8dbd98d5b31e5ad117b5fe280f26a68d544c4103675b559aceacb17e2d2f474\": container with ID starting with c8dbd98d5b31e5ad117b5fe280f26a68d544c4103675b559aceacb17e2d2f474 not found: ID does not exist" containerID="c8dbd98d5b31e5ad117b5fe280f26a68d544c4103675b559aceacb17e2d2f474" Oct 29 23:21:14.489578 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:14.489538 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8dbd98d5b31e5ad117b5fe280f26a68d544c4103675b559aceacb17e2d2f474"} err="failed to get container status \"c8dbd98d5b31e5ad117b5fe280f26a68d544c4103675b559aceacb17e2d2f474\": rpc error: code = NotFound desc = could not find container \"c8dbd98d5b31e5ad117b5fe280f26a68d544c4103675b559aceacb17e2d2f474\": container with ID starting with c8dbd98d5b31e5ad117b5fe280f26a68d544c4103675b559aceacb17e2d2f474 not found: ID does not exist" Oct 29 23:21:14.537365 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:14.537325 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-m7s4k"] Oct 29 23:21:14.544130 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:14.544104 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-m7s4k"] Oct 29 23:21:15.387906 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:15.387870 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="237af21d-a2aa-44e2-a54c-35795aedc496" path="/var/lib/kubelet/pods/237af21d-a2aa-44e2-a54c-35795aedc496/volumes" Oct 29 23:21:15.388195 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:15.388177 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="95fc4b12-ffc3-490d-9bb1-9c124c291fa4" path="/var/lib/kubelet/pods/95fc4b12-ffc3-490d-9bb1-9c124c291fa4/volumes" Oct 29 23:21:20.707297 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:20.707264 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-577f596567-wqsnm"] Oct 29 23:21:20.707662 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:20.707620 6029 cpu_manager.go:414] "containerMap: removing container" podUID="95fc4b12-ffc3-490d-9bb1-9c124c291fa4" containerName="authorino" Oct 29 23:21:20.707662 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:20.707635 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="95fc4b12-ffc3-490d-9bb1-9c124c291fa4" containerName="authorino" Oct 29 23:21:20.707742 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:20.707724 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="95fc4b12-ffc3-490d-9bb1-9c124c291fa4" containerName="authorino" Oct 29 23:21:20.711583 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:20.711567 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-wqsnm" Oct 29 23:21:20.744867 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:20.744835 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-577f596567-wqsnm"] Oct 29 23:21:20.791255 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:20.791218 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Oct 29 23:21:20.805886 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:20.805853 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Oct 29 23:21:20.805886 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:20.805856 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Oct 29 23:21:20.805886 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:20.805859 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-f5jqh\"" Oct 29 23:21:20.848559 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:20.848528 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5b7b899e-5667-41fb-9ab1-9e8444133489-webhook-cert\") pod \"maas-controller-577f596567-wqsnm\" (UID: \"5b7b899e-5667-41fb-9ab1-9e8444133489\") " pod="opendatahub/maas-controller-577f596567-wqsnm" Oct 29 23:21:20.848559 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:20.848559 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b7b899e-5667-41fb-9ab1-9e8444133489-metrics-certs\") pod \"maas-controller-577f596567-wqsnm\" (UID: \"5b7b899e-5667-41fb-9ab1-9e8444133489\") " pod="opendatahub/maas-controller-577f596567-wqsnm" Oct 29 23:21:20.848710 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:20.848583 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7mtt\" (UniqueName: \"kubernetes.io/projected/5b7b899e-5667-41fb-9ab1-9e8444133489-kube-api-access-v7mtt\") pod \"maas-controller-577f596567-wqsnm\" (UID: \"5b7b899e-5667-41fb-9ab1-9e8444133489\") " pod="opendatahub/maas-controller-577f596567-wqsnm" Oct 29 23:21:20.949954 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:20.949910 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5b7b899e-5667-41fb-9ab1-9e8444133489-webhook-cert\") pod \"maas-controller-577f596567-wqsnm\" (UID: \"5b7b899e-5667-41fb-9ab1-9e8444133489\") " pod="opendatahub/maas-controller-577f596567-wqsnm" Oct 29 23:21:20.949954 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:20.949954 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b7b899e-5667-41fb-9ab1-9e8444133489-metrics-certs\") pod \"maas-controller-577f596567-wqsnm\" (UID: \"5b7b899e-5667-41fb-9ab1-9e8444133489\") " pod="opendatahub/maas-controller-577f596567-wqsnm" Oct 29 23:21:20.950211 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:20.949984 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7mtt\" (UniqueName: \"kubernetes.io/projected/5b7b899e-5667-41fb-9ab1-9e8444133489-kube-api-access-v7mtt\") pod \"maas-controller-577f596567-wqsnm\" (UID: \"5b7b899e-5667-41fb-9ab1-9e8444133489\") " pod="opendatahub/maas-controller-577f596567-wqsnm" Oct 29 23:21:20.952480 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:20.952455 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5b7b899e-5667-41fb-9ab1-9e8444133489-webhook-cert\") pod \"maas-controller-577f596567-wqsnm\" (UID: \"5b7b899e-5667-41fb-9ab1-9e8444133489\") " pod="opendatahub/maas-controller-577f596567-wqsnm" Oct 29 23:21:20.952605 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:20.952507 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b7b899e-5667-41fb-9ab1-9e8444133489-metrics-certs\") pod \"maas-controller-577f596567-wqsnm\" (UID: \"5b7b899e-5667-41fb-9ab1-9e8444133489\") " pod="opendatahub/maas-controller-577f596567-wqsnm" Oct 29 23:21:20.971275 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:20.971213 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7mtt\" (UniqueName: \"kubernetes.io/projected/5b7b899e-5667-41fb-9ab1-9e8444133489-kube-api-access-v7mtt\") pod \"maas-controller-577f596567-wqsnm\" (UID: \"5b7b899e-5667-41fb-9ab1-9e8444133489\") " pod="opendatahub/maas-controller-577f596567-wqsnm" Oct 29 23:21:21.023366 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:21.023336 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-wqsnm" Oct 29 23:21:21.092316 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:21.092280 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-765946bc59-clx6k"] Oct 29 23:21:21.097197 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:21.097174 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765946bc59-clx6k" Oct 29 23:21:21.117173 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:21.117145 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-765946bc59-clx6k"] Oct 29 23:21:21.251635 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:21.251604 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cfb2b9f-51fd-4d78-a876-323986a1e6b2-metrics-certs\") pod \"maas-controller-765946bc59-clx6k\" (UID: \"5cfb2b9f-51fd-4d78-a876-323986a1e6b2\") " pod="opendatahub/maas-controller-765946bc59-clx6k" Oct 29 23:21:21.251844 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:21.251670 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cfb2b9f-51fd-4d78-a876-323986a1e6b2-webhook-cert\") pod \"maas-controller-765946bc59-clx6k\" (UID: \"5cfb2b9f-51fd-4d78-a876-323986a1e6b2\") " pod="opendatahub/maas-controller-765946bc59-clx6k" Oct 29 23:21:21.251844 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:21.251780 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2wzc\" (UniqueName: \"kubernetes.io/projected/5cfb2b9f-51fd-4d78-a876-323986a1e6b2-kube-api-access-l2wzc\") pod \"maas-controller-765946bc59-clx6k\" (UID: \"5cfb2b9f-51fd-4d78-a876-323986a1e6b2\") " pod="opendatahub/maas-controller-765946bc59-clx6k" Oct 29 23:21:21.317455 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:21.317424 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-577f596567-wqsnm"] Oct 29 23:21:21.318117 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:21:21.318086 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b7b899e_5667_41fb_9ab1_9e8444133489.slice/crio-6604e9a0c5d19ce108585e023f069d4f3a06b0d98f9fa2d8bdd2562b97b7f6c2 WatchSource:0}: Error finding container 6604e9a0c5d19ce108585e023f069d4f3a06b0d98f9fa2d8bdd2562b97b7f6c2: Status 404 returned error can't find the container with id 6604e9a0c5d19ce108585e023f069d4f3a06b0d98f9fa2d8bdd2562b97b7f6c2 Oct 29 23:21:21.352858 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:21.352805 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cfb2b9f-51fd-4d78-a876-323986a1e6b2-webhook-cert\") pod \"maas-controller-765946bc59-clx6k\" (UID: \"5cfb2b9f-51fd-4d78-a876-323986a1e6b2\") " pod="opendatahub/maas-controller-765946bc59-clx6k" Oct 29 23:21:21.353013 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:21.352879 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2wzc\" (UniqueName: \"kubernetes.io/projected/5cfb2b9f-51fd-4d78-a876-323986a1e6b2-kube-api-access-l2wzc\") pod \"maas-controller-765946bc59-clx6k\" (UID: \"5cfb2b9f-51fd-4d78-a876-323986a1e6b2\") " pod="opendatahub/maas-controller-765946bc59-clx6k" Oct 29 23:21:21.353013 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:21.352917 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cfb2b9f-51fd-4d78-a876-323986a1e6b2-metrics-certs\") pod \"maas-controller-765946bc59-clx6k\" (UID: \"5cfb2b9f-51fd-4d78-a876-323986a1e6b2\") " pod="opendatahub/maas-controller-765946bc59-clx6k" Oct 29 23:21:21.355227 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:21.355200 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cfb2b9f-51fd-4d78-a876-323986a1e6b2-metrics-certs\") pod \"maas-controller-765946bc59-clx6k\" (UID: \"5cfb2b9f-51fd-4d78-a876-323986a1e6b2\") " pod="opendatahub/maas-controller-765946bc59-clx6k" Oct 29 23:21:21.355333 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:21.355247 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cfb2b9f-51fd-4d78-a876-323986a1e6b2-webhook-cert\") pod \"maas-controller-765946bc59-clx6k\" (UID: \"5cfb2b9f-51fd-4d78-a876-323986a1e6b2\") " pod="opendatahub/maas-controller-765946bc59-clx6k" Oct 29 23:21:21.373590 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:21.373562 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2wzc\" (UniqueName: \"kubernetes.io/projected/5cfb2b9f-51fd-4d78-a876-323986a1e6b2-kube-api-access-l2wzc\") pod \"maas-controller-765946bc59-clx6k\" (UID: \"5cfb2b9f-51fd-4d78-a876-323986a1e6b2\") " pod="opendatahub/maas-controller-765946bc59-clx6k" Oct 29 23:21:21.411147 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:21.411113 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765946bc59-clx6k" Oct 29 23:21:21.527243 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:21.527164 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-wqsnm" event={"ID":"5b7b899e-5667-41fb-9ab1-9e8444133489","Type":"ContainerStarted","Data":"6604e9a0c5d19ce108585e023f069d4f3a06b0d98f9fa2d8bdd2562b97b7f6c2"} Oct 29 23:21:21.709062 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:21.709023 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-765946bc59-clx6k"] Oct 29 23:21:21.709606 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:21:21.709572 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cfb2b9f_51fd_4d78_a876_323986a1e6b2.slice/crio-08294f30d345bde1f34d9f37208d97bcaacb0b776469f1dbff4efb0fbfff3e0e WatchSource:0}: Error finding container 08294f30d345bde1f34d9f37208d97bcaacb0b776469f1dbff4efb0fbfff3e0e: Status 404 returned error can't find the container with id 08294f30d345bde1f34d9f37208d97bcaacb0b776469f1dbff4efb0fbfff3e0e Oct 29 23:21:22.534889 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:22.534843 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765946bc59-clx6k" event={"ID":"5cfb2b9f-51fd-4d78-a876-323986a1e6b2","Type":"ContainerStarted","Data":"08294f30d345bde1f34d9f37208d97bcaacb0b776469f1dbff4efb0fbfff3e0e"} Oct 29 23:21:24.548620 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:24.548527 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-wqsnm" event={"ID":"5b7b899e-5667-41fb-9ab1-9e8444133489","Type":"ContainerStarted","Data":"e167f28e4010dc67b0a23aff49816f8ad345f14461832a827d0d7143b18e50b4"} Oct 29 23:21:24.549110 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:24.548685 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-577f596567-wqsnm" Oct 29 23:21:24.550236 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:24.550209 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765946bc59-clx6k" event={"ID":"5cfb2b9f-51fd-4d78-a876-323986a1e6b2","Type":"ContainerStarted","Data":"45d58ea08c826f832a40f1368d31f153863d92c7156afab2b5a5f339584f2d23"} Oct 29 23:21:24.550373 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:24.550272 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-765946bc59-clx6k" Oct 29 23:21:24.598526 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:24.598474 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-577f596567-wqsnm" podStartSLOduration=1.913242525 podStartE2EDuration="4.598459735s" totalImagesPullingTime="2.68521721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:21:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:21:24.596590277 +0000 UTC m=+451.322840869" watchObservedRunningTime="2026-10-29 23:21:24.598459735 +0000 UTC m=+451.324710326" Oct 29 23:21:24.642761 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:24.642710 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-765946bc59-clx6k" podStartSLOduration=1.090912016 podStartE2EDuration="3.642693702s" totalImagesPullingTime="2.551781686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:21:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:21:24.641840519 +0000 UTC m=+451.368091109" watchObservedRunningTime="2026-10-29 23:21:24.642693702 +0000 UTC m=+451.368944293" Oct 29 23:21:27.660742 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:27.660706 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-bk27h"] Oct 29 23:21:27.664570 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:27.664552 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-bk27h" Oct 29 23:21:27.684743 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:27.684714 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-bk27h"] Oct 29 23:21:27.696203 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:27.696178 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\"" Oct 29 23:21:27.696203 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:27.696178 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\"" Oct 29 23:21:27.696390 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:27.696210 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-jpxcm\"" Oct 29 23:21:27.696390 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:27.696289 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\"" Oct 29 23:21:27.816559 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:27.816521 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm2pm\" (UniqueName: \"kubernetes.io/projected/a89e0a87-6c32-487d-a28e-efa597f92c09-kube-api-access-zm2pm\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-bk27h\" (UID: \"a89e0a87-6c32-487d-a28e-efa597f92c09\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-bk27h" Oct 29 23:21:27.816782 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:27.816572 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/a89e0a87-6c32-487d-a28e-efa597f92c09-proxy-source\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-bk27h\" (UID: \"a89e0a87-6c32-487d-a28e-efa597f92c09\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-bk27h" Oct 29 23:21:27.816782 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:27.816734 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a89e0a87-6c32-487d-a28e-efa597f92c09-tls-cert\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-bk27h\" (UID: \"a89e0a87-6c32-487d-a28e-efa597f92c09\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-bk27h" Oct 29 23:21:27.816924 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:27.816850 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a89e0a87-6c32-487d-a28e-efa597f92c09-service-ca\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-bk27h\" (UID: \"a89e0a87-6c32-487d-a28e-efa597f92c09\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-bk27h" Oct 29 23:21:27.918308 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:27.918212 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/a89e0a87-6c32-487d-a28e-efa597f92c09-proxy-source\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-bk27h\" (UID: \"a89e0a87-6c32-487d-a28e-efa597f92c09\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-bk27h" Oct 29 23:21:27.918471 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:27.918311 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a89e0a87-6c32-487d-a28e-efa597f92c09-tls-cert\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-bk27h\" (UID: \"a89e0a87-6c32-487d-a28e-efa597f92c09\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-bk27h" Oct 29 23:21:27.918471 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:27.918343 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a89e0a87-6c32-487d-a28e-efa597f92c09-service-ca\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-bk27h\" (UID: \"a89e0a87-6c32-487d-a28e-efa597f92c09\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-bk27h" Oct 29 23:21:27.918471 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:27.918362 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm2pm\" (UniqueName: \"kubernetes.io/projected/a89e0a87-6c32-487d-a28e-efa597f92c09-kube-api-access-zm2pm\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-bk27h\" (UID: \"a89e0a87-6c32-487d-a28e-efa597f92c09\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-bk27h" Oct 29 23:21:27.918976 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:27.918950 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a89e0a87-6c32-487d-a28e-efa597f92c09-service-ca\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-bk27h\" (UID: \"a89e0a87-6c32-487d-a28e-efa597f92c09\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-bk27h" Oct 29 23:21:27.919098 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:27.919078 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/a89e0a87-6c32-487d-a28e-efa597f92c09-proxy-source\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-bk27h\" (UID: \"a89e0a87-6c32-487d-a28e-efa597f92c09\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-bk27h" Oct 29 23:21:27.920806 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:27.920782 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a89e0a87-6c32-487d-a28e-efa597f92c09-tls-cert\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-bk27h\" (UID: \"a89e0a87-6c32-487d-a28e-efa597f92c09\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-bk27h" Oct 29 23:21:27.939134 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:27.939107 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm2pm\" (UniqueName: \"kubernetes.io/projected/a89e0a87-6c32-487d-a28e-efa597f92c09-kube-api-access-zm2pm\") pod \"usage-logs-tenancy-proxy-7d94f55f4b-bk27h\" (UID: \"a89e0a87-6c32-487d-a28e-efa597f92c09\") " pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-bk27h" Oct 29 23:21:27.976956 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:27.976926 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-bk27h" Oct 29 23:21:28.272211 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:28.272180 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-bk27h"] Oct 29 23:21:28.273133 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:21:28.273099 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda89e0a87_6c32_487d_a28e_efa597f92c09.slice/crio-433b8fee36d639ec2c66b62d63a394dfd05e917a046eeda6d02d895cbb4c597e WatchSource:0}: Error finding container 433b8fee36d639ec2c66b62d63a394dfd05e917a046eeda6d02d895cbb4c597e: Status 404 returned error can't find the container with id 433b8fee36d639ec2c66b62d63a394dfd05e917a046eeda6d02d895cbb4c597e Oct 29 23:21:28.572027 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:28.571943 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-bk27h" event={"ID":"a89e0a87-6c32-487d-a28e-efa597f92c09","Type":"ContainerStarted","Data":"433b8fee36d639ec2c66b62d63a394dfd05e917a046eeda6d02d895cbb4c597e"} Oct 29 23:21:35.557842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:35.557736 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-577f596567-wqsnm" Oct 29 23:21:35.558307 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:35.557874 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-765946bc59-clx6k" Oct 29 23:21:35.628172 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:35.628141 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-577f596567-wqsnm"] Oct 29 23:21:35.628389 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:35.628341 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-577f596567-wqsnm" podUID="5b7b899e-5667-41fb-9ab1-9e8444133489" containerName="manager" containerID="cri-o://e167f28e4010dc67b0a23aff49816f8ad345f14461832a827d0d7143b18e50b4" gracePeriod=30 Oct 29 23:21:35.897324 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:35.897299 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-wqsnm" Oct 29 23:21:35.998484 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:35.998448 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5b7b899e-5667-41fb-9ab1-9e8444133489-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b7b899e-5667-41fb-9ab1-9e8444133489-metrics-certs\") pod \"5b7b899e-5667-41fb-9ab1-9e8444133489\" (UID: \"5b7b899e-5667-41fb-9ab1-9e8444133489\") " Oct 29 23:21:35.998667 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:35.998565 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5b7b899e-5667-41fb-9ab1-9e8444133489-kube-api-access-v7mtt\" (UniqueName: \"kubernetes.io/projected/5b7b899e-5667-41fb-9ab1-9e8444133489-kube-api-access-v7mtt\") pod \"5b7b899e-5667-41fb-9ab1-9e8444133489\" (UID: \"5b7b899e-5667-41fb-9ab1-9e8444133489\") " Oct 29 23:21:35.998667 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:35.998623 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5b7b899e-5667-41fb-9ab1-9e8444133489-webhook-cert\" (UniqueName: \"kubernetes.io/secret/5b7b899e-5667-41fb-9ab1-9e8444133489-webhook-cert\") pod \"5b7b899e-5667-41fb-9ab1-9e8444133489\" (UID: \"5b7b899e-5667-41fb-9ab1-9e8444133489\") " Oct 29 23:21:36.001236 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:36.001201 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b7b899e-5667-41fb-9ab1-9e8444133489-kube-api-access-v7mtt" pod "5b7b899e-5667-41fb-9ab1-9e8444133489" (UID: "5b7b899e-5667-41fb-9ab1-9e8444133489"). InnerVolumeSpecName "kube-api-access-v7mtt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:21:36.001487 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:36.001465 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b7b899e-5667-41fb-9ab1-9e8444133489-metrics-certs" pod "5b7b899e-5667-41fb-9ab1-9e8444133489" (UID: "5b7b899e-5667-41fb-9ab1-9e8444133489"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:21:36.001620 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:36.001583 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b7b899e-5667-41fb-9ab1-9e8444133489-webhook-cert" pod "5b7b899e-5667-41fb-9ab1-9e8444133489" (UID: "5b7b899e-5667-41fb-9ab1-9e8444133489"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:21:36.099786 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:36.099704 6029 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5b7b899e-5667-41fb-9ab1-9e8444133489-webhook-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:21:36.099786 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:36.099739 6029 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b7b899e-5667-41fb-9ab1-9e8444133489-metrics-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:21:36.099786 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:36.099749 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7mtt\" (UniqueName: \"kubernetes.io/projected/5b7b899e-5667-41fb-9ab1-9e8444133489-kube-api-access-v7mtt\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:21:36.623784 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:36.623745 6029 generic.go:356] "Generic (PLEG): container finished" podID="5b7b899e-5667-41fb-9ab1-9e8444133489" containerID="e167f28e4010dc67b0a23aff49816f8ad345f14461832a827d0d7143b18e50b4" exitCode=0 Oct 29 23:21:36.624233 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:36.623808 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-wqsnm" Oct 29 23:21:36.624233 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:36.623835 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-wqsnm" event={"ID":"5b7b899e-5667-41fb-9ab1-9e8444133489","Type":"ContainerDied","Data":"e167f28e4010dc67b0a23aff49816f8ad345f14461832a827d0d7143b18e50b4"} Oct 29 23:21:36.624233 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:36.623925 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-wqsnm" event={"ID":"5b7b899e-5667-41fb-9ab1-9e8444133489","Type":"ContainerDied","Data":"6604e9a0c5d19ce108585e023f069d4f3a06b0d98f9fa2d8bdd2562b97b7f6c2"} Oct 29 23:21:36.624233 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:36.623955 6029 scope.go:122] "RemoveContainer" containerID="e167f28e4010dc67b0a23aff49816f8ad345f14461832a827d0d7143b18e50b4" Oct 29 23:21:36.635314 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:36.635099 6029 scope.go:122] "RemoveContainer" containerID="e167f28e4010dc67b0a23aff49816f8ad345f14461832a827d0d7143b18e50b4" Oct 29 23:21:36.635408 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:21:36.635386 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e167f28e4010dc67b0a23aff49816f8ad345f14461832a827d0d7143b18e50b4\": container with ID starting with e167f28e4010dc67b0a23aff49816f8ad345f14461832a827d0d7143b18e50b4 not found: ID does not exist" containerID="e167f28e4010dc67b0a23aff49816f8ad345f14461832a827d0d7143b18e50b4" Oct 29 23:21:36.635474 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:36.635419 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e167f28e4010dc67b0a23aff49816f8ad345f14461832a827d0d7143b18e50b4"} err="failed to get container status \"e167f28e4010dc67b0a23aff49816f8ad345f14461832a827d0d7143b18e50b4\": rpc error: code = NotFound desc = could not find container \"e167f28e4010dc67b0a23aff49816f8ad345f14461832a827d0d7143b18e50b4\": container with ID starting with e167f28e4010dc67b0a23aff49816f8ad345f14461832a827d0d7143b18e50b4 not found: ID does not exist" Oct 29 23:21:36.680919 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:36.680886 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-577f596567-wqsnm"] Oct 29 23:21:36.693972 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:36.693940 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-577f596567-wqsnm"] Oct 29 23:21:37.389511 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:37.389471 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5b7b899e-5667-41fb-9ab1-9e8444133489" path="/var/lib/kubelet/pods/5b7b899e-5667-41fb-9ab1-9e8444133489/volumes" Oct 29 23:21:38.637639 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:38.637603 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-bk27h" event={"ID":"a89e0a87-6c32-487d-a28e-efa597f92c09","Type":"ContainerStarted","Data":"195031ff345c8ccc681a9148e208a92d4fbbb5e2cc063871a3faef2b72573ac6"} Oct 29 23:21:38.638014 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:38.637692 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-bk27h" Oct 29 23:21:38.680849 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:38.680786 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-bk27h" podStartSLOduration=1.770999972 podStartE2EDuration="11.680769653s" totalImagesPullingTime="9.909769681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:21:38.680571628 +0000 UTC m=+465.406822218" watchObservedRunningTime="2026-10-29 23:21:38.680769653 +0000 UTC m=+465.407020245" Oct 29 23:21:38.920727 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:21:38.920644 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:21:49.648362 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:49.648331 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-7d94f55f4b-bk27h" Oct 29 23:21:58.814922 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:58.814890 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4"] Oct 29 23:21:58.815311 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:58.815293 6029 cpu_manager.go:414] "containerMap: removing container" podUID="5b7b899e-5667-41fb-9ab1-9e8444133489" containerName="manager" Oct 29 23:21:58.815311 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:58.815304 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5b7b899e-5667-41fb-9ab1-9e8444133489" containerName="manager" Oct 29 23:21:58.815387 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:58.815357 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="5b7b899e-5667-41fb-9ab1-9e8444133489" containerName="manager" Oct 29 23:21:58.870391 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:58.870355 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4"] Oct 29 23:21:58.870585 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:58.870490 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" Oct 29 23:21:58.900206 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:58.900179 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Oct 29 23:21:58.900206 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:58.900187 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kxtx2\"" Oct 29 23:21:58.900391 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:58.900225 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Oct 29 23:21:58.999585 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:58.999516 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ab51783-0a1c-48ef-97b1-335e83373f75-maas-api-tls\") pod \"maas-api-5c48877c75-sdfq4\" (UID: \"9ab51783-0a1c-48ef-97b1-335e83373f75\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" Oct 29 23:21:58.999753 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:58.999619 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ab51783-0a1c-48ef-97b1-335e83373f75-openshift-service-ca\") pod \"maas-api-5c48877c75-sdfq4\" (UID: \"9ab51783-0a1c-48ef-97b1-335e83373f75\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" Oct 29 23:21:58.999753 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:58.999659 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ab51783-0a1c-48ef-97b1-335e83373f75-metrics-certs\") pod \"maas-api-5c48877c75-sdfq4\" (UID: \"9ab51783-0a1c-48ef-97b1-335e83373f75\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" Oct 29 23:21:58.999753 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:58.999690 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp49j\" (UniqueName: \"kubernetes.io/projected/9ab51783-0a1c-48ef-97b1-335e83373f75-kube-api-access-zp49j\") pod \"maas-api-5c48877c75-sdfq4\" (UID: \"9ab51783-0a1c-48ef-97b1-335e83373f75\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" Oct 29 23:21:59.100994 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:59.100908 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ab51783-0a1c-48ef-97b1-335e83373f75-openshift-service-ca\") pod \"maas-api-5c48877c75-sdfq4\" (UID: \"9ab51783-0a1c-48ef-97b1-335e83373f75\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" Oct 29 23:21:59.100994 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:59.100970 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ab51783-0a1c-48ef-97b1-335e83373f75-metrics-certs\") pod \"maas-api-5c48877c75-sdfq4\" (UID: \"9ab51783-0a1c-48ef-97b1-335e83373f75\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" Oct 29 23:21:59.101172 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:59.101001 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp49j\" (UniqueName: \"kubernetes.io/projected/9ab51783-0a1c-48ef-97b1-335e83373f75-kube-api-access-zp49j\") pod \"maas-api-5c48877c75-sdfq4\" (UID: \"9ab51783-0a1c-48ef-97b1-335e83373f75\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" Oct 29 23:21:59.101172 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:59.101045 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ab51783-0a1c-48ef-97b1-335e83373f75-maas-api-tls\") pod \"maas-api-5c48877c75-sdfq4\" (UID: \"9ab51783-0a1c-48ef-97b1-335e83373f75\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" Oct 29 23:21:59.101698 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:59.101665 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ab51783-0a1c-48ef-97b1-335e83373f75-openshift-service-ca\") pod \"maas-api-5c48877c75-sdfq4\" (UID: \"9ab51783-0a1c-48ef-97b1-335e83373f75\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" Oct 29 23:21:59.103575 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:59.103554 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ab51783-0a1c-48ef-97b1-335e83373f75-metrics-certs\") pod \"maas-api-5c48877c75-sdfq4\" (UID: \"9ab51783-0a1c-48ef-97b1-335e83373f75\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" Oct 29 23:21:59.103709 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:59.103598 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ab51783-0a1c-48ef-97b1-335e83373f75-maas-api-tls\") pod \"maas-api-5c48877c75-sdfq4\" (UID: \"9ab51783-0a1c-48ef-97b1-335e83373f75\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" Oct 29 23:21:59.122001 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:59.121974 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp49j\" (UniqueName: \"kubernetes.io/projected/9ab51783-0a1c-48ef-97b1-335e83373f75-kube-api-access-zp49j\") pod \"maas-api-5c48877c75-sdfq4\" (UID: \"9ab51783-0a1c-48ef-97b1-335e83373f75\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" Oct 29 23:21:59.183894 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:59.183855 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" Oct 29 23:21:59.479418 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:59.479394 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4"] Oct 29 23:21:59.480589 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:21:59.480564 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab51783_0a1c_48ef_97b1_335e83373f75.slice/crio-9cc1eec10ead914aa4ee87fc9adf6f1ca43b5e7c41587e7d24201b79c075d3af WatchSource:0}: Error finding container 9cc1eec10ead914aa4ee87fc9adf6f1ca43b5e7c41587e7d24201b79c075d3af: Status 404 returned error can't find the container with id 9cc1eec10ead914aa4ee87fc9adf6f1ca43b5e7c41587e7d24201b79c075d3af Oct 29 23:21:59.740043 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:21:59.739955 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" event={"ID":"9ab51783-0a1c-48ef-97b1-335e83373f75","Type":"ContainerStarted","Data":"9cc1eec10ead914aa4ee87fc9adf6f1ca43b5e7c41587e7d24201b79c075d3af"} Oct 29 23:22:01.754611 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:22:01.754575 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" event={"ID":"9ab51783-0a1c-48ef-97b1-335e83373f75","Type":"ContainerStarted","Data":"720ea62ab5cb55c9ba6498910b9bbe71d466af69c9153154bef4abd581ffb5a6"} Oct 29 23:22:01.755129 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:22:01.754684 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" Oct 29 23:22:01.800640 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:22:01.800583 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" podStartSLOduration=2.28636769 podStartE2EDuration="3.800567706s" totalImagesPullingTime="1.514200016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:01.799169548 +0000 UTC m=+488.525420142" watchObservedRunningTime="2026-10-29 23:22:01.800567706 +0000 UTC m=+488.526818345" Oct 29 23:22:07.764535 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:22:07.764508 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" Oct 29 23:22:08.920982 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:22:08.920944 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:22:38.921216 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:22:38.921177 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:23:00.017002 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.016962 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6"] Oct 29 23:23:00.021024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.021002 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:00.053190 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.053162 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Oct 29 23:23:00.053190 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.053159 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-p4krx\"" Oct 29 23:23:00.053396 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.053188 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Oct 29 23:23:00.053396 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.053333 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Oct 29 23:23:00.055176 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.055157 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6"] Oct 29 23:23:00.148675 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.148641 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84d55858-cdd3-4272-856b-d487fc5a815c-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-5hwq6\" (UID: \"84d55858-cdd3-4272-856b-d487fc5a815c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:00.148906 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.148679 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84d55858-cdd3-4272-856b-d487fc5a815c-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-5hwq6\" (UID: \"84d55858-cdd3-4272-856b-d487fc5a815c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:00.148906 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.148772 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84d55858-cdd3-4272-856b-d487fc5a815c-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-5hwq6\" (UID: \"84d55858-cdd3-4272-856b-d487fc5a815c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:00.148906 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.148805 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84d55858-cdd3-4272-856b-d487fc5a815c-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-5hwq6\" (UID: \"84d55858-cdd3-4272-856b-d487fc5a815c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:00.148906 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.148861 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84d55858-cdd3-4272-856b-d487fc5a815c-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-5hwq6\" (UID: \"84d55858-cdd3-4272-856b-d487fc5a815c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:00.149122 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.149029 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6lww\" (UniqueName: \"kubernetes.io/projected/84d55858-cdd3-4272-856b-d487fc5a815c-kube-api-access-f6lww\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-5hwq6\" (UID: \"84d55858-cdd3-4272-856b-d487fc5a815c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:00.249979 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.249930 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84d55858-cdd3-4272-856b-d487fc5a815c-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-5hwq6\" (UID: \"84d55858-cdd3-4272-856b-d487fc5a815c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:00.250169 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.250023 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6lww\" (UniqueName: \"kubernetes.io/projected/84d55858-cdd3-4272-856b-d487fc5a815c-kube-api-access-f6lww\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-5hwq6\" (UID: \"84d55858-cdd3-4272-856b-d487fc5a815c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:00.250169 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.250088 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84d55858-cdd3-4272-856b-d487fc5a815c-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-5hwq6\" (UID: \"84d55858-cdd3-4272-856b-d487fc5a815c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:00.250169 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.250112 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84d55858-cdd3-4272-856b-d487fc5a815c-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-5hwq6\" (UID: \"84d55858-cdd3-4272-856b-d487fc5a815c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:00.250169 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.250153 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84d55858-cdd3-4272-856b-d487fc5a815c-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-5hwq6\" (UID: \"84d55858-cdd3-4272-856b-d487fc5a815c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:00.250382 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.250183 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84d55858-cdd3-4272-856b-d487fc5a815c-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-5hwq6\" (UID: \"84d55858-cdd3-4272-856b-d487fc5a815c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:00.250499 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.250475 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84d55858-cdd3-4272-856b-d487fc5a815c-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-5hwq6\" (UID: \"84d55858-cdd3-4272-856b-d487fc5a815c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:00.250583 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.250535 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84d55858-cdd3-4272-856b-d487fc5a815c-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-5hwq6\" (UID: \"84d55858-cdd3-4272-856b-d487fc5a815c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:00.250641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.250587 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84d55858-cdd3-4272-856b-d487fc5a815c-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-5hwq6\" (UID: \"84d55858-cdd3-4272-856b-d487fc5a815c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:00.252471 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.252449 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84d55858-cdd3-4272-856b-d487fc5a815c-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-5hwq6\" (UID: \"84d55858-cdd3-4272-856b-d487fc5a815c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:00.252737 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.252715 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84d55858-cdd3-4272-856b-d487fc5a815c-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-5hwq6\" (UID: \"84d55858-cdd3-4272-856b-d487fc5a815c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:00.271055 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.270991 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6lww\" (UniqueName: \"kubernetes.io/projected/84d55858-cdd3-4272-856b-d487fc5a815c-kube-api-access-f6lww\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-5hwq6\" (UID: \"84d55858-cdd3-4272-856b-d487fc5a815c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:00.334014 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.333972 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:00.628190 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:00.628156 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6"] Oct 29 23:23:00.629265 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:23:00.629243 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84d55858_cdd3_4272_856b_d487fc5a815c.slice/crio-e40cff45718f2b23b19c363d83770fe25861c6d3f359c478e59596708cebe92d WatchSource:0}: Error finding container e40cff45718f2b23b19c363d83770fe25861c6d3f359c478e59596708cebe92d: Status 404 returned error can't find the container with id e40cff45718f2b23b19c363d83770fe25861c6d3f359c478e59596708cebe92d Oct 29 23:23:01.047087 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:01.047047 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" event={"ID":"84d55858-cdd3-4272-856b-d487fc5a815c","Type":"ContainerStarted","Data":"e40cff45718f2b23b19c363d83770fe25861c6d3f359c478e59596708cebe92d"} Oct 29 23:23:01.917327 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:01.917290 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72"] Oct 29 23:23:01.923129 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:01.923100 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:01.940675 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:01.940646 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72"] Oct 29 23:23:01.952474 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:01.952438 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Oct 29 23:23:02.054111 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:02.054013 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" event={"ID":"84d55858-cdd3-4272-856b-d487fc5a815c","Type":"ContainerStarted","Data":"82e4b24df55b61c16ea0b3227e5abcf2fdd393b4b4a32066f46331e34256892d"} Oct 29 23:23:02.067807 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:02.067774 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a21a2cb5-2aac-4e11-9405-7d42222f4d1e-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-h5w72\" (UID: \"a21a2cb5-2aac-4e11-9405-7d42222f4d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:02.068005 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:02.067845 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a21a2cb5-2aac-4e11-9405-7d42222f4d1e-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-h5w72\" (UID: \"a21a2cb5-2aac-4e11-9405-7d42222f4d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:02.068005 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:02.067930 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a21a2cb5-2aac-4e11-9405-7d42222f4d1e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-h5w72\" (UID: \"a21a2cb5-2aac-4e11-9405-7d42222f4d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:02.068150 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:02.068095 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a21a2cb5-2aac-4e11-9405-7d42222f4d1e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-h5w72\" (UID: \"a21a2cb5-2aac-4e11-9405-7d42222f4d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:02.068227 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:02.068185 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a21a2cb5-2aac-4e11-9405-7d42222f4d1e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-h5w72\" (UID: \"a21a2cb5-2aac-4e11-9405-7d42222f4d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:02.068227 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:02.068218 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flhk9\" (UniqueName: \"kubernetes.io/projected/a21a2cb5-2aac-4e11-9405-7d42222f4d1e-kube-api-access-flhk9\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-h5w72\" (UID: \"a21a2cb5-2aac-4e11-9405-7d42222f4d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:02.100537 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:02.100464 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" podStartSLOduration=1.925293454 podStartE2EDuration="3.100442601s" totalImagesPullingTime="1.175149147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:02.098329283 +0000 UTC m=+548.824579884" watchObservedRunningTime="2026-10-29 23:23:02.100442601 +0000 UTC m=+548.826693196" Oct 29 23:23:02.169757 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:02.169716 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a21a2cb5-2aac-4e11-9405-7d42222f4d1e-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-h5w72\" (UID: \"a21a2cb5-2aac-4e11-9405-7d42222f4d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:02.169946 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:02.169790 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a21a2cb5-2aac-4e11-9405-7d42222f4d1e-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-h5w72\" (UID: \"a21a2cb5-2aac-4e11-9405-7d42222f4d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:02.169946 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:02.169880 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a21a2cb5-2aac-4e11-9405-7d42222f4d1e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-h5w72\" (UID: \"a21a2cb5-2aac-4e11-9405-7d42222f4d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:02.169946 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:02.169936 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a21a2cb5-2aac-4e11-9405-7d42222f4d1e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-h5w72\" (UID: \"a21a2cb5-2aac-4e11-9405-7d42222f4d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:02.170106 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:02.170014 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a21a2cb5-2aac-4e11-9405-7d42222f4d1e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-h5w72\" (UID: \"a21a2cb5-2aac-4e11-9405-7d42222f4d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:02.170106 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:02.170039 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flhk9\" (UniqueName: \"kubernetes.io/projected/a21a2cb5-2aac-4e11-9405-7d42222f4d1e-kube-api-access-flhk9\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-h5w72\" (UID: \"a21a2cb5-2aac-4e11-9405-7d42222f4d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:02.170309 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:02.170281 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a21a2cb5-2aac-4e11-9405-7d42222f4d1e-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-h5w72\" (UID: \"a21a2cb5-2aac-4e11-9405-7d42222f4d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:02.170578 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:02.170549 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a21a2cb5-2aac-4e11-9405-7d42222f4d1e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-h5w72\" (UID: \"a21a2cb5-2aac-4e11-9405-7d42222f4d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:02.170702 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:02.170625 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a21a2cb5-2aac-4e11-9405-7d42222f4d1e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-h5w72\" (UID: \"a21a2cb5-2aac-4e11-9405-7d42222f4d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:02.172239 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:02.172215 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a21a2cb5-2aac-4e11-9405-7d42222f4d1e-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-h5w72\" (UID: \"a21a2cb5-2aac-4e11-9405-7d42222f4d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:02.172553 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:02.172536 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a21a2cb5-2aac-4e11-9405-7d42222f4d1e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-h5w72\" (UID: \"a21a2cb5-2aac-4e11-9405-7d42222f4d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:02.193008 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:02.192965 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flhk9\" (UniqueName: \"kubernetes.io/projected/a21a2cb5-2aac-4e11-9405-7d42222f4d1e-kube-api-access-flhk9\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-h5w72\" (UID: \"a21a2cb5-2aac-4e11-9405-7d42222f4d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:02.238681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:02.238643 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:02.334292 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:02.334206 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:02.537318 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:02.537288 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72"] Oct 29 23:23:02.538194 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:23:02.538168 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda21a2cb5_2aac_4e11_9405_7d42222f4d1e.slice/crio-4c31c1c22aefed874c33c14b9a1929eeb85920a76399591f888ed132dfd8d401 WatchSource:0}: Error finding container 4c31c1c22aefed874c33c14b9a1929eeb85920a76399591f888ed132dfd8d401: Status 404 returned error can't find the container with id 4c31c1c22aefed874c33c14b9a1929eeb85920a76399591f888ed132dfd8d401 Oct 29 23:23:03.063706 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:03.063660 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" event={"ID":"a21a2cb5-2aac-4e11-9405-7d42222f4d1e","Type":"ContainerStarted","Data":"c4c265b319099a1fc06275a8f5a5e5f46f5abecea5f15ffb080906211d760ed8"} Oct 29 23:23:03.064208 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:03.063736 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" event={"ID":"a21a2cb5-2aac-4e11-9405-7d42222f4d1e","Type":"ContainerStarted","Data":"4c31c1c22aefed874c33c14b9a1929eeb85920a76399591f888ed132dfd8d401"} Oct 29 23:23:03.107947 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:03.107878 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" podStartSLOduration=1.9208882200000001 podStartE2EDuration="2.107855365s" totalImagesPullingTime="186.967145ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:03.106010593 +0000 UTC m=+549.832261203" watchObservedRunningTime="2026-10-29 23:23:03.107855365 +0000 UTC m=+549.834105975" Oct 29 23:23:03.239326 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:03.239296 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:05.806346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:05.806262 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx"] Oct 29 23:23:05.809990 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:05.809966 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:05.845780 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:05.845745 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Oct 29 23:23:05.861128 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:05.861096 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx"] Oct 29 23:23:05.907629 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:05.907594 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e20961c-72a4-4050-a8d2-69e02be47432-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx\" (UID: \"6e20961c-72a4-4050-a8d2-69e02be47432\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:05.907859 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:05.907648 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e20961c-72a4-4050-a8d2-69e02be47432-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx\" (UID: \"6e20961c-72a4-4050-a8d2-69e02be47432\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:05.907859 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:05.907762 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e20961c-72a4-4050-a8d2-69e02be47432-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx\" (UID: \"6e20961c-72a4-4050-a8d2-69e02be47432\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:05.907859 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:05.907833 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e20961c-72a4-4050-a8d2-69e02be47432-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx\" (UID: \"6e20961c-72a4-4050-a8d2-69e02be47432\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:05.908020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:05.907905 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dvlp\" (UniqueName: \"kubernetes.io/projected/6e20961c-72a4-4050-a8d2-69e02be47432-kube-api-access-7dvlp\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx\" (UID: \"6e20961c-72a4-4050-a8d2-69e02be47432\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:05.908020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:05.907955 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e20961c-72a4-4050-a8d2-69e02be47432-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx\" (UID: \"6e20961c-72a4-4050-a8d2-69e02be47432\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:06.017844 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:06.016306 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e20961c-72a4-4050-a8d2-69e02be47432-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx\" (UID: \"6e20961c-72a4-4050-a8d2-69e02be47432\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:06.017844 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:06.016387 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e20961c-72a4-4050-a8d2-69e02be47432-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx\" (UID: \"6e20961c-72a4-4050-a8d2-69e02be47432\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:06.017844 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:06.016441 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e20961c-72a4-4050-a8d2-69e02be47432-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx\" (UID: \"6e20961c-72a4-4050-a8d2-69e02be47432\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:06.017844 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:06.016497 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e20961c-72a4-4050-a8d2-69e02be47432-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx\" (UID: \"6e20961c-72a4-4050-a8d2-69e02be47432\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:06.018901 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:06.018865 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e20961c-72a4-4050-a8d2-69e02be47432-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx\" (UID: \"6e20961c-72a4-4050-a8d2-69e02be47432\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:06.019112 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:06.019093 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dvlp\" (UniqueName: \"kubernetes.io/projected/6e20961c-72a4-4050-a8d2-69e02be47432-kube-api-access-7dvlp\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx\" (UID: \"6e20961c-72a4-4050-a8d2-69e02be47432\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:06.019878 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:06.019855 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e20961c-72a4-4050-a8d2-69e02be47432-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx\" (UID: \"6e20961c-72a4-4050-a8d2-69e02be47432\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:06.020160 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:06.020132 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e20961c-72a4-4050-a8d2-69e02be47432-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx\" (UID: \"6e20961c-72a4-4050-a8d2-69e02be47432\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:06.020609 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:06.020527 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e20961c-72a4-4050-a8d2-69e02be47432-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx\" (UID: \"6e20961c-72a4-4050-a8d2-69e02be47432\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:06.024378 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:06.024357 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e20961c-72a4-4050-a8d2-69e02be47432-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx\" (UID: \"6e20961c-72a4-4050-a8d2-69e02be47432\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:06.032171 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:06.030097 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e20961c-72a4-4050-a8d2-69e02be47432-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx\" (UID: \"6e20961c-72a4-4050-a8d2-69e02be47432\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:06.043729 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:06.043693 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dvlp\" (UniqueName: \"kubernetes.io/projected/6e20961c-72a4-4050-a8d2-69e02be47432-kube-api-access-7dvlp\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx\" (UID: \"6e20961c-72a4-4050-a8d2-69e02be47432\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:06.124982 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:06.124895 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:06.426754 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:06.426729 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx"] Oct 29 23:23:06.429252 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:23:06.429224 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e20961c_72a4_4050_a8d2_69e02be47432.slice/crio-979e2bff6e0b8bea6a65e760a1dc67676f996af2f09b2ad53086f283cfc90555 WatchSource:0}: Error finding container 979e2bff6e0b8bea6a65e760a1dc67676f996af2f09b2ad53086f283cfc90555: Status 404 returned error can't find the container with id 979e2bff6e0b8bea6a65e760a1dc67676f996af2f09b2ad53086f283cfc90555 Oct 29 23:23:07.087275 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:07.087240 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" event={"ID":"6e20961c-72a4-4050-a8d2-69e02be47432","Type":"ContainerStarted","Data":"b199d449b0574dc111b8974c23ae54836235dc372f0a6bef95beb578dc885877"} Oct 29 23:23:07.087710 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:07.087293 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" event={"ID":"6e20961c-72a4-4050-a8d2-69e02be47432","Type":"ContainerStarted","Data":"979e2bff6e0b8bea6a65e760a1dc67676f996af2f09b2ad53086f283cfc90555"} Oct 29 23:23:07.125902 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:07.125862 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:07.130181 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:07.130139 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" podStartSLOduration=1.938770557 podStartE2EDuration="2.130126642s" totalImagesPullingTime="191.356085ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:07.128853149 +0000 UTC m=+553.855103742" watchObservedRunningTime="2026-10-29 23:23:07.130126642 +0000 UTC m=+553.856377284" Oct 29 23:23:08.923124 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:23:08.923022 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:23:09.962891 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:09.962851 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc"] Oct 29 23:23:09.966395 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:09.966372 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:10.002068 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.002019 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Oct 29 23:23:10.004206 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.004174 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc"] Oct 29 23:23:10.058902 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.058865 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a0196c9-4399-4c90-98cd-fd8068e05436-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc\" (UID: \"6a0196c9-4399-4c90-98cd-fd8068e05436\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:10.059092 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.058937 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a0196c9-4399-4c90-98cd-fd8068e05436-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc\" (UID: \"6a0196c9-4399-4c90-98cd-fd8068e05436\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:10.059092 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.058998 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npxhr\" (UniqueName: \"kubernetes.io/projected/6a0196c9-4399-4c90-98cd-fd8068e05436-kube-api-access-npxhr\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc\" (UID: \"6a0196c9-4399-4c90-98cd-fd8068e05436\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:10.059173 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.059092 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a0196c9-4399-4c90-98cd-fd8068e05436-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc\" (UID: \"6a0196c9-4399-4c90-98cd-fd8068e05436\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:10.059173 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.059137 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a0196c9-4399-4c90-98cd-fd8068e05436-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc\" (UID: \"6a0196c9-4399-4c90-98cd-fd8068e05436\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:10.059242 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.059173 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0196c9-4399-4c90-98cd-fd8068e05436-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc\" (UID: \"6a0196c9-4399-4c90-98cd-fd8068e05436\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:10.160479 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.160442 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a0196c9-4399-4c90-98cd-fd8068e05436-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc\" (UID: \"6a0196c9-4399-4c90-98cd-fd8068e05436\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:10.160661 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.160494 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0196c9-4399-4c90-98cd-fd8068e05436-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc\" (UID: \"6a0196c9-4399-4c90-98cd-fd8068e05436\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:10.160661 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.160578 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a0196c9-4399-4c90-98cd-fd8068e05436-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc\" (UID: \"6a0196c9-4399-4c90-98cd-fd8068e05436\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:10.160661 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.160626 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a0196c9-4399-4c90-98cd-fd8068e05436-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc\" (UID: \"6a0196c9-4399-4c90-98cd-fd8068e05436\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:10.160661 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.160649 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npxhr\" (UniqueName: \"kubernetes.io/projected/6a0196c9-4399-4c90-98cd-fd8068e05436-kube-api-access-npxhr\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc\" (UID: \"6a0196c9-4399-4c90-98cd-fd8068e05436\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:10.160906 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.160681 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a0196c9-4399-4c90-98cd-fd8068e05436-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc\" (UID: \"6a0196c9-4399-4c90-98cd-fd8068e05436\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:10.160981 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.160947 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a0196c9-4399-4c90-98cd-fd8068e05436-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc\" (UID: \"6a0196c9-4399-4c90-98cd-fd8068e05436\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:10.161040 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.161014 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a0196c9-4399-4c90-98cd-fd8068e05436-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc\" (UID: \"6a0196c9-4399-4c90-98cd-fd8068e05436\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:10.161274 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.161248 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a0196c9-4399-4c90-98cd-fd8068e05436-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc\" (UID: \"6a0196c9-4399-4c90-98cd-fd8068e05436\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:10.163348 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.163323 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0196c9-4399-4c90-98cd-fd8068e05436-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc\" (UID: \"6a0196c9-4399-4c90-98cd-fd8068e05436\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:10.163788 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.163763 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a0196c9-4399-4c90-98cd-fd8068e05436-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc\" (UID: \"6a0196c9-4399-4c90-98cd-fd8068e05436\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:10.185414 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.185370 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npxhr\" (UniqueName: \"kubernetes.io/projected/6a0196c9-4399-4c90-98cd-fd8068e05436-kube-api-access-npxhr\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc\" (UID: \"6a0196c9-4399-4c90-98cd-fd8068e05436\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:10.282828 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.282775 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:10.334723 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.334679 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:10.364981 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.361640 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:10.602600 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:23:10.602566 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a0196c9_4399_4c90_98cd_fd8068e05436.slice/crio-d3d65552b87e17fd5f8fd9a18554d45ccb47bc9a160bdff1c09bb86357d1df43 WatchSource:0}: Error finding container d3d65552b87e17fd5f8fd9a18554d45ccb47bc9a160bdff1c09bb86357d1df43: Status 404 returned error can't find the container with id d3d65552b87e17fd5f8fd9a18554d45ccb47bc9a160bdff1c09bb86357d1df43 Oct 29 23:23:10.605042 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:10.605019 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc"] Oct 29 23:23:11.111179 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:11.111141 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" event={"ID":"6a0196c9-4399-4c90-98cd-fd8068e05436","Type":"ContainerStarted","Data":"e133cfae894270e4533aea3b74eae2bae53bf8531f64b9dc76d7cd75cce7eab2"} Oct 29 23:23:11.111697 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:11.111198 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" event={"ID":"6a0196c9-4399-4c90-98cd-fd8068e05436","Type":"ContainerStarted","Data":"d3d65552b87e17fd5f8fd9a18554d45ccb47bc9a160bdff1c09bb86357d1df43"} Oct 29 23:23:11.122740 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:11.122714 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-5hwq6" Oct 29 23:23:11.157117 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:11.157062 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" podStartSLOduration=1.968858716 podStartE2EDuration="2.157047597s" totalImagesPullingTime="188.188881ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:11.155007918 +0000 UTC m=+557.881258512" watchObservedRunningTime="2026-10-29 23:23:11.157047597 +0000 UTC m=+557.883298189" Oct 29 23:23:11.283460 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:11.283423 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:12.239365 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:12.239324 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:12.253573 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:12.253545 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:13.134335 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:13.134309 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-h5w72" Oct 29 23:23:16.125902 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:16.125870 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:16.142936 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:16.142908 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:16.155645 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:16.155613 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx" Oct 29 23:23:20.283973 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:20.283935 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:20.296862 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:20.296809 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:21.184504 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:21.184471 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc" Oct 29 23:23:23.865093 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:23.862058 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76c4776574-7jpnh"] Oct 29 23:23:23.870769 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:23.870741 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76c4776574-7jpnh" Oct 29 23:23:23.884405 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:23.884373 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76c4776574-7jpnh"] Oct 29 23:23:23.994470 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:23.994431 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90af7b4e-6275-411a-b500-350eb13a9fcf-tls-cert\") pod \"authorino-76c4776574-7jpnh\" (UID: \"90af7b4e-6275-411a-b500-350eb13a9fcf\") " pod="kuadrant-system/authorino-76c4776574-7jpnh" Oct 29 23:23:23.994470 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:23.994475 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5px7c\" (UniqueName: \"kubernetes.io/projected/90af7b4e-6275-411a-b500-350eb13a9fcf-kube-api-access-5px7c\") pod \"authorino-76c4776574-7jpnh\" (UID: \"90af7b4e-6275-411a-b500-350eb13a9fcf\") " pod="kuadrant-system/authorino-76c4776574-7jpnh" Oct 29 23:23:24.095180 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:24.095140 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90af7b4e-6275-411a-b500-350eb13a9fcf-tls-cert\") pod \"authorino-76c4776574-7jpnh\" (UID: \"90af7b4e-6275-411a-b500-350eb13a9fcf\") " pod="kuadrant-system/authorino-76c4776574-7jpnh" Oct 29 23:23:24.095180 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:24.095178 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5px7c\" (UniqueName: \"kubernetes.io/projected/90af7b4e-6275-411a-b500-350eb13a9fcf-kube-api-access-5px7c\") pod \"authorino-76c4776574-7jpnh\" (UID: \"90af7b4e-6275-411a-b500-350eb13a9fcf\") " pod="kuadrant-system/authorino-76c4776574-7jpnh" Oct 29 23:23:24.097661 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:24.097631 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90af7b4e-6275-411a-b500-350eb13a9fcf-tls-cert\") pod \"authorino-76c4776574-7jpnh\" (UID: \"90af7b4e-6275-411a-b500-350eb13a9fcf\") " pod="kuadrant-system/authorino-76c4776574-7jpnh" Oct 29 23:23:24.117192 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:24.117118 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5px7c\" (UniqueName: \"kubernetes.io/projected/90af7b4e-6275-411a-b500-350eb13a9fcf-kube-api-access-5px7c\") pod \"authorino-76c4776574-7jpnh\" (UID: \"90af7b4e-6275-411a-b500-350eb13a9fcf\") " pod="kuadrant-system/authorino-76c4776574-7jpnh" Oct 29 23:23:24.186169 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:24.186139 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76c4776574-7jpnh" Oct 29 23:23:24.484718 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:24.484687 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76c4776574-7jpnh"] Oct 29 23:23:24.485509 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:23:24.485480 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90af7b4e_6275_411a_b500_350eb13a9fcf.slice/crio-70552a836922c797512743698ac6d65edb5b2a71b5a548024b62255ea9864542 WatchSource:0}: Error finding container 70552a836922c797512743698ac6d65edb5b2a71b5a548024b62255ea9864542: Status 404 returned error can't find the container with id 70552a836922c797512743698ac6d65edb5b2a71b5a548024b62255ea9864542 Oct 29 23:23:25.196869 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:25.196799 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76c4776574-7jpnh" event={"ID":"90af7b4e-6275-411a-b500-350eb13a9fcf","Type":"ContainerStarted","Data":"8ce26d1428a50e87c0b9e6c25b94f44e5ce7948ea491167561092d9270a9997a"} Oct 29 23:23:25.196869 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:25.196873 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76c4776574-7jpnh" event={"ID":"90af7b4e-6275-411a-b500-350eb13a9fcf","Type":"ContainerStarted","Data":"70552a836922c797512743698ac6d65edb5b2a71b5a548024b62255ea9864542"} Oct 29 23:23:25.238292 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:25.238237 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-76c4776574-7jpnh" podStartSLOduration=1.643000539 podStartE2EDuration="2.238222645s" totalImagesPullingTime="595.222106ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:25.238027468 +0000 UTC m=+571.964278063" watchObservedRunningTime="2026-10-29 23:23:25.238222645 +0000 UTC m=+571.964473237" Oct 29 23:23:25.265707 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:25.265665 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5fb764f489-bt8lv"] Oct 29 23:23:25.265919 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:25.265893 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-5fb764f489-bt8lv" podUID="c1644939-c94a-4397-969d-c658f04984ce" containerName="authorino" containerID="cri-o://d8fca75e583d7868b6bac803f9f5c7f2798bcac0b8e94517005869c6e6fa5c5f" gracePeriod=30 Oct 29 23:23:25.525711 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:25.525679 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5fb764f489-bt8lv" Oct 29 23:23:25.609519 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:25.609480 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c1644939-c94a-4397-969d-c658f04984ce-kube-api-access-5ffw8\" (UniqueName: \"kubernetes.io/projected/c1644939-c94a-4397-969d-c658f04984ce-kube-api-access-5ffw8\") pod \"c1644939-c94a-4397-969d-c658f04984ce\" (UID: \"c1644939-c94a-4397-969d-c658f04984ce\") " Oct 29 23:23:25.609709 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:25.609595 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c1644939-c94a-4397-969d-c658f04984ce-tls-cert\" (UniqueName: \"kubernetes.io/secret/c1644939-c94a-4397-969d-c658f04984ce-tls-cert\") pod \"c1644939-c94a-4397-969d-c658f04984ce\" (UID: \"c1644939-c94a-4397-969d-c658f04984ce\") " Oct 29 23:23:25.611769 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:25.611741 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1644939-c94a-4397-969d-c658f04984ce-kube-api-access-5ffw8" pod "c1644939-c94a-4397-969d-c658f04984ce" (UID: "c1644939-c94a-4397-969d-c658f04984ce"). InnerVolumeSpecName "kube-api-access-5ffw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:23:25.621662 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:25.621621 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1644939-c94a-4397-969d-c658f04984ce-tls-cert" pod "c1644939-c94a-4397-969d-c658f04984ce" (UID: "c1644939-c94a-4397-969d-c658f04984ce"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:23:25.710502 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:25.710416 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ffw8\" (UniqueName: \"kubernetes.io/projected/c1644939-c94a-4397-969d-c658f04984ce-kube-api-access-5ffw8\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:23:25.710502 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:25.710450 6029 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c1644939-c94a-4397-969d-c658f04984ce-tls-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:23:26.206313 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:26.206276 6029 generic.go:356] "Generic (PLEG): container finished" podID="c1644939-c94a-4397-969d-c658f04984ce" containerID="d8fca75e583d7868b6bac803f9f5c7f2798bcac0b8e94517005869c6e6fa5c5f" exitCode=0 Oct 29 23:23:26.206867 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:26.206335 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5fb764f489-bt8lv" Oct 29 23:23:26.206867 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:26.206355 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5fb764f489-bt8lv" event={"ID":"c1644939-c94a-4397-969d-c658f04984ce","Type":"ContainerDied","Data":"d8fca75e583d7868b6bac803f9f5c7f2798bcac0b8e94517005869c6e6fa5c5f"} Oct 29 23:23:26.206867 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:26.206403 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5fb764f489-bt8lv" event={"ID":"c1644939-c94a-4397-969d-c658f04984ce","Type":"ContainerDied","Data":"3c4fbba7ba87583a00e91032195811b2d59047543f1d14ccdb4bb2666c2db269"} Oct 29 23:23:26.206867 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:26.206422 6029 scope.go:122] "RemoveContainer" containerID="d8fca75e583d7868b6bac803f9f5c7f2798bcac0b8e94517005869c6e6fa5c5f" Oct 29 23:23:26.218084 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:26.218062 6029 scope.go:122] "RemoveContainer" containerID="d8fca75e583d7868b6bac803f9f5c7f2798bcac0b8e94517005869c6e6fa5c5f" Oct 29 23:23:26.218372 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:23:26.218348 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8fca75e583d7868b6bac803f9f5c7f2798bcac0b8e94517005869c6e6fa5c5f\": container with ID starting with d8fca75e583d7868b6bac803f9f5c7f2798bcac0b8e94517005869c6e6fa5c5f not found: ID does not exist" containerID="d8fca75e583d7868b6bac803f9f5c7f2798bcac0b8e94517005869c6e6fa5c5f" Oct 29 23:23:26.218418 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:26.218382 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8fca75e583d7868b6bac803f9f5c7f2798bcac0b8e94517005869c6e6fa5c5f"} err="failed to get container status \"d8fca75e583d7868b6bac803f9f5c7f2798bcac0b8e94517005869c6e6fa5c5f\": rpc error: code = NotFound desc = could not find container \"d8fca75e583d7868b6bac803f9f5c7f2798bcac0b8e94517005869c6e6fa5c5f\": container with ID starting with d8fca75e583d7868b6bac803f9f5c7f2798bcac0b8e94517005869c6e6fa5c5f not found: ID does not exist" Oct 29 23:23:26.260929 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:26.260897 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5fb764f489-bt8lv"] Oct 29 23:23:26.275749 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:26.275710 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5fb764f489-bt8lv"] Oct 29 23:23:27.390028 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:27.389992 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c1644939-c94a-4397-969d-c658f04984ce" path="/var/lib/kubelet/pods/c1644939-c94a-4397-969d-c658f04984ce/volumes" Oct 29 23:23:30.004747 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.004708 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-ct2m8"] Oct 29 23:23:30.005157 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.005129 6029 cpu_manager.go:414] "containerMap: removing container" podUID="c1644939-c94a-4397-969d-c658f04984ce" containerName="authorino" Oct 29 23:23:30.005157 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.005140 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c1644939-c94a-4397-969d-c658f04984ce" containerName="authorino" Oct 29 23:23:30.005233 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.005202 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="c1644939-c94a-4397-969d-c658f04984ce" containerName="authorino" Oct 29 23:23:30.011344 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.011325 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5f78687d5b-ct2m8" Oct 29 23:23:30.037546 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.037510 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-ct2m8"] Oct 29 23:23:30.047874 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.047849 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-n7csk\"" Oct 29 23:23:30.061769 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.061732 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8mgm\" (UniqueName: \"kubernetes.io/projected/e9dc9c76-648c-4dde-8a9c-823f0722c909-kube-api-access-r8mgm\") pod \"payload-processing-5f78687d5b-ct2m8\" (UID: \"e9dc9c76-648c-4dde-8a9c-823f0722c909\") " pod="openshift-ingress/payload-processing-5f78687d5b-ct2m8" Oct 29 23:23:30.061953 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.061776 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9dc9c76-648c-4dde-8a9c-823f0722c909-plugins-config-volume\") pod \"payload-processing-5f78687d5b-ct2m8\" (UID: \"e9dc9c76-648c-4dde-8a9c-823f0722c909\") " pod="openshift-ingress/payload-processing-5f78687d5b-ct2m8" Oct 29 23:23:30.065716 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.065684 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-cs4j7"] Oct 29 23:23:30.070302 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.070283 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-cs4j7" Oct 29 23:23:30.090571 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.090539 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-cs4j7"] Oct 29 23:23:30.104949 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.104919 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Oct 29 23:23:30.104949 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.104917 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Oct 29 23:23:30.105145 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.104968 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Oct 29 23:23:30.163203 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.163167 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llxcx\" (UniqueName: \"kubernetes.io/projected/ea0ed84a-fd93-4954-b7a3-90954be9f4b6-kube-api-access-llxcx\") pod \"payload-pre-processing-7b98bb678c-cs4j7\" (UID: \"ea0ed84a-fd93-4954-b7a3-90954be9f4b6\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-cs4j7" Oct 29 23:23:30.163398 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.163210 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8mgm\" (UniqueName: \"kubernetes.io/projected/e9dc9c76-648c-4dde-8a9c-823f0722c909-kube-api-access-r8mgm\") pod \"payload-processing-5f78687d5b-ct2m8\" (UID: \"e9dc9c76-648c-4dde-8a9c-823f0722c909\") " pod="openshift-ingress/payload-processing-5f78687d5b-ct2m8" Oct 29 23:23:30.163398 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.163230 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea0ed84a-fd93-4954-b7a3-90954be9f4b6-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-cs4j7\" (UID: \"ea0ed84a-fd93-4954-b7a3-90954be9f4b6\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-cs4j7" Oct 29 23:23:30.163525 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.163396 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9dc9c76-648c-4dde-8a9c-823f0722c909-plugins-config-volume\") pod \"payload-processing-5f78687d5b-ct2m8\" (UID: \"e9dc9c76-648c-4dde-8a9c-823f0722c909\") " pod="openshift-ingress/payload-processing-5f78687d5b-ct2m8" Oct 29 23:23:30.164185 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.164167 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9dc9c76-648c-4dde-8a9c-823f0722c909-plugins-config-volume\") pod \"payload-processing-5f78687d5b-ct2m8\" (UID: \"e9dc9c76-648c-4dde-8a9c-823f0722c909\") " pod="openshift-ingress/payload-processing-5f78687d5b-ct2m8" Oct 29 23:23:30.184374 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.184345 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8mgm\" (UniqueName: \"kubernetes.io/projected/e9dc9c76-648c-4dde-8a9c-823f0722c909-kube-api-access-r8mgm\") pod \"payload-processing-5f78687d5b-ct2m8\" (UID: \"e9dc9c76-648c-4dde-8a9c-823f0722c909\") " pod="openshift-ingress/payload-processing-5f78687d5b-ct2m8" Oct 29 23:23:30.264552 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.264468 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llxcx\" (UniqueName: \"kubernetes.io/projected/ea0ed84a-fd93-4954-b7a3-90954be9f4b6-kube-api-access-llxcx\") pod \"payload-pre-processing-7b98bb678c-cs4j7\" (UID: \"ea0ed84a-fd93-4954-b7a3-90954be9f4b6\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-cs4j7" Oct 29 23:23:30.264552 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.264506 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea0ed84a-fd93-4954-b7a3-90954be9f4b6-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-cs4j7\" (UID: \"ea0ed84a-fd93-4954-b7a3-90954be9f4b6\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-cs4j7" Oct 29 23:23:30.265157 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.265138 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea0ed84a-fd93-4954-b7a3-90954be9f4b6-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-cs4j7\" (UID: \"ea0ed84a-fd93-4954-b7a3-90954be9f4b6\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-cs4j7" Oct 29 23:23:30.285382 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.285347 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llxcx\" (UniqueName: \"kubernetes.io/projected/ea0ed84a-fd93-4954-b7a3-90954be9f4b6-kube-api-access-llxcx\") pod \"payload-pre-processing-7b98bb678c-cs4j7\" (UID: \"ea0ed84a-fd93-4954-b7a3-90954be9f4b6\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-cs4j7" Oct 29 23:23:30.327006 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.326965 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5f78687d5b-ct2m8" Oct 29 23:23:30.389802 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.389511 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-cs4j7" Oct 29 23:23:30.626005 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.625974 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-ct2m8"] Oct 29 23:23:30.627868 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:23:30.627807 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9dc9c76_648c_4dde_8a9c_823f0722c909.slice/crio-c3fb8e1b0cdccddcae6ba14beb9a5dd222d8e43617f172a15bd802c833d37510 WatchSource:0}: Error finding container c3fb8e1b0cdccddcae6ba14beb9a5dd222d8e43617f172a15bd802c833d37510: Status 404 returned error can't find the container with id c3fb8e1b0cdccddcae6ba14beb9a5dd222d8e43617f172a15bd802c833d37510 Oct 29 23:23:30.699861 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:30.699838 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-cs4j7"] Oct 29 23:23:30.700333 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:23:30.700308 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea0ed84a_fd93_4954_b7a3_90954be9f4b6.slice/crio-f9965f3d959fdf5358a0f6367e94745e7369aa25fd940a16c4f1e251bfec8041 WatchSource:0}: Error finding container f9965f3d959fdf5358a0f6367e94745e7369aa25fd940a16c4f1e251bfec8041: Status 404 returned error can't find the container with id f9965f3d959fdf5358a0f6367e94745e7369aa25fd940a16c4f1e251bfec8041 Oct 29 23:23:31.248622 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:31.248521 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-cs4j7" event={"ID":"ea0ed84a-fd93-4954-b7a3-90954be9f4b6","Type":"ContainerStarted","Data":"f9965f3d959fdf5358a0f6367e94745e7369aa25fd940a16c4f1e251bfec8041"} Oct 29 23:23:31.250582 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:31.250535 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5f78687d5b-ct2m8" event={"ID":"e9dc9c76-648c-4dde-8a9c-823f0722c909","Type":"ContainerStarted","Data":"c3fb8e1b0cdccddcae6ba14beb9a5dd222d8e43617f172a15bd802c833d37510"} Oct 29 23:23:33.275661 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:33.275620 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-cs4j7" event={"ID":"ea0ed84a-fd93-4954-b7a3-90954be9f4b6","Type":"ContainerStarted","Data":"3472bf92e8f521e9d636eb601232eaa0669e2f3af2e85cc992fd563d44d4cb22"} Oct 29 23:23:33.276162 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:33.275837 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-cs4j7" Oct 29 23:23:33.277240 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:33.277217 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5f78687d5b-ct2m8" event={"ID":"e9dc9c76-648c-4dde-8a9c-823f0722c909","Type":"ContainerStarted","Data":"a2237552aff244ab6f0725820e9e39a8780f3a9bf15d628932c1eed4cf8ec00d"} Oct 29 23:23:33.277334 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:33.277278 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5f78687d5b-ct2m8" Oct 29 23:23:33.317447 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:33.317394 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7b98bb678c-cs4j7" podStartSLOduration=1.075507468 podStartE2EDuration="3.31738146s" totalImagesPullingTime="2.241873992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:33.31660038 +0000 UTC m=+580.042850973" watchObservedRunningTime="2026-10-29 23:23:33.31738146 +0000 UTC m=+580.043632052" Oct 29 23:23:33.360406 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:33.360354 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5f78687d5b-ct2m8" podStartSLOduration=2.098685779 podStartE2EDuration="4.360342131s" totalImagesPullingTime="2.261656352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:33.357996146 +0000 UTC m=+580.084246942" watchObservedRunningTime="2026-10-29 23:23:33.360342131 +0000 UTC m=+580.086592744" Oct 29 23:23:38.920848 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:23:38.920793 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:23:39.046133 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.046096 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv"] Oct 29 23:23:39.049754 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.049714 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.067874 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.067838 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Oct 29 23:23:39.081496 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.081467 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-tvvvz\"" Oct 29 23:23:39.084443 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.084411 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv"] Oct 29 23:23:39.151405 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.151362 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78822c5b-2a93-412c-8fef-e7673ce74a94-credential-socket\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.151405 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.151409 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tx2f\" (UniqueName: \"kubernetes.io/projected/78822c5b-2a93-412c-8fef-e7673ce74a94-kube-api-access-4tx2f\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.151608 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.151555 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78822c5b-2a93-412c-8fef-e7673ce74a94-workload-socket\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.151686 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.151665 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78822c5b-2a93-412c-8fef-e7673ce74a94-istio-data\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.151735 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.151721 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78822c5b-2a93-412c-8fef-e7673ce74a94-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.151796 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.151750 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78822c5b-2a93-412c-8fef-e7673ce74a94-workload-certs\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.151796 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.151787 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78822c5b-2a93-412c-8fef-e7673ce74a94-istio-token\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.151990 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.151971 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78822c5b-2a93-412c-8fef-e7673ce74a94-istio-podinfo\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.152056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.152014 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78822c5b-2a93-412c-8fef-e7673ce74a94-istio-envoy\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.252524 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.252495 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78822c5b-2a93-412c-8fef-e7673ce74a94-workload-socket\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.252717 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.252548 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78822c5b-2a93-412c-8fef-e7673ce74a94-istio-data\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.252717 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.252572 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78822c5b-2a93-412c-8fef-e7673ce74a94-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.252717 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.252591 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78822c5b-2a93-412c-8fef-e7673ce74a94-workload-certs\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.252717 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.252614 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78822c5b-2a93-412c-8fef-e7673ce74a94-istio-token\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.252717 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.252639 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78822c5b-2a93-412c-8fef-e7673ce74a94-istio-podinfo\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.253035 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.252729 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78822c5b-2a93-412c-8fef-e7673ce74a94-istio-envoy\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.253035 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.252843 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78822c5b-2a93-412c-8fef-e7673ce74a94-credential-socket\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.253035 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.252874 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tx2f\" (UniqueName: \"kubernetes.io/projected/78822c5b-2a93-412c-8fef-e7673ce74a94-kube-api-access-4tx2f\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.253035 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.252946 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78822c5b-2a93-412c-8fef-e7673ce74a94-workload-socket\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.253035 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.252997 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78822c5b-2a93-412c-8fef-e7673ce74a94-workload-certs\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.253298 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.253281 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78822c5b-2a93-412c-8fef-e7673ce74a94-istio-data\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.253459 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.253439 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78822c5b-2a93-412c-8fef-e7673ce74a94-credential-socket\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.253619 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.253605 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78822c5b-2a93-412c-8fef-e7673ce74a94-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.255032 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.255012 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78822c5b-2a93-412c-8fef-e7673ce74a94-istio-envoy\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.255352 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.255333 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78822c5b-2a93-412c-8fef-e7673ce74a94-istio-podinfo\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.273538 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.273507 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78822c5b-2a93-412c-8fef-e7673ce74a94-istio-token\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.273714 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.273689 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tx2f\" (UniqueName: \"kubernetes.io/projected/78822c5b-2a93-412c-8fef-e7673ce74a94-kube-api-access-4tx2f\") pod \"maas-default-gateway-openshift-default-746ff8f49f-zrhxv\" (UID: \"78822c5b-2a93-412c-8fef-e7673ce74a94\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.363020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.362971 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:39.677603 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:39.677574 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv"] Oct 29 23:23:39.678489 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:23:39.678459 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78822c5b_2a93_412c_8fef_e7673ce74a94.slice/crio-1dd9a53b6dd920eab23158f212b0694e2f9d4848e9b52eee237ea6d250bf019d WatchSource:0}: Error finding container 1dd9a53b6dd920eab23158f212b0694e2f9d4848e9b52eee237ea6d250bf019d: Status 404 returned error can't find the container with id 1dd9a53b6dd920eab23158f212b0694e2f9d4848e9b52eee237ea6d250bf019d Oct 29 23:23:40.314759 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:40.314719 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" event={"ID":"78822c5b-2a93-412c-8fef-e7673ce74a94","Type":"ContainerStarted","Data":"1dd9a53b6dd920eab23158f212b0694e2f9d4848e9b52eee237ea6d250bf019d"} Oct 29 23:23:42.345004 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:42.344972 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:23:42.345305 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:42.345040 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:23:42.345305 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:42.345081 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:23:43.351587 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:43.351547 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" event={"ID":"78822c5b-2a93-412c-8fef-e7673ce74a94","Type":"ContainerStarted","Data":"11fa7d33b96095b4a18c696335e550570dbb0fd29d10c56763f03ffa2deaa028"} Oct 29 23:23:43.364086 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:43.364058 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:43.365698 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:43.365670 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-zrhxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Oct 29 23:23:43.365843 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:43.365717 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" podUID="78822c5b-2a93-412c-8fef-e7673ce74a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Oct 29 23:23:43.418093 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:43.418028 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" podStartSLOduration=1.754353751 podStartE2EDuration="4.418016039s" totalImagesPullingTime="2.663662288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:43.410425569 +0000 UTC m=+590.136676162" watchObservedRunningTime="2026-10-29 23:23:43.418016039 +0000 UTC m=+590.144266631" Oct 29 23:23:44.286089 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:44.286057 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5f78687d5b-ct2m8" Oct 29 23:23:44.286293 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:44.286202 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-cs4j7" Oct 29 23:23:44.363912 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:44.363870 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-zrhxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Oct 29 23:23:44.364399 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:44.363924 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" podUID="78822c5b-2a93-412c-8fef-e7673ce74a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Oct 29 23:23:45.364030 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:45.363996 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-zrhxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Oct 29 23:23:45.364441 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:45.364064 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" podUID="78822c5b-2a93-412c-8fef-e7673ce74a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Oct 29 23:23:46.363984 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:46.363946 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-zrhxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Oct 29 23:23:46.364169 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:46.364005 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" podUID="78822c5b-2a93-412c-8fef-e7673ce74a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Oct 29 23:23:47.364002 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:47.363961 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-zrhxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Oct 29 23:23:47.364192 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:47.364025 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" podUID="78822c5b-2a93-412c-8fef-e7673ce74a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Oct 29 23:23:48.363949 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:48.363912 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-zrhxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Oct 29 23:23:48.364136 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:48.363967 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" podUID="78822c5b-2a93-412c-8fef-e7673ce74a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Oct 29 23:23:49.364258 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:49.364222 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-zrhxv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Oct 29 23:23:49.364685 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:49.364278 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" podUID="78822c5b-2a93-412c-8fef-e7673ce74a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Oct 29 23:23:50.856964 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:50.856934 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:50.857427 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:50.857309 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:50.858303 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:50.858280 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" Oct 29 23:23:54.096874 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.096836 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch"] Oct 29 23:23:54.101870 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.101842 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.120023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.119986 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.120203 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.120037 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-credential-socket\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.120203 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.120121 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-istio-token\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.120203 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.120179 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-istio-envoy\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.120418 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.120205 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-istio-data\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.120418 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.120297 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-workload-socket\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.120418 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.120322 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-workload-certs\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.120418 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.120372 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jvw8\" (UniqueName: \"kubernetes.io/projected/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-kube-api-access-2jvw8\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.120418 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.120392 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.140717 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.140673 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch"] Oct 29 23:23:54.221088 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.221051 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-istio-token\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.221088 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.221092 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-istio-envoy\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.221373 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.221114 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-istio-data\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.221373 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.221161 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-workload-socket\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.221373 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.221186 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-workload-certs\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.221373 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.221219 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jvw8\" (UniqueName: \"kubernetes.io/projected/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-kube-api-access-2jvw8\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.221373 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.221238 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.221373 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.221287 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.221373 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.221340 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-credential-socket\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.221733 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.221638 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-workload-socket\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.221733 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.221660 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-istio-data\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.221733 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.221729 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-workload-certs\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.221941 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.221884 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-credential-socket\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.222048 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.222025 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.223462 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.223440 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-istio-envoy\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.223853 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.223836 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.242715 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.242692 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-istio-token\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.242854 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.242794 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jvw8\" (UniqueName: \"kubernetes.io/projected/e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5-kube-api-access-2jvw8\") pod \"maas-default-gateway-openshift-default-746ff8f49f-wv9ch\" (UID: \"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.415124 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.415033 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:54.728279 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.728253 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch"] Oct 29 23:23:54.729103 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:23:54.729073 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64fdf06_8afe_4176_8c09_dc0bf9c9e7f5.slice/crio-94f86d014f83eaf9ef70058d0c173278233d4176257a47fcef89ec49f3a3a150 WatchSource:0}: Error finding container 94f86d014f83eaf9ef70058d0c173278233d4176257a47fcef89ec49f3a3a150: Status 404 returned error can't find the container with id 94f86d014f83eaf9ef70058d0c173278233d4176257a47fcef89ec49f3a3a150 Oct 29 23:23:54.731310 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.731278 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:23:54.731375 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.731344 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:23:54.731412 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:54.731374 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:23:55.416115 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:55.416082 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" event={"ID":"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5","Type":"ContainerStarted","Data":"448355a73dab9506c47ee20f551b23429d81a3041ba40c139e4e746504d329fb"} Oct 29 23:23:55.416513 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:55.416130 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" event={"ID":"e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5","Type":"ContainerStarted","Data":"94f86d014f83eaf9ef70058d0c173278233d4176257a47fcef89ec49f3a3a150"} Oct 29 23:23:56.415630 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:56.415586 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:23:56.417361 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:56.417330 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-wv9ch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Oct 29 23:23:56.417768 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:56.417392 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" podUID="e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Oct 29 23:23:57.415612 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:57.415579 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-wv9ch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Oct 29 23:23:57.415789 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:57.415630 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" podUID="e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Oct 29 23:23:58.416185 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:58.416149 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-wv9ch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Oct 29 23:23:58.416582 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:58.416200 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" podUID="e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Oct 29 23:23:59.416493 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:59.416458 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-wv9ch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Oct 29 23:23:59.416939 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:23:59.416514 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" podUID="e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Oct 29 23:24:00.416179 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:00.416145 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-wv9ch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Oct 29 23:24:00.416369 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:00.416203 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" podUID="e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Oct 29 23:24:01.416371 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:01.416334 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-wv9ch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Oct 29 23:24:01.416770 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:01.416401 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" podUID="e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Oct 29 23:24:03.088499 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:03.088466 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:24:03.089172 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:03.089147 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:24:03.090021 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:03.090003 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" Oct 29 23:24:03.160426 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:03.160372 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-wv9ch" podStartSLOduration=9.160359097 podStartE2EDuration="9.160359097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:55.474882754 +0000 UTC m=+602.201133374" watchObservedRunningTime="2026-10-29 23:24:03.160359097 +0000 UTC m=+609.886609691" Oct 29 23:24:08.920915 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:24:08.920878 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:24:23.652017 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.651978 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq"] Oct 29 23:24:23.669192 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.669156 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.683536 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.683501 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq"] Oct 29 23:24:23.692549 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.692517 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-032fa8-openshift-default-dockercfg-kpn7m\"" Oct 29 23:24:23.828381 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.828347 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-data\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.828545 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.828395 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-envoy\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.828545 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.828499 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-token\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.828620 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.828566 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-podinfo\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.828672 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.828652 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istiod-ca-cert\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.828708 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.828693 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t8n7\" (UniqueName: \"kubernetes.io/projected/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-kube-api-access-4t8n7\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.828742 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.828715 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-workload-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.828774 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.828753 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-credential-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.828806 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.828778 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-workload-certs\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.930058 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.929956 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-workload-certs\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.930058 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.930003 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-data\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.930058 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.930039 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-envoy\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.930058 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.930063 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-token\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.930413 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.930117 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-podinfo\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.930413 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.930159 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istiod-ca-cert\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.930413 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.930195 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t8n7\" (UniqueName: \"kubernetes.io/projected/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-kube-api-access-4t8n7\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.930413 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.930223 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-workload-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.930413 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.930253 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-credential-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.930678 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.930508 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-workload-certs\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.930678 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.930522 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-data\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.930678 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.930574 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-credential-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.930839 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.930792 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-workload-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.931004 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.930983 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istiod-ca-cert\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.932620 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.932594 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-envoy\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.932853 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.932830 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-podinfo\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.963048 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.963019 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t8n7\" (UniqueName: \"kubernetes.io/projected/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-kube-api-access-4t8n7\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.965084 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.965058 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-token\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.993344 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.993310 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:23.993737 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.993716 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l"] Oct 29 23:24:23.998539 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:23.998517 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.016355 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.016322 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-313d9c-openshift-default-dockercfg-bgdwt\"" Oct 29 23:24:24.031908 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.031870 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l"] Oct 29 23:24:24.132268 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.132228 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bafc705-c3f4-4532-a67a-77e1536256d1-istiod-ca-cert\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.132426 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.132335 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-envoy\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.132426 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.132413 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-data\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.132519 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.132469 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-workload-certs\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.132519 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.132507 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-credential-socket\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.132577 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.132568 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-podinfo\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.132610 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.132589 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tbs2\" (UniqueName: \"kubernetes.io/projected/6bafc705-c3f4-4532-a67a-77e1536256d1-kube-api-access-2tbs2\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.132683 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.132632 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-workload-socket\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.132683 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.132662 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-token\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.201000 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.200918 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs"] Oct 29 23:24:24.205692 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.205667 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.228539 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.228508 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs"] Oct 29 23:24:24.232048 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.232018 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-0b2ae9-openshift-default-dockercfg-pwcxh\"" Oct 29 23:24:24.233341 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.233321 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-envoy\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.233456 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.233351 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-data\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.233456 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.233385 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-workload-certs\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.233456 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.233432 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-credential-socket\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.233754 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.233730 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-podinfo\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.233889 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.233866 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-data\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.234006 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.233980 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-workload-certs\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.234006 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.233996 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tbs2\" (UniqueName: \"kubernetes.io/projected/6bafc705-c3f4-4532-a67a-77e1536256d1-kube-api-access-2tbs2\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.234191 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.234095 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-workload-socket\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.234191 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.234127 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-token\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.234191 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.234187 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bafc705-c3f4-4532-a67a-77e1536256d1-istiod-ca-cert\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.234729 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.234678 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-credential-socket\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.234729 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.234699 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-workload-socket\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.235534 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.235506 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bafc705-c3f4-4532-a67a-77e1536256d1-istiod-ca-cert\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.236015 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.235996 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-envoy\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.236852 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.236832 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-podinfo\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.255882 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.255853 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-token\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.256133 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.256111 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tbs2\" (UniqueName: \"kubernetes.io/projected/6bafc705-c3f4-4532-a67a-77e1536256d1-kube-api-access-2tbs2\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.315467 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.315436 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq"] Oct 29 23:24:24.316747 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:24:24.316719 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee5b3e7f_2efc_4ac7_b00e_8426ea94c250.slice/crio-b4efad55b5a327b5adea4859d08ed8689334e9888b7b1e231838efd46a1e6ee7 WatchSource:0}: Error finding container b4efad55b5a327b5adea4859d08ed8689334e9888b7b1e231838efd46a1e6ee7: Status 404 returned error can't find the container with id b4efad55b5a327b5adea4859d08ed8689334e9888b7b1e231838efd46a1e6ee7 Oct 29 23:24:24.318940 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.318905 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:24:24.319062 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.318995 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:24:24.319062 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.319044 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:24:24.326177 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.326153 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:24.337951 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.334938 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-workload-socket\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.337951 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.335033 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istiod-ca-cert\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.337951 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.335106 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-data\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.337951 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.335152 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-envoy\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.337951 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.335170 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-token\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.337951 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.335313 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-podinfo\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.337951 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.335342 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54zgh\" (UniqueName: \"kubernetes.io/projected/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-kube-api-access-54zgh\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.337951 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.335374 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-workload-certs\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.337951 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.335448 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-credential-socket\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.436708 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.436667 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-envoy\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.436916 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.436772 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-token\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.436916 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.436875 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-podinfo\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.437004 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.436915 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54zgh\" (UniqueName: \"kubernetes.io/projected/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-kube-api-access-54zgh\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.437004 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.436957 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-workload-certs\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.437469 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.437445 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-credential-socket\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.437562 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.437546 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-workload-socket\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.437597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.437585 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istiod-ca-cert\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.437689 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.437675 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-data\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.438221 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.438200 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-data\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.439106 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.439085 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-workload-certs\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.439879 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.439858 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-workload-socket\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.441071 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.441040 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-credential-socket\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.441332 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.441309 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istiod-ca-cert\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.442427 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.442403 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-envoy\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.443590 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.443568 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-podinfo\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.465968 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.465910 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-token\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.468484 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.468456 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54zgh\" (UniqueName: \"kubernetes.io/projected/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-kube-api-access-54zgh\") pod \"e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.519716 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.519677 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:24.608873 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.607784 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" event={"ID":"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250","Type":"ContainerStarted","Data":"a248c413c68c2021e35ca9ddf330661ba8035bdc14da783f0014fa3646a012ae"} Oct 29 23:24:24.608873 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.607873 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" event={"ID":"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250","Type":"ContainerStarted","Data":"b4efad55b5a327b5adea4859d08ed8689334e9888b7b1e231838efd46a1e6ee7"} Oct 29 23:24:24.661859 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.658721 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" podStartSLOduration=1.6586995340000001 podStartE2EDuration="1.658699534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:24:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:24:24.657080263 +0000 UTC m=+631.383330863" watchObservedRunningTime="2026-10-29 23:24:24.658699534 +0000 UTC m=+631.384950130" Oct 29 23:24:24.666115 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.666070 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l"] Oct 29 23:24:24.667903 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:24:24.667878 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bafc705_c3f4_4532_a67a_77e1536256d1.slice/crio-c4b404116849c4e3dcca5f058eda960ee77f16787e063cbd0446d96d5aa90efb WatchSource:0}: Error finding container c4b404116849c4e3dcca5f058eda960ee77f16787e063cbd0446d96d5aa90efb: Status 404 returned error can't find the container with id c4b404116849c4e3dcca5f058eda960ee77f16787e063cbd0446d96d5aa90efb Oct 29 23:24:24.671105 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.671069 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:24:24.671189 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.671138 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:24:24.671189 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.671167 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:24:24.838180 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.838155 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs"] Oct 29 23:24:24.839019 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:24:24.838992 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb39e7c06_e062_4b42_ae3e_eb1d72e058bb.slice/crio-f3c9a1ec5e18881535f76b27a307970aaf6dc4b1447c5a7e3b46769ecd63133a WatchSource:0}: Error finding container f3c9a1ec5e18881535f76b27a307970aaf6dc4b1447c5a7e3b46769ecd63133a: Status 404 returned error can't find the container with id f3c9a1ec5e18881535f76b27a307970aaf6dc4b1447c5a7e3b46769ecd63133a Oct 29 23:24:24.841531 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.841496 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:24:24.841605 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.841583 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:24:24.841637 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.841622 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:24:24.994267 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:24.994187 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:25.621468 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:25.621435 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" event={"ID":"6bafc705-c3f4-4532-a67a-77e1536256d1","Type":"ContainerStarted","Data":"92ffb89d10b640b4b4c2036e94572010dcb11c4021611aa07aa60c82596a3ed6"} Oct 29 23:24:25.621687 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:25.621531 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" event={"ID":"6bafc705-c3f4-4532-a67a-77e1536256d1","Type":"ContainerStarted","Data":"c4b404116849c4e3dcca5f058eda960ee77f16787e063cbd0446d96d5aa90efb"} Oct 29 23:24:25.623119 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:25.623088 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" event={"ID":"b39e7c06-e062-4b42-ae3e-eb1d72e058bb","Type":"ContainerStarted","Data":"7809944bc6f0e41ce4beb612525169038f2de93dfb46d2db09cfdcc42c4f8cab"} Oct 29 23:24:25.623262 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:25.623139 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" event={"ID":"b39e7c06-e062-4b42-ae3e-eb1d72e058bb","Type":"ContainerStarted","Data":"f3c9a1ec5e18881535f76b27a307970aaf6dc4b1447c5a7e3b46769ecd63133a"} Oct 29 23:24:25.666373 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:25.666322 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" podStartSLOduration=2.6663093509999998 podStartE2EDuration="2.666309351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:24:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:24:25.665001978 +0000 UTC m=+632.391252596" watchObservedRunningTime="2026-10-29 23:24:25.666309351 +0000 UTC m=+632.392559942" Oct 29 23:24:25.711801 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:25.711743 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" podStartSLOduration=1.711728835 podStartE2EDuration="1.711728835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:24:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:24:25.710470457 +0000 UTC m=+632.436721049" watchObservedRunningTime="2026-10-29 23:24:25.711728835 +0000 UTC m=+632.437979496" Oct 29 23:24:26.000985 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:26.000950 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:26.327340 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:26.327229 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:26.333482 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:26.333447 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:26.520346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:26.520308 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:26.525952 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:26.525924 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:26.629648 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:26.629560 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:26.630007 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:26.629985 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:26.630164 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:26.630022 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:26.630227 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:26.630218 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:26.630556 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:26.630533 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:26.630669 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:26.630584 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:29.413369 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:29.413336 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9"] Oct 29 23:24:29.417431 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:29.417408 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9" Oct 29 23:24:29.448568 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:29.448537 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-be8726\"" Oct 29 23:24:29.491576 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:29.491527 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9"] Oct 29 23:24:29.491985 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:29.491963 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzqnh\" (UniqueName: \"kubernetes.io/projected/430db6a8-1f92-4f9d-95be-369032f16c8d-kube-api-access-wzqnh\") pod \"payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9\" (UID: \"430db6a8-1f92-4f9d-95be-369032f16c8d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9" Oct 29 23:24:29.492055 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:29.492019 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/430db6a8-1f92-4f9d-95be-369032f16c8d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9\" (UID: \"430db6a8-1f92-4f9d-95be-369032f16c8d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9" Oct 29 23:24:29.493526 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:29.493505 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh"] Oct 29 23:24:29.497566 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:29.497546 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh" Oct 29 23:24:29.525888 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:29.525859 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh"] Oct 29 23:24:29.529680 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:29.529654 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-be8726-dockercfg-7bdqf\"" Oct 29 23:24:29.593243 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:29.593206 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzqnh\" (UniqueName: \"kubernetes.io/projected/430db6a8-1f92-4f9d-95be-369032f16c8d-kube-api-access-wzqnh\") pod \"payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9\" (UID: \"430db6a8-1f92-4f9d-95be-369032f16c8d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9" Oct 29 23:24:29.593433 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:29.593291 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/430db6a8-1f92-4f9d-95be-369032f16c8d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9\" (UID: \"430db6a8-1f92-4f9d-95be-369032f16c8d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9" Oct 29 23:24:29.593433 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:29.593356 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hl9w\" (UniqueName: \"kubernetes.io/projected/b58f9001-4e4a-4959-8d80-53b37221fd59-kube-api-access-2hl9w\") pod \"payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh\" (UID: \"b58f9001-4e4a-4959-8d80-53b37221fd59\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh" Oct 29 23:24:29.593433 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:29.593405 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b58f9001-4e4a-4959-8d80-53b37221fd59-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh\" (UID: \"b58f9001-4e4a-4959-8d80-53b37221fd59\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh" Oct 29 23:24:29.594092 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:29.594062 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/430db6a8-1f92-4f9d-95be-369032f16c8d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9\" (UID: \"430db6a8-1f92-4f9d-95be-369032f16c8d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9" Oct 29 23:24:29.619396 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:29.619365 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzqnh\" (UniqueName: \"kubernetes.io/projected/430db6a8-1f92-4f9d-95be-369032f16c8d-kube-api-access-wzqnh\") pod \"payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9\" (UID: \"430db6a8-1f92-4f9d-95be-369032f16c8d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9" Oct 29 23:24:29.694854 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:29.694739 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b58f9001-4e4a-4959-8d80-53b37221fd59-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh\" (UID: \"b58f9001-4e4a-4959-8d80-53b37221fd59\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh" Oct 29 23:24:29.695036 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:29.695018 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hl9w\" (UniqueName: \"kubernetes.io/projected/b58f9001-4e4a-4959-8d80-53b37221fd59-kube-api-access-2hl9w\") pod \"payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh\" (UID: \"b58f9001-4e4a-4959-8d80-53b37221fd59\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh" Oct 29 23:24:29.695642 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:29.695614 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b58f9001-4e4a-4959-8d80-53b37221fd59-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh\" (UID: \"b58f9001-4e4a-4959-8d80-53b37221fd59\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh" Oct 29 23:24:29.717169 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:29.717141 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hl9w\" (UniqueName: \"kubernetes.io/projected/b58f9001-4e4a-4959-8d80-53b37221fd59-kube-api-access-2hl9w\") pod \"payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh\" (UID: \"b58f9001-4e4a-4959-8d80-53b37221fd59\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh" Oct 29 23:24:29.731078 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:29.731038 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9" Oct 29 23:24:29.814184 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:29.814152 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh" Oct 29 23:24:30.036130 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.036102 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9"] Oct 29 23:24:30.037181 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:24:30.037158 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod430db6a8_1f92_4f9d_95be_369032f16c8d.slice/crio-88a10589a00f9271fea721080803b64268f8a4be4c6cb4d00be3dbcc5afec455 WatchSource:0}: Error finding container 88a10589a00f9271fea721080803b64268f8a4be4c6cb4d00be3dbcc5afec455: Status 404 returned error can't find the container with id 88a10589a00f9271fea721080803b64268f8a4be4c6cb4d00be3dbcc5afec455 Oct 29 23:24:30.134446 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.134411 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh"] Oct 29 23:24:30.135555 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:24:30.135528 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58f9001_4e4a_4959_8d80_53b37221fd59.slice/crio-78d106229b3370c01a053ae407da57a7b44ebb5202028923832e44261b12d656 WatchSource:0}: Error finding container 78d106229b3370c01a053ae407da57a7b44ebb5202028923832e44261b12d656: Status 404 returned error can't find the container with id 78d106229b3370c01a053ae407da57a7b44ebb5202028923832e44261b12d656 Oct 29 23:24:30.136779 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.136751 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh"] Oct 29 23:24:30.141004 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.140982 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" Oct 29 23:24:30.160432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.160410 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-032fa8-serving-cert\"" Oct 29 23:24:30.167690 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.167649 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh"] Oct 29 23:24:30.301323 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.301235 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6300192f-3f51-49b3-8889-e52171fa3e8e-maas-api-tls\") pod \"maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh\" (UID: \"6300192f-3f51-49b3-8889-e52171fa3e8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" Oct 29 23:24:30.301475 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.301354 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp84d\" (UniqueName: \"kubernetes.io/projected/6300192f-3f51-49b3-8889-e52171fa3e8e-kube-api-access-kp84d\") pod \"maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh\" (UID: \"6300192f-3f51-49b3-8889-e52171fa3e8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" Oct 29 23:24:30.301475 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.301413 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6300192f-3f51-49b3-8889-e52171fa3e8e-metrics-certs\") pod \"maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh\" (UID: \"6300192f-3f51-49b3-8889-e52171fa3e8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" Oct 29 23:24:30.301475 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.301444 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6300192f-3f51-49b3-8889-e52171fa3e8e-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh\" (UID: \"6300192f-3f51-49b3-8889-e52171fa3e8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" Oct 29 23:24:30.402428 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.402388 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp84d\" (UniqueName: \"kubernetes.io/projected/6300192f-3f51-49b3-8889-e52171fa3e8e-kube-api-access-kp84d\") pod \"maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh\" (UID: \"6300192f-3f51-49b3-8889-e52171fa3e8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" Oct 29 23:24:30.402633 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.402437 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6300192f-3f51-49b3-8889-e52171fa3e8e-metrics-certs\") pod \"maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh\" (UID: \"6300192f-3f51-49b3-8889-e52171fa3e8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" Oct 29 23:24:30.402633 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.402471 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6300192f-3f51-49b3-8889-e52171fa3e8e-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh\" (UID: \"6300192f-3f51-49b3-8889-e52171fa3e8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" Oct 29 23:24:30.402633 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.402552 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6300192f-3f51-49b3-8889-e52171fa3e8e-maas-api-tls\") pod \"maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh\" (UID: \"6300192f-3f51-49b3-8889-e52171fa3e8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" Oct 29 23:24:30.403272 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.403247 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6300192f-3f51-49b3-8889-e52171fa3e8e-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh\" (UID: \"6300192f-3f51-49b3-8889-e52171fa3e8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" Oct 29 23:24:30.405182 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.405150 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6300192f-3f51-49b3-8889-e52171fa3e8e-maas-api-tls\") pod \"maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh\" (UID: \"6300192f-3f51-49b3-8889-e52171fa3e8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" Oct 29 23:24:30.405271 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.405227 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6300192f-3f51-49b3-8889-e52171fa3e8e-metrics-certs\") pod \"maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh\" (UID: \"6300192f-3f51-49b3-8889-e52171fa3e8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" Oct 29 23:24:30.424068 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.424044 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp84d\" (UniqueName: \"kubernetes.io/projected/6300192f-3f51-49b3-8889-e52171fa3e8e-kube-api-access-kp84d\") pod \"maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh\" (UID: \"6300192f-3f51-49b3-8889-e52171fa3e8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" Oct 29 23:24:30.460703 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.460670 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" Oct 29 23:24:30.656312 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.656217 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh" event={"ID":"b58f9001-4e4a-4959-8d80-53b37221fd59","Type":"ContainerStarted","Data":"a808582a639bde1c7f7381842f218acd29141b50e55a3f247c0ae09b798b6d5d"} Oct 29 23:24:30.656312 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.656280 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh" event={"ID":"b58f9001-4e4a-4959-8d80-53b37221fd59","Type":"ContainerStarted","Data":"78d106229b3370c01a053ae407da57a7b44ebb5202028923832e44261b12d656"} Oct 29 23:24:30.656515 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.656423 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh" Oct 29 23:24:30.657942 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.657918 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9" event={"ID":"430db6a8-1f92-4f9d-95be-369032f16c8d","Type":"ContainerStarted","Data":"11a4106c2f8b7ac792c93055d35768ee583b3487ce474f09a5335084917600a1"} Oct 29 23:24:30.658065 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.657954 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9" event={"ID":"430db6a8-1f92-4f9d-95be-369032f16c8d","Type":"ContainerStarted","Data":"88a10589a00f9271fea721080803b64268f8a4be4c6cb4d00be3dbcc5afec455"} Oct 29 23:24:30.658065 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.658056 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9" Oct 29 23:24:30.702159 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.702099 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh" podStartSLOduration=1.7020829119999998 podStartE2EDuration="1.702082912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:24:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:24:30.702069925 +0000 UTC m=+637.428320518" watchObservedRunningTime="2026-10-29 23:24:30.702082912 +0000 UTC m=+637.428333506" Oct 29 23:24:30.746721 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.746670 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9" podStartSLOduration=1.746655099 podStartE2EDuration="1.746655099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:24:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:24:30.744498101 +0000 UTC m=+637.470748694" watchObservedRunningTime="2026-10-29 23:24:30.746655099 +0000 UTC m=+637.472905705" Oct 29 23:24:30.802022 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:24:30.801995 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6300192f_3f51_49b3_8889_e52171fa3e8e.slice/crio-f44f02074e8b2fa8b02db8ffcd854d60f2df3c3496395228c4780876f6a3a482 WatchSource:0}: Error finding container f44f02074e8b2fa8b02db8ffcd854d60f2df3c3496395228c4780876f6a3a482: Status 404 returned error can't find the container with id f44f02074e8b2fa8b02db8ffcd854d60f2df3c3496395228c4780876f6a3a482 Oct 29 23:24:30.802022 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.802009 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh"] Oct 29 23:24:30.803639 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:30.803615 6029 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 29 23:24:31.677651 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:31.677559 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" event={"ID":"6300192f-3f51-49b3-8889-e52171fa3e8e","Type":"ContainerStarted","Data":"4dcb2f6167914c10ef2725fe33469db9771d815f47cd4ef1952c5ce5d1591cc1"} Oct 29 23:24:31.678300 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:31.678273 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" Oct 29 23:24:31.678426 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:31.678314 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" event={"ID":"6300192f-3f51-49b3-8889-e52171fa3e8e","Type":"ContainerStarted","Data":"f44f02074e8b2fa8b02db8ffcd854d60f2df3c3496395228c4780876f6a3a482"} Oct 29 23:24:31.726349 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:31.726294 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" podStartSLOduration=1.128801279 podStartE2EDuration="1.726280268s" totalImagesPullingTime="597.478989ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:24:31.723691205 +0000 UTC m=+638.449941797" watchObservedRunningTime="2026-10-29 23:24:31.726280268 +0000 UTC m=+638.452530859" Oct 29 23:24:31.826661 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:31.826628 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj"] Oct 29 23:24:31.830955 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:31.830933 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" Oct 29 23:24:31.852869 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:31.852839 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w6-837245-serving-cert\"" Oct 29 23:24:31.859159 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:31.859125 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj"] Oct 29 23:24:31.918317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:31.918279 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5a87768-faea-4bd4-a252-c518bb2b809c-metrics-certs\") pod \"maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj\" (UID: \"a5a87768-faea-4bd4-a252-c518bb2b809c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" Oct 29 23:24:31.918498 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:31.918391 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5a87768-faea-4bd4-a252-c518bb2b809c-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj\" (UID: \"a5a87768-faea-4bd4-a252-c518bb2b809c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" Oct 29 23:24:31.918498 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:31.918433 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk7sk\" (UniqueName: \"kubernetes.io/projected/a5a87768-faea-4bd4-a252-c518bb2b809c-kube-api-access-fk7sk\") pod \"maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj\" (UID: \"a5a87768-faea-4bd4-a252-c518bb2b809c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" Oct 29 23:24:31.918624 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:31.918604 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5a87768-faea-4bd4-a252-c518bb2b809c-maas-api-tls\") pod \"maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj\" (UID: \"a5a87768-faea-4bd4-a252-c518bb2b809c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" Oct 29 23:24:32.019782 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:32.019747 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5a87768-faea-4bd4-a252-c518bb2b809c-maas-api-tls\") pod \"maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj\" (UID: \"a5a87768-faea-4bd4-a252-c518bb2b809c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" Oct 29 23:24:32.020031 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:32.019843 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5a87768-faea-4bd4-a252-c518bb2b809c-metrics-certs\") pod \"maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj\" (UID: \"a5a87768-faea-4bd4-a252-c518bb2b809c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" Oct 29 23:24:32.020031 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:32.019899 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5a87768-faea-4bd4-a252-c518bb2b809c-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj\" (UID: \"a5a87768-faea-4bd4-a252-c518bb2b809c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" Oct 29 23:24:32.020031 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:32.019929 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk7sk\" (UniqueName: \"kubernetes.io/projected/a5a87768-faea-4bd4-a252-c518bb2b809c-kube-api-access-fk7sk\") pod \"maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj\" (UID: \"a5a87768-faea-4bd4-a252-c518bb2b809c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" Oct 29 23:24:32.021133 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:32.021101 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5a87768-faea-4bd4-a252-c518bb2b809c-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj\" (UID: \"a5a87768-faea-4bd4-a252-c518bb2b809c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" Oct 29 23:24:32.024733 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:32.023309 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5a87768-faea-4bd4-a252-c518bb2b809c-maas-api-tls\") pod \"maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj\" (UID: \"a5a87768-faea-4bd4-a252-c518bb2b809c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" Oct 29 23:24:32.024733 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:32.023656 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5a87768-faea-4bd4-a252-c518bb2b809c-metrics-certs\") pod \"maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj\" (UID: \"a5a87768-faea-4bd4-a252-c518bb2b809c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" Oct 29 23:24:32.044346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:32.044159 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk7sk\" (UniqueName: \"kubernetes.io/projected/a5a87768-faea-4bd4-a252-c518bb2b809c-kube-api-access-fk7sk\") pod \"maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj\" (UID: \"a5a87768-faea-4bd4-a252-c518bb2b809c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" Oct 29 23:24:32.149409 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:32.149366 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" Oct 29 23:24:32.457034 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:32.457002 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj"] Oct 29 23:24:32.457628 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:24:32.457589 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5a87768_faea_4bd4_a252_c518bb2b809c.slice/crio-5b73763f815908143c102a7d5ae2dff92016ad322e04b8fb1991de811487e705 WatchSource:0}: Error finding container 5b73763f815908143c102a7d5ae2dff92016ad322e04b8fb1991de811487e705: Status 404 returned error can't find the container with id 5b73763f815908143c102a7d5ae2dff92016ad322e04b8fb1991de811487e705 Oct 29 23:24:32.683442 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:32.683400 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" event={"ID":"a5a87768-faea-4bd4-a252-c518bb2b809c","Type":"ContainerStarted","Data":"5b73763f815908143c102a7d5ae2dff92016ad322e04b8fb1991de811487e705"} Oct 29 23:24:33.532709 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:33.532668 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht"] Oct 29 23:24:33.536758 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:33.536732 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" Oct 29 23:24:33.567877 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:33.567844 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-2670a5-serving-cert\"" Oct 29 23:24:33.571306 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:33.571263 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht"] Oct 29 23:24:33.638283 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:33.638246 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht\" (UID: \"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" Oct 29 23:24:33.638488 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:33.638301 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkprd\" (UniqueName: \"kubernetes.io/projected/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-kube-api-access-kkprd\") pod \"maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht\" (UID: \"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" Oct 29 23:24:33.638488 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:33.638376 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-metrics-certs\") pod \"maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht\" (UID: \"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" Oct 29 23:24:33.638488 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:33.638438 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-maas-api-tls\") pod \"maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht\" (UID: \"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" Oct 29 23:24:33.691144 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:33.691103 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" event={"ID":"a5a87768-faea-4bd4-a252-c518bb2b809c","Type":"ContainerStarted","Data":"b5aec051ceea42a5730ee280fe14348ccd79219628244eb75c133750528184cf"} Oct 29 23:24:33.691633 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:33.691167 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" Oct 29 23:24:33.737352 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:33.737298 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" podStartSLOduration=2.360066745 podStartE2EDuration="2.737282836s" totalImagesPullingTime="377.216091ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:24:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:24:33.73538403 +0000 UTC m=+640.461634626" watchObservedRunningTime="2026-10-29 23:24:33.737282836 +0000 UTC m=+640.463533429" Oct 29 23:24:33.739554 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:33.739533 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht\" (UID: \"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" Oct 29 23:24:33.739624 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:33.739583 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkprd\" (UniqueName: \"kubernetes.io/projected/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-kube-api-access-kkprd\") pod \"maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht\" (UID: \"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" Oct 29 23:24:33.739673 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:33.739625 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-metrics-certs\") pod \"maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht\" (UID: \"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" Oct 29 23:24:33.739673 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:33.739655 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-maas-api-tls\") pod \"maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht\" (UID: \"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" Oct 29 23:24:33.740260 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:33.740236 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht\" (UID: \"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" Oct 29 23:24:33.742258 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:33.742195 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-metrics-certs\") pod \"maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht\" (UID: \"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" Oct 29 23:24:33.742378 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:33.742326 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-maas-api-tls\") pod \"maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht\" (UID: \"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" Oct 29 23:24:33.761307 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:33.761279 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkprd\" (UniqueName: \"kubernetes.io/projected/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-kube-api-access-kkprd\") pod \"maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht\" (UID: \"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" Oct 29 23:24:33.852175 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:33.852084 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" Oct 29 23:24:34.165455 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:34.165423 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht"] Oct 29 23:24:34.165753 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:24:34.165728 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0cd24af_80e1_4336_8f97_cdedd3e1ef0e.slice/crio-9aeb63a3b7bde4564d354f51e5a65cac8af9a56f0b50cbb265cf8b5bf4dba999 WatchSource:0}: Error finding container 9aeb63a3b7bde4564d354f51e5a65cac8af9a56f0b50cbb265cf8b5bf4dba999: Status 404 returned error can't find the container with id 9aeb63a3b7bde4564d354f51e5a65cac8af9a56f0b50cbb265cf8b5bf4dba999 Oct 29 23:24:34.699087 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:34.699027 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" event={"ID":"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e","Type":"ContainerStarted","Data":"98ad0d23045b06cd4ff58691ea7a1f7aff90810117d59e89ec1b4c95e5046e4d"} Oct 29 23:24:34.699571 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:34.699113 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" event={"ID":"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e","Type":"ContainerStarted","Data":"9aeb63a3b7bde4564d354f51e5a65cac8af9a56f0b50cbb265cf8b5bf4dba999"} Oct 29 23:24:34.699571 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:34.699370 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" Oct 29 23:24:36.851936 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:36.848564 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" podStartSLOduration=3.52303572 podStartE2EDuration="3.848543925s" totalImagesPullingTime="325.508205ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:24:34.753856931 +0000 UTC m=+641.480107523" watchObservedRunningTime="2026-10-29 23:24:36.848543925 +0000 UTC m=+643.574794522" Oct 29 23:24:36.852457 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:36.852088 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g"] Oct 29 23:24:36.856209 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:36.856190 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" Oct 29 23:24:36.875079 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:36.875051 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g"] Oct 29 23:24:36.880870 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:36.880842 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-be8726-serving-cert\"" Oct 29 23:24:36.903064 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:36.903033 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g\" (UID: \"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" Oct 29 23:24:36.903226 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:36.903146 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgvtd\" (UniqueName: \"kubernetes.io/projected/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-kube-api-access-bgvtd\") pod \"maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g\" (UID: \"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" Oct 29 23:24:36.903226 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:36.903183 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-metrics-certs\") pod \"maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g\" (UID: \"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" Oct 29 23:24:36.903226 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:36.903209 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-maas-api-tls\") pod \"maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g\" (UID: \"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" Oct 29 23:24:37.004214 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:37.004183 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g\" (UID: \"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" Oct 29 23:24:37.004396 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:37.004269 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgvtd\" (UniqueName: \"kubernetes.io/projected/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-kube-api-access-bgvtd\") pod \"maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g\" (UID: \"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" Oct 29 23:24:37.004396 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:37.004300 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-metrics-certs\") pod \"maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g\" (UID: \"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" Oct 29 23:24:37.004396 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:37.004335 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-maas-api-tls\") pod \"maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g\" (UID: \"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" Oct 29 23:24:37.005148 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:37.005116 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g\" (UID: \"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" Oct 29 23:24:37.007387 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:37.007363 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-maas-api-tls\") pod \"maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g\" (UID: \"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" Oct 29 23:24:37.007941 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:37.007851 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-metrics-certs\") pod \"maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g\" (UID: \"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" Oct 29 23:24:37.055405 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:37.055373 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgvtd\" (UniqueName: \"kubernetes.io/projected/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-kube-api-access-bgvtd\") pod \"maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g\" (UID: \"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" Oct 29 23:24:37.170151 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:37.170048 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" Oct 29 23:24:37.495410 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:37.495381 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g"] Oct 29 23:24:37.495734 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:24:37.495709 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77a4bccb_b4aa_4cc5_a204_b7b8b14e228b.slice/crio-d82d75f40551ae9768f9f751a015c9e15d8e8022f3f9c1e7973bcd548165ecb4 WatchSource:0}: Error finding container d82d75f40551ae9768f9f751a015c9e15d8e8022f3f9c1e7973bcd548165ecb4: Status 404 returned error can't find the container with id d82d75f40551ae9768f9f751a015c9e15d8e8022f3f9c1e7973bcd548165ecb4 Oct 29 23:24:37.689673 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:37.689643 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" Oct 29 23:24:37.719699 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:37.719663 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" event={"ID":"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b","Type":"ContainerStarted","Data":"d82d75f40551ae9768f9f751a015c9e15d8e8022f3f9c1e7973bcd548165ecb4"} Oct 29 23:24:38.529365 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:38.525865 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp"] Oct 29 23:24:38.531504 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:38.531479 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" Oct 29 23:24:38.562165 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:38.562133 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-313d9c-serving-cert\"" Oct 29 23:24:38.567181 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:38.566360 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp"] Oct 29 23:24:38.631170 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:38.631079 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e026a2b-f88b-43eb-845a-d97e66bb8656-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp\" (UID: \"8e026a2b-f88b-43eb-845a-d97e66bb8656\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" Oct 29 23:24:38.631498 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:38.631474 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e026a2b-f88b-43eb-845a-d97e66bb8656-metrics-certs\") pod \"maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp\" (UID: \"8e026a2b-f88b-43eb-845a-d97e66bb8656\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" Oct 29 23:24:38.631717 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:38.631699 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkrxq\" (UniqueName: \"kubernetes.io/projected/8e026a2b-f88b-43eb-845a-d97e66bb8656-kube-api-access-vkrxq\") pod \"maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp\" (UID: \"8e026a2b-f88b-43eb-845a-d97e66bb8656\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" Oct 29 23:24:38.631948 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:38.631929 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e026a2b-f88b-43eb-845a-d97e66bb8656-maas-api-tls\") pod \"maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp\" (UID: \"8e026a2b-f88b-43eb-845a-d97e66bb8656\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" Oct 29 23:24:38.741716 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:38.740509 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e026a2b-f88b-43eb-845a-d97e66bb8656-maas-api-tls\") pod \"maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp\" (UID: \"8e026a2b-f88b-43eb-845a-d97e66bb8656\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" Oct 29 23:24:38.741716 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:38.740631 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e026a2b-f88b-43eb-845a-d97e66bb8656-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp\" (UID: \"8e026a2b-f88b-43eb-845a-d97e66bb8656\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" Oct 29 23:24:38.741716 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:38.740689 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e026a2b-f88b-43eb-845a-d97e66bb8656-metrics-certs\") pod \"maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp\" (UID: \"8e026a2b-f88b-43eb-845a-d97e66bb8656\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" Oct 29 23:24:38.741716 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:38.740743 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkrxq\" (UniqueName: \"kubernetes.io/projected/8e026a2b-f88b-43eb-845a-d97e66bb8656-kube-api-access-vkrxq\") pod \"maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp\" (UID: \"8e026a2b-f88b-43eb-845a-d97e66bb8656\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" Oct 29 23:24:38.742938 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:38.742913 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e026a2b-f88b-43eb-845a-d97e66bb8656-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp\" (UID: \"8e026a2b-f88b-43eb-845a-d97e66bb8656\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" Oct 29 23:24:38.756486 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:38.756396 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e026a2b-f88b-43eb-845a-d97e66bb8656-maas-api-tls\") pod \"maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp\" (UID: \"8e026a2b-f88b-43eb-845a-d97e66bb8656\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" Oct 29 23:24:38.756674 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:38.756634 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" event={"ID":"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b","Type":"ContainerStarted","Data":"4b2f10d392bccdf2c9d2c234cbf3efcad1c1c472ca8a0efc0dabec64c5ae1af1"} Oct 29 23:24:38.756748 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:38.756713 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" Oct 29 23:24:38.757408 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:38.757384 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e026a2b-f88b-43eb-845a-d97e66bb8656-metrics-certs\") pod \"maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp\" (UID: \"8e026a2b-f88b-43eb-845a-d97e66bb8656\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" Oct 29 23:24:38.762521 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:38.762487 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkrxq\" (UniqueName: \"kubernetes.io/projected/8e026a2b-f88b-43eb-845a-d97e66bb8656-kube-api-access-vkrxq\") pod \"maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp\" (UID: \"8e026a2b-f88b-43eb-845a-d97e66bb8656\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" Oct 29 23:24:38.808553 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:38.808452 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" podStartSLOduration=2.435204331 podStartE2EDuration="2.808439744s" totalImagesPullingTime="373.235413ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:24:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:24:38.807100627 +0000 UTC m=+645.533351220" watchObservedRunningTime="2026-10-29 23:24:38.808439744 +0000 UTC m=+645.534690336" Oct 29 23:24:38.863165 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:38.863132 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" Oct 29 23:24:38.976028 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:24:38.975370 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:24:39.187457 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:39.187410 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp"] Oct 29 23:24:39.189140 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:24:39.189099 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e026a2b_f88b_43eb_845a_d97e66bb8656.slice/crio-a4094faf6ebe955b02afd29d002ee1454b7496ee56b0b995bb980b1a1b892562 WatchSource:0}: Error finding container a4094faf6ebe955b02afd29d002ee1454b7496ee56b0b995bb980b1a1b892562: Status 404 returned error can't find the container with id a4094faf6ebe955b02afd29d002ee1454b7496ee56b0b995bb980b1a1b892562 Oct 29 23:24:39.705669 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:39.705638 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" Oct 29 23:24:39.768504 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:39.768462 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" event={"ID":"8e026a2b-f88b-43eb-845a-d97e66bb8656","Type":"ContainerStarted","Data":"acab7eef8f9a1305db2ba48283121aa5773dbd1ed20630f855ca0c157abb4acc"} Oct 29 23:24:39.768681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:39.768553 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" event={"ID":"8e026a2b-f88b-43eb-845a-d97e66bb8656","Type":"ContainerStarted","Data":"a4094faf6ebe955b02afd29d002ee1454b7496ee56b0b995bb980b1a1b892562"} Oct 29 23:24:39.768681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:39.768582 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" Oct 29 23:24:39.894570 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:39.894508 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" podStartSLOduration=1.598173249 podStartE2EDuration="1.894486134s" totalImagesPullingTime="296.312885ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:24:39.891402686 +0000 UTC m=+646.617653291" watchObservedRunningTime="2026-10-29 23:24:39.894486134 +0000 UTC m=+646.620736727" Oct 29 23:24:40.360850 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:40.360796 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8"] Oct 29 23:24:40.367785 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:40.367756 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" Oct 29 23:24:40.385230 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:40.384131 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-0b2ae9-serving-cert\"" Oct 29 23:24:40.385378 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:40.385265 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8"] Oct 29 23:24:40.470075 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:40.469956 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f788db3-8b57-4936-bb05-466bbf4acd61-maas-api-tls\") pod \"maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8\" (UID: \"7f788db3-8b57-4936-bb05-466bbf4acd61\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" Oct 29 23:24:40.470075 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:40.470025 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f788db3-8b57-4936-bb05-466bbf4acd61-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8\" (UID: \"7f788db3-8b57-4936-bb05-466bbf4acd61\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" Oct 29 23:24:40.470353 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:40.470111 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsc5f\" (UniqueName: \"kubernetes.io/projected/7f788db3-8b57-4936-bb05-466bbf4acd61-kube-api-access-qsc5f\") pod \"maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8\" (UID: \"7f788db3-8b57-4936-bb05-466bbf4acd61\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" Oct 29 23:24:40.470353 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:40.470184 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f788db3-8b57-4936-bb05-466bbf4acd61-metrics-certs\") pod \"maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8\" (UID: \"7f788db3-8b57-4936-bb05-466bbf4acd61\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" Oct 29 23:24:40.570955 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:40.570913 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f788db3-8b57-4936-bb05-466bbf4acd61-maas-api-tls\") pod \"maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8\" (UID: \"7f788db3-8b57-4936-bb05-466bbf4acd61\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" Oct 29 23:24:40.571163 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:40.571002 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f788db3-8b57-4936-bb05-466bbf4acd61-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8\" (UID: \"7f788db3-8b57-4936-bb05-466bbf4acd61\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" Oct 29 23:24:40.571163 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:40.571112 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsc5f\" (UniqueName: \"kubernetes.io/projected/7f788db3-8b57-4936-bb05-466bbf4acd61-kube-api-access-qsc5f\") pod \"maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8\" (UID: \"7f788db3-8b57-4936-bb05-466bbf4acd61\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" Oct 29 23:24:40.571296 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:40.571192 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f788db3-8b57-4936-bb05-466bbf4acd61-metrics-certs\") pod \"maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8\" (UID: \"7f788db3-8b57-4936-bb05-466bbf4acd61\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" Oct 29 23:24:40.572465 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:40.572430 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f788db3-8b57-4936-bb05-466bbf4acd61-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8\" (UID: \"7f788db3-8b57-4936-bb05-466bbf4acd61\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" Oct 29 23:24:40.574204 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:40.574179 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f788db3-8b57-4936-bb05-466bbf4acd61-metrics-certs\") pod \"maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8\" (UID: \"7f788db3-8b57-4936-bb05-466bbf4acd61\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" Oct 29 23:24:40.577829 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:40.577787 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f788db3-8b57-4936-bb05-466bbf4acd61-maas-api-tls\") pod \"maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8\" (UID: \"7f788db3-8b57-4936-bb05-466bbf4acd61\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" Oct 29 23:24:40.594638 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:40.594606 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsc5f\" (UniqueName: \"kubernetes.io/projected/7f788db3-8b57-4936-bb05-466bbf4acd61-kube-api-access-qsc5f\") pod \"maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8\" (UID: \"7f788db3-8b57-4936-bb05-466bbf4acd61\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" Oct 29 23:24:40.691207 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:40.691165 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" Oct 29 23:24:40.712925 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:40.712896 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" Oct 29 23:24:41.001457 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:24:41.001425 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f788db3_8b57_4936_bb05_466bbf4acd61.slice/crio-12a2d70770a220fd06785a9c3e2ebaac4774f595fa25809a2f0bc9376fdf44d5 WatchSource:0}: Error finding container 12a2d70770a220fd06785a9c3e2ebaac4774f595fa25809a2f0bc9376fdf44d5: Status 404 returned error can't find the container with id 12a2d70770a220fd06785a9c3e2ebaac4774f595fa25809a2f0bc9376fdf44d5 Oct 29 23:24:41.002554 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:41.002521 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8"] Oct 29 23:24:41.680763 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:41.680686 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9" Oct 29 23:24:41.680963 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:41.680880 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh" Oct 29 23:24:41.805903 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:41.805321 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" event={"ID":"7f788db3-8b57-4936-bb05-466bbf4acd61","Type":"ContainerStarted","Data":"4e6173d75826b69238deb8b370f663990d3370ac26a065af1e1584d3f8574512"} Oct 29 23:24:41.805903 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:41.805388 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" event={"ID":"7f788db3-8b57-4936-bb05-466bbf4acd61","Type":"ContainerStarted","Data":"12a2d70770a220fd06785a9c3e2ebaac4774f595fa25809a2f0bc9376fdf44d5"} Oct 29 23:24:41.806417 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:41.806253 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" Oct 29 23:24:41.851585 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:41.851514 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" podStartSLOduration=1.560687272 podStartE2EDuration="1.851492788s" totalImagesPullingTime="290.805516ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:24:41.84905202 +0000 UTC m=+648.575302625" watchObservedRunningTime="2026-10-29 23:24:41.851492788 +0000 UTC m=+648.577743382" Oct 29 23:24:42.671025 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:42.670979 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 29 23:24:42.671206 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:42.671062 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" podUID="ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 29 23:24:43.421734 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:43.421693 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2"] Oct 29 23:24:43.426057 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:43.426033 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" Oct 29 23:24:43.447733 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:43.447706 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-9280e4-serving-cert\"" Oct 29 23:24:43.466265 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:43.466209 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2"] Oct 29 23:24:43.516616 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:43.516580 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-metrics-certs\") pod \"maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2\" (UID: \"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" Oct 29 23:24:43.516781 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:43.516673 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2\" (UID: \"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" Oct 29 23:24:43.516848 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:43.516796 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-maas-api-tls\") pod \"maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2\" (UID: \"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" Oct 29 23:24:43.516918 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:43.516902 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbv28\" (UniqueName: \"kubernetes.io/projected/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-kube-api-access-mbv28\") pod \"maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2\" (UID: \"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" Oct 29 23:24:43.618269 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:43.618226 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2\" (UID: \"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" Oct 29 23:24:43.618438 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:43.618293 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-maas-api-tls\") pod \"maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2\" (UID: \"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" Oct 29 23:24:43.618438 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:43.618339 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbv28\" (UniqueName: \"kubernetes.io/projected/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-kube-api-access-mbv28\") pod \"maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2\" (UID: \"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" Oct 29 23:24:43.618438 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:43.618384 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-metrics-certs\") pod \"maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2\" (UID: \"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" Oct 29 23:24:43.619161 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:43.619129 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2\" (UID: \"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" Oct 29 23:24:43.620935 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:43.620911 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-metrics-certs\") pod \"maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2\" (UID: \"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" Oct 29 23:24:43.621144 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:43.621123 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-maas-api-tls\") pod \"maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2\" (UID: \"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" Oct 29 23:24:43.639777 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:43.639744 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbv28\" (UniqueName: \"kubernetes.io/projected/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-kube-api-access-mbv28\") pod \"maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2\" (UID: \"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" Oct 29 23:24:43.758951 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:43.758916 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" Oct 29 23:24:44.150191 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:44.137097 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2"] Oct 29 23:24:44.795094 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:44.794145 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" Oct 29 23:24:44.855837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:44.854935 6029 generic.go:356] "Generic (PLEG): container finished" podID="ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" containerID="a248c413c68c2021e35ca9ddf330661ba8035bdc14da783f0014fa3646a012ae" exitCode=0 Oct 29 23:24:44.855837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:44.855099 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" event={"ID":"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250","Type":"ContainerDied","Data":"a248c413c68c2021e35ca9ddf330661ba8035bdc14da783f0014fa3646a012ae"} Oct 29 23:24:44.856116 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:44.855859 6029 scope.go:122] "RemoveContainer" containerID="a248c413c68c2021e35ca9ddf330661ba8035bdc14da783f0014fa3646a012ae" Oct 29 23:24:44.874310 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:44.867744 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:24:44.874310 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:44.867871 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:24:44.874310 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:44.867939 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:24:44.887752 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:44.887643 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" event={"ID":"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb","Type":"ContainerStarted","Data":"27e966501973201c4dface7cabd7506d079a2e0aeb3973ecb1f9e54f3fbc9145"} Oct 29 23:24:44.887752 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:44.887718 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" event={"ID":"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb","Type":"ContainerStarted","Data":"f9cdc4380c83464711d029c8c3ba05e2f51ce75f678a0d5bb772e23d2982b598"} Oct 29 23:24:44.891255 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:44.888228 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" Oct 29 23:24:45.073905 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:45.053439 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" podStartSLOduration=1.67520298 podStartE2EDuration="2.053415811s" totalImagesPullingTime="378.212831ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:24:45.037248038 +0000 UTC m=+651.763498631" watchObservedRunningTime="2026-10-29 23:24:45.053415811 +0000 UTC m=+651.779666405" Oct 29 23:24:45.807978 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:45.807589 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" Oct 29 23:24:46.010020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:46.009989 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" event={"ID":"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250","Type":"ContainerStarted","Data":"c0751b3abd472846c59e1f7b0670563859d62a6be819a993dbe435d36ee7f476"} Oct 29 23:24:46.995219 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:46.995185 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:46.995913 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:46.995885 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Oct 29 23:24:46.996127 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:46.996099 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" podUID="ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Oct 29 23:24:48.008839 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:48.004279 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Oct 29 23:24:48.008839 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:48.004341 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" podUID="ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Oct 29 23:24:48.865838 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:48.865128 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" Oct 29 23:24:49.026954 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:49.026901 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Oct 29 23:24:49.100844 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:49.097139 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" podUID="ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Oct 29 23:24:50.005843 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:50.005281 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Oct 29 23:24:50.005843 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:50.005338 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" podUID="ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Oct 29 23:24:50.993781 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:50.993697 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Oct 29 23:24:50.993781 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:50.993761 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" podUID="ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Oct 29 23:24:52.025081 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:52.025048 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" Oct 29 23:24:52.048495 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:52.048463 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:52.049659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:52.049598 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:52.051528 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:52.051420 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:24:55.268837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:55.265403 6029 generic.go:356] "Generic (PLEG): container finished" podID="6bafc705-c3f4-4532-a67a-77e1536256d1" containerID="92ffb89d10b640b4b4c2036e94572010dcb11c4021611aa07aa60c82596a3ed6" exitCode=0 Oct 29 23:24:55.268837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:55.265499 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" event={"ID":"6bafc705-c3f4-4532-a67a-77e1536256d1","Type":"ContainerDied","Data":"92ffb89d10b640b4b4c2036e94572010dcb11c4021611aa07aa60c82596a3ed6"} Oct 29 23:24:55.268837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:55.266006 6029 scope.go:122] "RemoveContainer" containerID="92ffb89d10b640b4b4c2036e94572010dcb11c4021611aa07aa60c82596a3ed6" Oct 29 23:24:55.273835 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:55.269962 6029 generic.go:356] "Generic (PLEG): container finished" podID="b39e7c06-e062-4b42-ae3e-eb1d72e058bb" containerID="7809944bc6f0e41ce4beb612525169038f2de93dfb46d2db09cfdcc42c4f8cab" exitCode=0 Oct 29 23:24:55.273835 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:55.270144 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" event={"ID":"b39e7c06-e062-4b42-ae3e-eb1d72e058bb","Type":"ContainerDied","Data":"7809944bc6f0e41ce4beb612525169038f2de93dfb46d2db09cfdcc42c4f8cab"} Oct 29 23:24:55.273835 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:55.270543 6029 scope.go:122] "RemoveContainer" containerID="7809944bc6f0e41ce4beb612525169038f2de93dfb46d2db09cfdcc42c4f8cab" Oct 29 23:24:55.282837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:55.276101 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:24:55.282837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:55.276193 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:24:55.282837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:55.276228 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:24:55.282837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:55.280676 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:24:55.282837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:55.280783 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:24:55.282837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:55.280863 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:24:56.281212 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:56.281166 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" event={"ID":"6bafc705-c3f4-4532-a67a-77e1536256d1","Type":"ContainerStarted","Data":"f5a894fb9c0fe8bfce96a5c104aadc4bba663a64e670b7bd5f96e066d36a80f2"} Oct 29 23:24:56.283960 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:56.283930 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" event={"ID":"b39e7c06-e062-4b42-ae3e-eb1d72e058bb","Type":"ContainerStarted","Data":"ef8baecd07eb2245c078d58c2ef0bd63e25fd136fa9cb8b3e508654320af3889"} Oct 29 23:24:56.342839 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:56.333169 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:56.342839 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:56.337944 6029 patch_prober.go:29] interesting pod/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Oct 29 23:24:56.342839 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:56.338002 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" podUID="6bafc705-c3f4-4532-a67a-77e1536256d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Oct 29 23:24:56.520356 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:56.520320 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:56.521423 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:56.521383 6029 patch_prober.go:29] interesting pod/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Oct 29 23:24:56.521545 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:56.521439 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" podUID="b39e7c06-e062-4b42-ae3e-eb1d72e058bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Oct 29 23:24:56.633928 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:56.629990 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:24:56.634949 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:56.634919 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:24:57.330246 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:57.330209 6029 patch_prober.go:29] interesting pod/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Oct 29 23:24:57.331511 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:57.331478 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" podUID="6bafc705-c3f4-4532-a67a-77e1536256d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Oct 29 23:24:57.520424 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:57.520379 6029 patch_prober.go:29] interesting pod/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Oct 29 23:24:57.520597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:57.520441 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" podUID="b39e7c06-e062-4b42-ae3e-eb1d72e058bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Oct 29 23:24:58.329301 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:58.329259 6029 patch_prober.go:29] interesting pod/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Oct 29 23:24:58.329597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:58.329570 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" podUID="6bafc705-c3f4-4532-a67a-77e1536256d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Oct 29 23:24:58.520553 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:58.520508 6029 patch_prober.go:29] interesting pod/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Oct 29 23:24:58.521070 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:58.520576 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" podUID="b39e7c06-e062-4b42-ae3e-eb1d72e058bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Oct 29 23:24:59.344297 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:59.344256 6029 patch_prober.go:29] interesting pod/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Oct 29 23:24:59.344623 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:59.344594 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" podUID="6bafc705-c3f4-4532-a67a-77e1536256d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Oct 29 23:24:59.520790 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:59.520755 6029 patch_prober.go:29] interesting pod/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Oct 29 23:24:59.521229 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:24:59.520836 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" podUID="b39e7c06-e062-4b42-ae3e-eb1d72e058bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Oct 29 23:25:00.330840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:00.330273 6029 patch_prober.go:29] interesting pod/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Oct 29 23:25:00.330840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:00.330350 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" podUID="6bafc705-c3f4-4532-a67a-77e1536256d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Oct 29 23:25:00.520760 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:00.520722 6029 patch_prober.go:29] interesting pod/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Oct 29 23:25:00.521020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:00.520996 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" podUID="b39e7c06-e062-4b42-ae3e-eb1d72e058bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Oct 29 23:25:01.343361 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:01.343324 6029 patch_prober.go:29] interesting pod/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Oct 29 23:25:01.343641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:01.343616 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" podUID="6bafc705-c3f4-4532-a67a-77e1536256d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Oct 29 23:25:01.520654 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:01.520618 6029 patch_prober.go:29] interesting pod/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Oct 29 23:25:01.520858 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:01.520669 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" podUID="b39e7c06-e062-4b42-ae3e-eb1d72e058bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Oct 29 23:25:02.332038 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:02.332005 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:25:02.333104 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:02.333082 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:25:02.525036 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:02.525000 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:25:02.526030 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:02.526007 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:25:08.921332 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:25:08.921288 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:25:38.921299 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:25:38.921257 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:25:39.603134 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.601940 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8"] Oct 29 23:25:39.606691 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.606617 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.626542 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.626512 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-837245-openshift-default-dockercfg-tn2ps\"" Oct 29 23:25:39.644072 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.644039 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8"] Oct 29 23:25:39.710460 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.710425 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-podinfo\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.710646 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.710475 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-workload-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.710646 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.710553 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-credential-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.710646 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.710628 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-envoy\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.710799 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.710664 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istiod-ca-cert\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.710903 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.710853 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-data\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.710962 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.710914 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4rn4\" (UniqueName: \"kubernetes.io/projected/6a44ecac-10fb-4a00-9596-716b57cc8dfa-kube-api-access-d4rn4\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.710962 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.710955 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-workload-certs\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.711069 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.711027 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-token\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.747271 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.747235 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb"] Oct 29 23:25:39.751327 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.751307 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:39.769385 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.769360 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-2670a5-openshift-default-dockercfg-6sq5q\"" Oct 29 23:25:39.777422 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.777398 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb"] Oct 29 23:25:39.812538 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.812502 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-envoy\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.812733 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.812547 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istiod-ca-cert\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.812733 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.812640 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-data\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.812733 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.812676 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4rn4\" (UniqueName: \"kubernetes.io/projected/6a44ecac-10fb-4a00-9596-716b57cc8dfa-kube-api-access-d4rn4\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.812733 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.812710 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-workload-certs\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.813000 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.812763 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-token\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.813000 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.812892 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-podinfo\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.813000 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.812928 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-workload-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.813000 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.812955 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-credential-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.813166 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.813116 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-data\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.813518 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.813378 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istiod-ca-cert\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.813518 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.813417 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-credential-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.813518 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.813476 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-workload-certs\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.813518 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.813489 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-workload-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.815467 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.815443 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-envoy\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.815754 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.815732 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-podinfo\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.834310 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.834285 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-token\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.834545 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.834523 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4rn4\" (UniqueName: \"kubernetes.io/projected/6a44ecac-10fb-4a00-9596-716b57cc8dfa-kube-api-access-d4rn4\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:39.914595 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.914512 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-istio-envoy\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:39.914595 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.914564 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-credential-socket\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:39.914791 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.914705 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-istio-data\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:39.914791 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.914741 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c26dda21-42b8-4789-8658-e91d387542e3-istio-token\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:39.914902 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.914885 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d957s\" (UniqueName: \"kubernetes.io/projected/c26dda21-42b8-4789-8658-e91d387542e3-kube-api-access-d957s\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:39.914946 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.914921 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c26dda21-42b8-4789-8658-e91d387542e3-istio-podinfo\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:39.915004 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.914958 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c26dda21-42b8-4789-8658-e91d387542e3-istiod-ca-cert\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:39.915046 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.915008 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-workload-certs\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:39.915148 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.915128 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-workload-socket\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:39.924477 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:39.924449 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:40.016853 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.016698 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-istio-envoy\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:40.016853 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.016734 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-credential-socket\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:40.016853 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.016772 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-istio-data\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:40.016853 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.016796 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c26dda21-42b8-4789-8658-e91d387542e3-istio-token\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:40.017245 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.016878 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d957s\" (UniqueName: \"kubernetes.io/projected/c26dda21-42b8-4789-8658-e91d387542e3-kube-api-access-d957s\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:40.017245 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.016914 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c26dda21-42b8-4789-8658-e91d387542e3-istio-podinfo\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:40.017245 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.016954 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c26dda21-42b8-4789-8658-e91d387542e3-istiod-ca-cert\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:40.017245 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.016984 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-workload-certs\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:40.017245 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.017103 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-workload-socket\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:40.017245 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.017224 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-credential-socket\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:40.017594 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.017406 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-workload-socket\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:40.017661 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.017640 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-istio-data\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:40.018650 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.018099 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-workload-certs\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:40.018650 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.018441 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c26dda21-42b8-4789-8658-e91d387542e3-istiod-ca-cert\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:40.020015 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.019980 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-istio-envoy\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:40.021356 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.021337 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c26dda21-42b8-4789-8658-e91d387542e3-istio-podinfo\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:40.040148 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.040114 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c26dda21-42b8-4789-8658-e91d387542e3-istio-token\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:40.041524 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.041494 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d957s\" (UniqueName: \"kubernetes.io/projected/c26dda21-42b8-4789-8658-e91d387542e3-kube-api-access-d957s\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:40.064255 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.064222 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:40.247490 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:25:40.247455 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a44ecac_10fb_4a00_9596_716b57cc8dfa.slice/crio-e835d367b48264900d6e36ad8184a033c91ee8b233a84a3e4114b4a92cea64a5 WatchSource:0}: Error finding container e835d367b48264900d6e36ad8184a033c91ee8b233a84a3e4114b4a92cea64a5: Status 404 returned error can't find the container with id e835d367b48264900d6e36ad8184a033c91ee8b233a84a3e4114b4a92cea64a5 Oct 29 23:25:40.248065 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.247992 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8"] Oct 29 23:25:40.249920 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.249889 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:25:40.249975 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.249954 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:25:40.250005 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.249981 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:25:40.395409 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.395380 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb"] Oct 29 23:25:40.395742 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:25:40.395713 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc26dda21_42b8_4789_8658_e91d387542e3.slice/crio-768f4552e1ebc82645d3475d7433c24b98bd28476f552894b6129d6aabb53ba7 WatchSource:0}: Error finding container 768f4552e1ebc82645d3475d7433c24b98bd28476f552894b6129d6aabb53ba7: Status 404 returned error can't find the container with id 768f4552e1ebc82645d3475d7433c24b98bd28476f552894b6129d6aabb53ba7 Oct 29 23:25:40.399028 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.398984 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:25:40.399137 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.399083 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:25:40.399137 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.399128 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:25:40.573253 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.573211 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" event={"ID":"6a44ecac-10fb-4a00-9596-716b57cc8dfa","Type":"ContainerStarted","Data":"fe72fb8f1ebdd62e7ba69808ddcb488bfb199f2360991ddcbb3e70f96cb5a15d"} Oct 29 23:25:40.573471 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.573273 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" event={"ID":"6a44ecac-10fb-4a00-9596-716b57cc8dfa","Type":"ContainerStarted","Data":"e835d367b48264900d6e36ad8184a033c91ee8b233a84a3e4114b4a92cea64a5"} Oct 29 23:25:40.575093 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.575065 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" event={"ID":"c26dda21-42b8-4789-8658-e91d387542e3","Type":"ContainerStarted","Data":"ba32fc6824ee0aa0981efef02aded7d46344ee9ff6c4e96aa112c750f83325e2"} Oct 29 23:25:40.575191 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.575117 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" event={"ID":"c26dda21-42b8-4789-8658-e91d387542e3","Type":"ContainerStarted","Data":"768f4552e1ebc82645d3475d7433c24b98bd28476f552894b6129d6aabb53ba7"} Oct 29 23:25:40.625317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.625258 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" podStartSLOduration=1.625238932 podStartE2EDuration="1.625238932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:25:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:25:40.622125381 +0000 UTC m=+707.348375974" watchObservedRunningTime="2026-10-29 23:25:40.625238932 +0000 UTC m=+707.351489524" Oct 29 23:25:40.669547 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.669489 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" podStartSLOduration=1.669473929 podStartE2EDuration="1.669473929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:25:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:25:40.667442083 +0000 UTC m=+707.393692711" watchObservedRunningTime="2026-10-29 23:25:40.669473929 +0000 UTC m=+707.395724579" Oct 29 23:25:40.929013 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:40.928915 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:41.070840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:41.070501 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:41.070840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:41.070667 6029 patch_prober.go:29] interesting pod/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body= Oct 29 23:25:41.070840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:41.070710 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" podUID="c26dda21-42b8-4789-8658-e91d387542e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" Oct 29 23:25:41.953840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:41.952998 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body= Oct 29 23:25:41.953840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:41.953086 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" podUID="6a44ecac-10fb-4a00-9596-716b57cc8dfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" Oct 29 23:25:42.068281 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:42.068239 6029 patch_prober.go:29] interesting pod/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body= Oct 29 23:25:42.068601 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:42.068562 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" podUID="c26dda21-42b8-4789-8658-e91d387542e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" Oct 29 23:25:42.927842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:42.927038 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body= Oct 29 23:25:42.927842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:42.927101 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" podUID="6a44ecac-10fb-4a00-9596-716b57cc8dfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" Oct 29 23:25:43.068839 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:43.068490 6029 patch_prober.go:29] interesting pod/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body= Oct 29 23:25:43.068839 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:43.068574 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" podUID="c26dda21-42b8-4789-8658-e91d387542e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" Oct 29 23:25:43.938840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:43.933477 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body= Oct 29 23:25:43.938840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:43.933644 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" podUID="6a44ecac-10fb-4a00-9596-716b57cc8dfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" Oct 29 23:25:44.065837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:44.065315 6029 patch_prober.go:29] interesting pod/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body= Oct 29 23:25:44.065837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:44.065395 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" podUID="c26dda21-42b8-4789-8658-e91d387542e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" Oct 29 23:25:44.927342 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:44.927302 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body= Oct 29 23:25:44.928105 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:44.928062 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" podUID="6a44ecac-10fb-4a00-9596-716b57cc8dfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" Oct 29 23:25:45.067331 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:45.067291 6029 patch_prober.go:29] interesting pod/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body= Oct 29 23:25:45.067627 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:45.067596 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" podUID="c26dda21-42b8-4789-8658-e91d387542e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" Oct 29 23:25:45.934838 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:45.934291 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body= Oct 29 23:25:45.934838 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:45.934400 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" podUID="6a44ecac-10fb-4a00-9596-716b57cc8dfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" Oct 29 23:25:46.078850 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:46.070346 6029 patch_prober.go:29] interesting pod/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body= Oct 29 23:25:46.078850 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:46.070417 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" podUID="c26dda21-42b8-4789-8658-e91d387542e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" Oct 29 23:25:47.065023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:47.064838 6029 patch_prober.go:29] interesting pod/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body= Oct 29 23:25:47.065023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:47.064903 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" podUID="c26dda21-42b8-4789-8658-e91d387542e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" Oct 29 23:25:47.202558 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:47.202521 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:47.204864 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:47.203607 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:47.204864 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:47.204745 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:25:48.329703 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:48.329669 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:48.330472 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:48.330000 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:25:48.330935 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:25:48.330913 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:26:08.903200 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:08.903115 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv"] Oct 29 23:26:08.907716 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:08.907689 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:08.927513 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:26:08.927480 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:26:08.927747 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:08.927725 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-be8726-openshift-default-dockercfg-mgctq\"" Oct 29 23:26:08.945199 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:08.945165 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv"] Oct 29 23:26:08.993766 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:08.993722 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istiod-ca-cert\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:08.994004 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:08.993845 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lqv2\" (UniqueName: \"kubernetes.io/projected/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-kube-api-access-9lqv2\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:08.994004 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:08.993926 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-workload-certs\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:08.994004 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:08.993967 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-token\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:08.994120 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:08.994023 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-workload-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:08.994120 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:08.994051 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-credential-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:08.994183 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:08.994151 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-data\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:08.994252 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:08.994230 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-podinfo\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:08.994369 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:08.994303 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-envoy\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:09.095442 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.095399 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-token\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:09.095442 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.095442 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-workload-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:09.095685 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.095462 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-credential-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:09.095685 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.095588 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-data\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:09.095685 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.095674 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-podinfo\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:09.095901 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.095738 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-envoy\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:09.095901 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.095777 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istiod-ca-cert\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:09.095901 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.095810 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-workload-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:09.095901 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.095877 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-credential-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:09.096120 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.095927 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lqv2\" (UniqueName: \"kubernetes.io/projected/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-kube-api-access-9lqv2\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:09.096120 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.096019 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-data\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:09.096120 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.096051 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-workload-certs\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:09.096353 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.096332 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-workload-certs\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:09.096520 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.096502 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istiod-ca-cert\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:09.098176 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.098150 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-envoy\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:09.098438 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.098413 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-podinfo\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:09.124761 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.124728 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lqv2\" (UniqueName: \"kubernetes.io/projected/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-kube-api-access-9lqv2\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:09.135981 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.135921 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-token\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:09.223376 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.223292 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:09.549274 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:26:09.549244 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e114c59_0ecc_4eed_ad14_7e2c6ad38d78.slice/crio-2d23c336cfa813364651de10682227831f2b0567bbf5068f5008781627063838 WatchSource:0}: Error finding container 2d23c336cfa813364651de10682227831f2b0567bbf5068f5008781627063838: Status 404 returned error can't find the container with id 2d23c336cfa813364651de10682227831f2b0567bbf5068f5008781627063838 Oct 29 23:26:09.550940 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.550794 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv"] Oct 29 23:26:09.551929 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.551888 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:26:09.552032 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.551968 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:26:09.552032 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.552016 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:26:09.789669 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.789634 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" event={"ID":"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78","Type":"ContainerStarted","Data":"b112ba333d8d82bf0cc9e223b595cf9ed774c64ee2728bdbce4fcdeec152e4a5"} Oct 29 23:26:09.789889 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.789695 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" event={"ID":"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78","Type":"ContainerStarted","Data":"2d23c336cfa813364651de10682227831f2b0567bbf5068f5008781627063838"} Oct 29 23:26:09.839638 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:09.839527 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" podStartSLOduration=1.839506812 podStartE2EDuration="1.839506812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:26:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:26:09.837370611 +0000 UTC m=+736.563621207" watchObservedRunningTime="2026-10-29 23:26:09.839506812 +0000 UTC m=+736.565757405" Oct 29 23:26:10.242903 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:10.232199 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:10.252877 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:10.248957 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body= Oct 29 23:26:10.252877 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:10.249023 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" podUID="6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" Oct 29 23:26:11.225842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:11.224278 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body= Oct 29 23:26:11.225842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:11.224372 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" podUID="6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" Oct 29 23:26:12.229841 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:12.226211 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body= Oct 29 23:26:12.229841 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:12.226271 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" podUID="6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" Oct 29 23:26:13.227850 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:13.226171 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body= Oct 29 23:26:13.227850 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:13.226267 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" podUID="6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" Oct 29 23:26:14.224356 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:14.224310 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body= Oct 29 23:26:14.225015 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:14.224980 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" podUID="6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" Oct 29 23:26:15.231840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:15.226303 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body= Oct 29 23:26:15.231840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:15.226392 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" podUID="6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" Oct 29 23:26:16.224491 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:16.224448 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body= Oct 29 23:26:16.224796 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:16.224516 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" podUID="6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" Oct 29 23:26:17.457837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:17.457726 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:17.458575 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:17.458551 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:17.460037 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:17.460015 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:26:38.921232 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:26:38.921186 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:26:39.296147 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.296103 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7"] Oct 29 23:26:39.300588 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.300567 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.317033 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.317001 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7"] Oct 29 23:26:39.352855 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.330412 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-9280e4-openshift-default-dockercfg-2jl2d\"" Oct 29 23:26:39.396408 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.396368 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-credential-socket\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.396587 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.396455 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-istio-data\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.396587 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.396482 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/717e543a-a22e-4966-8c30-e245cd6005b4-istio-token\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.396587 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.396516 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47lrz\" (UniqueName: \"kubernetes.io/projected/717e543a-a22e-4966-8c30-e245cd6005b4-kube-api-access-47lrz\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.396587 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.396550 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/717e543a-a22e-4966-8c30-e245cd6005b4-istio-podinfo\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.396887 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.396601 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/717e543a-a22e-4966-8c30-e245cd6005b4-istiod-ca-cert\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.396887 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.396637 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-workload-socket\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.396887 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.396685 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-istio-envoy\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.396887 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.396866 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-workload-certs\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.497460 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.497423 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-workload-certs\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.497627 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.497501 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-credential-socket\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.497627 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.497546 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-istio-data\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.497627 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.497570 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/717e543a-a22e-4966-8c30-e245cd6005b4-istio-token\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.497735 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.497645 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47lrz\" (UniqueName: \"kubernetes.io/projected/717e543a-a22e-4966-8c30-e245cd6005b4-kube-api-access-47lrz\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.497735 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.497696 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/717e543a-a22e-4966-8c30-e245cd6005b4-istio-podinfo\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.497800 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.497743 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/717e543a-a22e-4966-8c30-e245cd6005b4-istiod-ca-cert\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.497800 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.497787 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-workload-socket\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.497893 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.497846 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-istio-envoy\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.497961 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.497942 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-credential-socket\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.498090 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.497982 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-istio-data\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.498234 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.498205 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-workload-certs\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.498310 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.498245 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-workload-socket\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.498485 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.498466 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/717e543a-a22e-4966-8c30-e245cd6005b4-istiod-ca-cert\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.500118 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.500092 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-istio-envoy\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.500529 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.500505 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/717e543a-a22e-4966-8c30-e245cd6005b4-istio-podinfo\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.519343 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.519315 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/717e543a-a22e-4966-8c30-e245cd6005b4-istio-token\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.519467 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.519388 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47lrz\" (UniqueName: \"kubernetes.io/projected/717e543a-a22e-4966-8c30-e245cd6005b4-kube-api-access-47lrz\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:39.615066 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:39.614971 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:40.065877 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:40.065651 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7"] Oct 29 23:26:40.067660 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:26:40.067619 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod717e543a_a22e_4966_8c30_e245cd6005b4.slice/crio-2d7b8f2c45b6baf6fa67929ee1fc215423f4e2bbbae79e1cf7365c50567fdfe9 WatchSource:0}: Error finding container 2d7b8f2c45b6baf6fa67929ee1fc215423f4e2bbbae79e1cf7365c50567fdfe9: Status 404 returned error can't find the container with id 2d7b8f2c45b6baf6fa67929ee1fc215423f4e2bbbae79e1cf7365c50567fdfe9 Oct 29 23:26:40.071863 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:40.071319 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:26:40.071863 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:40.071423 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:26:40.071863 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:40.071489 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:26:40.091467 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:40.091434 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" event={"ID":"717e543a-a22e-4966-8c30-e245cd6005b4","Type":"ContainerStarted","Data":"2d7b8f2c45b6baf6fa67929ee1fc215423f4e2bbbae79e1cf7365c50567fdfe9"} Oct 29 23:26:41.108487 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:41.108443 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" event={"ID":"717e543a-a22e-4966-8c30-e245cd6005b4","Type":"ContainerStarted","Data":"b7e7314f06342c731f1cd2b8802f903cf71d600c859bb26eb6460ca781336f23"} Oct 29 23:26:41.175730 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:41.175666 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" podStartSLOduration=2.175649336 podStartE2EDuration="2.175649336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:26:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:26:41.17275588 +0000 UTC m=+767.899006472" watchObservedRunningTime="2026-10-29 23:26:41.175649336 +0000 UTC m=+767.901899932" Oct 29 23:26:41.616013 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:41.615970 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:41.617497 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:41.617466 6029 patch_prober.go:29] interesting pod/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body= Oct 29 23:26:41.617630 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:41.617513 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" podUID="717e543a-a22e-4966-8c30-e245cd6005b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" Oct 29 23:26:42.616260 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:42.616217 6029 patch_prober.go:29] interesting pod/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body= Oct 29 23:26:42.616759 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:42.616293 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" podUID="717e543a-a22e-4966-8c30-e245cd6005b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" Oct 29 23:26:43.615713 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:43.615677 6029 patch_prober.go:29] interesting pod/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body= Oct 29 23:26:43.615927 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:43.615744 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" podUID="717e543a-a22e-4966-8c30-e245cd6005b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" Oct 29 23:26:44.616119 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:44.616068 6029 patch_prober.go:29] interesting pod/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body= Oct 29 23:26:44.616513 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:44.616161 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" podUID="717e543a-a22e-4966-8c30-e245cd6005b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" Oct 29 23:26:45.616055 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:45.616021 6029 patch_prober.go:29] interesting pod/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body= Oct 29 23:26:45.616250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:45.616079 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" podUID="717e543a-a22e-4966-8c30-e245cd6005b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" Oct 29 23:26:46.615563 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:46.615522 6029 patch_prober.go:29] interesting pod/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body= Oct 29 23:26:46.615755 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:46.615633 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" podUID="717e543a-a22e-4966-8c30-e245cd6005b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" Oct 29 23:26:47.619907 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:47.619876 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:47.620437 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:47.620164 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:47.621010 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:47.620991 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:26:54.329760 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.329721 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj"] Oct 29 23:26:54.496421 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.496388 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj"] Oct 29 23:26:54.505839 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.497457 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.618477 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.618371 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-workload-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.618757 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.618719 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-podinfo\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.622954 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.622928 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-workload-certs\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.623158 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.623140 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-data\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.623311 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.623294 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krqwl\" (UniqueName: \"kubernetes.io/projected/3860268b-8c6e-4826-831f-e6efd1a0faf6-kube-api-access-krqwl\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.645092 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.645051 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3860268b-8c6e-4826-831f-e6efd1a0faf6-istiod-ca-cert\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.645393 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.645376 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-token\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.645531 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.645514 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-envoy\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.645717 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.645703 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-credential-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.765489 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.765447 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-workload-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.766259 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.766235 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-podinfo\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.769535 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.766477 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-workload-certs\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.785767 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.785734 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-data\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.786043 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.786020 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krqwl\" (UniqueName: \"kubernetes.io/projected/3860268b-8c6e-4826-831f-e6efd1a0faf6-kube-api-access-krqwl\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.786206 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.786191 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3860268b-8c6e-4826-831f-e6efd1a0faf6-istiod-ca-cert\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.786403 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.786384 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-token\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.786530 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.786513 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-envoy\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.786696 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.786678 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-credential-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.817854 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.787054 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3860268b-8c6e-4826-831f-e6efd1a0faf6-istiod-ca-cert\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.818961 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.787179 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-credential-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.818961 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.786117 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-data\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.818961 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.770012 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-workload-certs\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.818961 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.766178 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-workload-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.818961 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.788679 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-podinfo\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.818961 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.809208 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-envoy\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.857692 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.857606 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krqwl\" (UniqueName: \"kubernetes.io/projected/3860268b-8c6e-4826-831f-e6efd1a0faf6-kube-api-access-krqwl\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:54.858515 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:54.858493 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-token\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:55.026172 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:55.026121 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:56.101025 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:56.100996 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj"] Oct 29 23:26:56.103939 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:26:56.103913 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3860268b_8c6e_4826_831f_e6efd1a0faf6.slice/crio-81a57d8d87538f40fe115051814108575ae28b7bdd9e69c68e8ca08e737b39d4 WatchSource:0}: Error finding container 81a57d8d87538f40fe115051814108575ae28b7bdd9e69c68e8ca08e737b39d4: Status 404 returned error can't find the container with id 81a57d8d87538f40fe115051814108575ae28b7bdd9e69c68e8ca08e737b39d4 Oct 29 23:26:56.106058 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:56.106017 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:26:56.106144 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:56.106111 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:26:56.106185 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:56.106155 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:26:56.586722 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:56.586683 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" event={"ID":"3860268b-8c6e-4826-831f-e6efd1a0faf6","Type":"ContainerStarted","Data":"ed8453f3b5d7f55062daa28e8943690a9c7522b8f4972b326e449cff3f219809"} Oct 29 23:26:56.587037 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:56.587010 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" event={"ID":"3860268b-8c6e-4826-831f-e6efd1a0faf6","Type":"ContainerStarted","Data":"81a57d8d87538f40fe115051814108575ae28b7bdd9e69c68e8ca08e737b39d4"} Oct 29 23:26:56.683890 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:56.676850 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" podStartSLOduration=2.676805474 podStartE2EDuration="2.676805474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:26:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:26:56.656147617 +0000 UTC m=+783.382398239" watchObservedRunningTime="2026-10-29 23:26:56.676805474 +0000 UTC m=+783.403056085" Oct 29 23:26:57.032614 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:57.032583 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:26:57.032977 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:57.032957 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body= Oct 29 23:26:57.042838 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:57.033120 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" podUID="3860268b-8c6e-4826-831f-e6efd1a0faf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" Oct 29 23:26:58.040006 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:58.039962 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body= Oct 29 23:26:58.040801 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:58.040767 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" podUID="3860268b-8c6e-4826-831f-e6efd1a0faf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" Oct 29 23:26:59.030271 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:59.030233 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body= Oct 29 23:26:59.030572 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:26:59.030542 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" podUID="3860268b-8c6e-4826-831f-e6efd1a0faf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" Oct 29 23:27:00.035838 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:00.031245 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body= Oct 29 23:27:00.035838 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:00.031309 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" podUID="3860268b-8c6e-4826-831f-e6efd1a0faf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" Oct 29 23:27:01.027714 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:01.027676 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body= Oct 29 23:27:01.028073 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:01.028031 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" podUID="3860268b-8c6e-4826-831f-e6efd1a0faf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" Oct 29 23:27:02.057837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:02.039398 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body= Oct 29 23:27:02.057837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:02.039476 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" podUID="3860268b-8c6e-4826-831f-e6efd1a0faf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" Oct 29 23:27:03.027290 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:03.027256 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body= Oct 29 23:27:03.027456 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:03.027306 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" podUID="3860268b-8c6e-4826-831f-e6efd1a0faf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" Oct 29 23:27:04.033011 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:04.032967 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:27:04.036283 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:04.036260 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:27:04.036600 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:04.036584 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:27:08.939614 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:27:08.939566 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:27:09.719080 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.719045 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s"] Oct 29 23:27:09.725095 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.725069 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.771149 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.771121 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s"] Oct 29 23:27:09.818636 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.818600 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjb6n\" (UniqueName: \"kubernetes.io/projected/ca770a17-0292-4428-8044-8a413b388227-kube-api-access-rjb6n\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.818841 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.818707 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca770a17-0292-4428-8044-8a413b388227-istio-envoy\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.818841 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.818748 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca770a17-0292-4428-8044-8a413b388227-istio-podinfo\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.818841 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.818792 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca770a17-0292-4428-8044-8a413b388227-istio-token\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.818986 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.818962 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca770a17-0292-4428-8044-8a413b388227-credential-socket\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.819065 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.819050 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca770a17-0292-4428-8044-8a413b388227-workload-certs\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.819128 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.819098 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca770a17-0292-4428-8044-8a413b388227-istio-data\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.819196 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.819180 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca770a17-0292-4428-8044-8a413b388227-workload-socket\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.819260 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.819246 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca770a17-0292-4428-8044-8a413b388227-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.920871 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.920810 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca770a17-0292-4428-8044-8a413b388227-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.921057 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.920935 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjb6n\" (UniqueName: \"kubernetes.io/projected/ca770a17-0292-4428-8044-8a413b388227-kube-api-access-rjb6n\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.921057 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.920971 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca770a17-0292-4428-8044-8a413b388227-istio-envoy\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.921057 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.920986 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca770a17-0292-4428-8044-8a413b388227-istio-podinfo\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.921057 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.921015 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca770a17-0292-4428-8044-8a413b388227-istio-token\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.921276 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.921061 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca770a17-0292-4428-8044-8a413b388227-credential-socket\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.921276 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.921112 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca770a17-0292-4428-8044-8a413b388227-workload-certs\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.921276 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.921138 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca770a17-0292-4428-8044-8a413b388227-istio-data\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.921276 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.921194 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca770a17-0292-4428-8044-8a413b388227-workload-socket\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.921528 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.921504 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca770a17-0292-4428-8044-8a413b388227-credential-socket\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.921590 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.921543 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca770a17-0292-4428-8044-8a413b388227-workload-certs\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.921590 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.921575 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca770a17-0292-4428-8044-8a413b388227-workload-socket\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.921590 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.921582 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca770a17-0292-4428-8044-8a413b388227-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.921749 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.921670 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca770a17-0292-4428-8044-8a413b388227-istio-data\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.923435 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.923410 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca770a17-0292-4428-8044-8a413b388227-istio-envoy\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.923597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.923581 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca770a17-0292-4428-8044-8a413b388227-istio-podinfo\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.942645 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.942614 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca770a17-0292-4428-8044-8a413b388227-istio-token\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:09.943046 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:09.942923 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjb6n\" (UniqueName: \"kubernetes.io/projected/ca770a17-0292-4428-8044-8a413b388227-kube-api-access-rjb6n\") pod \"maas-default-gateway-openshift-default-746ff8f49f-xhg5s\" (UID: \"ca770a17-0292-4428-8044-8a413b388227\") " pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:10.051263 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:10.051232 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:10.367264 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:27:10.367237 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca770a17_0292_4428_8044_8a413b388227.slice/crio-e628f199247f3ab5a995acad7bb8af37f81a782ff8adbddd1671a56206c287a1 WatchSource:0}: Error finding container e628f199247f3ab5a995acad7bb8af37f81a782ff8adbddd1671a56206c287a1: Status 404 returned error can't find the container with id e628f199247f3ab5a995acad7bb8af37f81a782ff8adbddd1671a56206c287a1 Oct 29 23:27:10.369266 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:10.369237 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s"] Oct 29 23:27:10.369980 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:10.369941 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:27:10.370078 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:10.370013 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:27:10.370078 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:10.370046 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:27:10.698998 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:10.698902 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" event={"ID":"ca770a17-0292-4428-8044-8a413b388227","Type":"ContainerStarted","Data":"dad5b35ae8ebf06801bf4e3b5177cb6125ba4c21b3b3f90cecba8325378c93b0"} Oct 29 23:27:10.698998 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:10.698962 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" event={"ID":"ca770a17-0292-4428-8044-8a413b388227","Type":"ContainerStarted","Data":"e628f199247f3ab5a995acad7bb8af37f81a782ff8adbddd1671a56206c287a1"} Oct 29 23:27:10.751578 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:10.751509 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" podStartSLOduration=1.751488736 podStartE2EDuration="1.751488736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:27:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:27:10.747122548 +0000 UTC m=+797.473373151" watchObservedRunningTime="2026-10-29 23:27:10.751488736 +0000 UTC m=+797.477739329" Oct 29 23:27:11.056357 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:11.056322 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:11.058196 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:11.058127 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-xhg5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body= Oct 29 23:27:11.058513 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:11.058467 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" podUID="ca770a17-0292-4428-8044-8a413b388227" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" Oct 29 23:27:12.055841 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:12.055215 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-xhg5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body= Oct 29 23:27:12.055841 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:12.055275 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" podUID="ca770a17-0292-4428-8044-8a413b388227" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" Oct 29 23:27:13.052478 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:13.052442 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-xhg5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body= Oct 29 23:27:13.052897 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:13.052498 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" podUID="ca770a17-0292-4428-8044-8a413b388227" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" Oct 29 23:27:14.052076 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:14.052044 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-xhg5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body= Oct 29 23:27:14.052268 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:14.052104 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" podUID="ca770a17-0292-4428-8044-8a413b388227" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" Oct 29 23:27:15.052497 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:15.052456 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-xhg5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body= Oct 29 23:27:15.053024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:15.052536 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" podUID="ca770a17-0292-4428-8044-8a413b388227" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" Oct 29 23:27:16.052839 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:16.052225 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-xhg5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body= Oct 29 23:27:16.052839 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:16.052285 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" podUID="ca770a17-0292-4428-8044-8a413b388227" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" Oct 29 23:27:17.051598 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:17.051562 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-xhg5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body= Oct 29 23:27:17.051803 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:17.051636 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" podUID="ca770a17-0292-4428-8044-8a413b388227" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" Oct 29 23:27:18.052213 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:18.052171 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-xhg5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body= Oct 29 23:27:18.052606 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:18.052253 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" podUID="ca770a17-0292-4428-8044-8a413b388227" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" Oct 29 23:27:19.363878 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:19.363166 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:19.379845 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:19.365806 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:19.448852 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:19.448671 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-xhg5s" Oct 29 23:27:24.312537 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.312504 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl"] Oct 29 23:27:24.316604 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.316584 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.335048 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.335020 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h"] Oct 29 23:27:24.338932 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.338914 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.350046 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.350014 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl"] Oct 29 23:27:24.364157 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.364105 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h"] Oct 29 23:27:24.367772 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.367740 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/219edfce-514c-4adc-aed0-c331515e9467-istio-podinfo\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.368090 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.368070 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-workload-certs\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.368261 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.368243 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-istio-data\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.368412 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.368395 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-workload-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.368512 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.368499 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-workload-certs\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.368620 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.368606 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/219edfce-514c-4adc-aed0-c331515e9467-istiod-ca-cert\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.368719 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.368707 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istiod-ca-cert\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.368852 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.368835 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-credential-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.368966 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.368954 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-credential-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.369058 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.369045 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-data\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.369161 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.369147 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jnks\" (UniqueName: \"kubernetes.io/projected/219edfce-514c-4adc-aed0-c331515e9467-kube-api-access-8jnks\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.369295 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.369281 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/219edfce-514c-4adc-aed0-c331515e9467-istio-token\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.369415 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.369402 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-istio-envoy\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.369522 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.369509 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mx27\" (UniqueName: \"kubernetes.io/projected/7add77b8-8cb6-48a6-8e3d-dd223f76402a-kube-api-access-8mx27\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.369662 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.369648 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-podinfo\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.369786 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.369773 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-workload-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.369927 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.369913 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-envoy\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.370027 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.370014 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-token\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.442736 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.442704 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd"] Oct 29 23:27:24.446861 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.446805 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.472918 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.472876 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd"] Oct 29 23:27:24.473621 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.473595 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/219edfce-514c-4adc-aed0-c331515e9467-istio-token\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.473755 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.473648 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-istio-envoy\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.473755 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.473685 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mx27\" (UniqueName: \"kubernetes.io/projected/7add77b8-8cb6-48a6-8e3d-dd223f76402a-kube-api-access-8mx27\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.473755 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.473732 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-podinfo\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.473931 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.473773 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-workload-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.473931 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.473831 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-envoy\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.473931 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.473855 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-token\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.474083 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.473944 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/219edfce-514c-4adc-aed0-c331515e9467-istio-podinfo\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.474083 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.473973 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-workload-certs\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.474083 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.473997 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-istio-data\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.474083 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.474057 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-workload-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.474083 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.474079 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-workload-certs\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.474333 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.474108 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/219edfce-514c-4adc-aed0-c331515e9467-istiod-ca-cert\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.474333 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.474132 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istiod-ca-cert\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.474333 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.474177 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-credential-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.474333 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.474212 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-credential-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.474333 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.474237 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-data\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.474333 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.474240 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-workload-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.474333 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.474266 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jnks\" (UniqueName: \"kubernetes.io/projected/219edfce-514c-4adc-aed0-c331515e9467-kube-api-access-8jnks\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.474923 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.474851 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-istio-data\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.476918 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.475145 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-workload-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.476918 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.475235 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/219edfce-514c-4adc-aed0-c331515e9467-istiod-ca-cert\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.476918 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.475379 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-credential-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.476918 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.475479 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-credential-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.476918 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.475700 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-data\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.476918 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.476242 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-workload-certs\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.476918 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.476395 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-workload-certs\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.476918 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.476885 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istiod-ca-cert\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.478505 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.478481 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/219edfce-514c-4adc-aed0-c331515e9467-istio-podinfo\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.478703 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.478677 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-istio-envoy\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.480047 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.480023 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-podinfo\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.480148 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.480127 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-envoy\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.501249 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.501181 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-token\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.502925 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.502847 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jnks\" (UniqueName: \"kubernetes.io/projected/219edfce-514c-4adc-aed0-c331515e9467-kube-api-access-8jnks\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.502925 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.502847 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mx27\" (UniqueName: \"kubernetes.io/projected/7add77b8-8cb6-48a6-8e3d-dd223f76402a-kube-api-access-8mx27\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.503564 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.503536 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/219edfce-514c-4adc-aed0-c331515e9467-istio-token\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.576998 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.576910 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-token\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.576998 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.576953 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-podinfo\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.577221 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.577100 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istiod-ca-cert\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.577221 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.577180 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-envoy\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.577221 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.577218 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-credential-socket\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.577351 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.577234 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-data\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.577351 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.577265 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-workload-socket\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.577454 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.577432 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lm5f\" (UniqueName: \"kubernetes.io/projected/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-kube-api-access-6lm5f\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.577522 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.577509 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-workload-certs\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.631298 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.631261 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:24.658049 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.658020 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:24.679872 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.678877 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lm5f\" (UniqueName: \"kubernetes.io/projected/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-kube-api-access-6lm5f\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.679872 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.678964 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-workload-certs\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.679872 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.679110 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-token\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.679872 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.679416 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-podinfo\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.679872 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.679692 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-workload-certs\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.679872 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.679772 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istiod-ca-cert\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.680254 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.679887 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-envoy\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.680254 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.679933 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-credential-socket\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.680254 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.679959 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-data\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.680254 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.679993 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-workload-socket\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.680494 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.680472 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-workload-socket\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.681692 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.680728 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-credential-socket\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.681692 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.681023 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-data\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.681692 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.681639 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istiod-ca-cert\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.684216 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.684197 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-envoy\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.685965 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.685927 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-podinfo\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.754848 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.751118 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lm5f\" (UniqueName: \"kubernetes.io/projected/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-kube-api-access-6lm5f\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.756852 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.755144 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-token\") pod \"e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.764105 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.764072 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:24.994175 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:27:24.994146 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7add77b8_8cb6_48a6_8e3d_dd223f76402a.slice/crio-305c87f671259f17dbd3384a18722a993810f4a9c4247123295bcd06e2add38b WatchSource:0}: Error finding container 305c87f671259f17dbd3384a18722a993810f4a9c4247123295bcd06e2add38b: Status 404 returned error can't find the container with id 305c87f671259f17dbd3384a18722a993810f4a9c4247123295bcd06e2add38b Oct 29 23:27:24.994491 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.994470 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl"] Oct 29 23:27:24.996497 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.996461 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:27:24.996584 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.996525 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:27:24.996584 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:24.996560 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:27:25.048905 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:27:25.048874 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod219edfce_514c_4adc_aed0_c331515e9467.slice/crio-0d71f9393708e1e766d37a4936cdfe6a4577d5c8ec31752da14cbf6df94c279b WatchSource:0}: Error finding container 0d71f9393708e1e766d37a4936cdfe6a4577d5c8ec31752da14cbf6df94c279b: Status 404 returned error can't find the container with id 0d71f9393708e1e766d37a4936cdfe6a4577d5c8ec31752da14cbf6df94c279b Oct 29 23:27:25.048905 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:25.048894 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h"] Oct 29 23:27:25.050359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:25.050323 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:27:25.050428 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:25.050403 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:27:25.050463 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:25.050444 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:27:25.100128 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:27:25.100093 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f9ba1bd_dab9_48e9_aa0c_90c781da120f.slice/crio-2bf228d66be75cdf437958fb21f11a9c9c509477a21ad71e893a8fce75c01d18 WatchSource:0}: Error finding container 2bf228d66be75cdf437958fb21f11a9c9c509477a21ad71e893a8fce75c01d18: Status 404 returned error can't find the container with id 2bf228d66be75cdf437958fb21f11a9c9c509477a21ad71e893a8fce75c01d18 Oct 29 23:27:25.100961 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:25.100938 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd"] Oct 29 23:27:25.103159 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:25.103123 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:27:25.103277 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:25.103185 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:27:25.103277 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:25.103213 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:27:25.857841 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:25.857672 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" event={"ID":"2f9ba1bd-dab9-48e9-aa0c-90c781da120f","Type":"ContainerStarted","Data":"635f0416e1109beff877ae9d9ce2715cb5abacf8bf1520439acce399191ecb88"} Oct 29 23:27:25.857841 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:25.857780 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" event={"ID":"2f9ba1bd-dab9-48e9-aa0c-90c781da120f","Type":"ContainerStarted","Data":"2bf228d66be75cdf437958fb21f11a9c9c509477a21ad71e893a8fce75c01d18"} Oct 29 23:27:25.863629 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:25.863579 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" event={"ID":"219edfce-514c-4adc-aed0-c331515e9467","Type":"ContainerStarted","Data":"d8aaae0e1d749183f788ce74b6bd3fac05ea1a0d20888200b5b0f225167b2708"} Oct 29 23:27:25.863954 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:25.863934 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" event={"ID":"219edfce-514c-4adc-aed0-c331515e9467","Type":"ContainerStarted","Data":"0d71f9393708e1e766d37a4936cdfe6a4577d5c8ec31752da14cbf6df94c279b"} Oct 29 23:27:25.867138 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:25.867108 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" event={"ID":"7add77b8-8cb6-48a6-8e3d-dd223f76402a","Type":"ContainerStarted","Data":"919004d763d6b0ae055097c3285e1874aef48ea971f564bca0b1b0de516717a7"} Oct 29 23:27:25.867370 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:25.867352 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" event={"ID":"7add77b8-8cb6-48a6-8e3d-dd223f76402a","Type":"ContainerStarted","Data":"305c87f671259f17dbd3384a18722a993810f4a9c4247123295bcd06e2add38b"} Oct 29 23:27:25.945845 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:25.945675 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" podStartSLOduration=1.945654148 podStartE2EDuration="1.945654148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:27:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:27:25.92629592 +0000 UTC m=+812.652546513" watchObservedRunningTime="2026-10-29 23:27:25.945654148 +0000 UTC m=+812.671904740" Oct 29 23:27:25.984838 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:25.984109 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" podStartSLOduration=1.9840884829999998 podStartE2EDuration="1.984088483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:27:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:27:25.9746101 +0000 UTC m=+812.700860686" watchObservedRunningTime="2026-10-29 23:27:25.984088483 +0000 UTC m=+812.710339075" Oct 29 23:27:26.635402 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:26.635314 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:26.638639 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:26.638263 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body= Oct 29 23:27:26.638639 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:26.638328 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" podUID="7add77b8-8cb6-48a6-8e3d-dd223f76402a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" Oct 29 23:27:26.665037 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:26.664950 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:26.665431 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:26.665317 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body= Oct 29 23:27:26.665431 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:26.665371 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" podUID="219edfce-514c-4adc-aed0-c331515e9467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" Oct 29 23:27:26.779849 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:26.778928 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:26.779849 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:26.779070 6029 patch_prober.go:29] interesting pod/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body= Oct 29 23:27:26.779849 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:26.779119 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" podUID="2f9ba1bd-dab9-48e9-aa0c-90c781da120f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" Oct 29 23:27:27.635775 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:27.635243 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body= Oct 29 23:27:27.635775 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:27.635329 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" podUID="7add77b8-8cb6-48a6-8e3d-dd223f76402a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" Oct 29 23:27:27.672839 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:27.663652 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body= Oct 29 23:27:27.672839 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:27.663710 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" podUID="219edfce-514c-4adc-aed0-c331515e9467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" Oct 29 23:27:27.769462 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:27.769028 6029 patch_prober.go:29] interesting pod/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body= Oct 29 23:27:27.769462 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:27.769086 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" podUID="2f9ba1bd-dab9-48e9-aa0c-90c781da120f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" Oct 29 23:27:28.638837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:28.638679 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body= Oct 29 23:27:28.638837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:28.638782 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" podUID="7add77b8-8cb6-48a6-8e3d-dd223f76402a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" Oct 29 23:27:28.659223 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:28.659111 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body= Oct 29 23:27:28.659223 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:28.659166 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" podUID="219edfce-514c-4adc-aed0-c331515e9467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" Oct 29 23:27:28.767663 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:28.767219 6029 patch_prober.go:29] interesting pod/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body= Oct 29 23:27:28.767663 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:28.767283 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" podUID="2f9ba1bd-dab9-48e9-aa0c-90c781da120f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" Oct 29 23:27:29.635840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:29.632306 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body= Oct 29 23:27:29.635840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:29.632389 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" podUID="7add77b8-8cb6-48a6-8e3d-dd223f76402a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" Oct 29 23:27:29.665840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:29.665316 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body= Oct 29 23:27:29.665840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:29.665401 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" podUID="219edfce-514c-4adc-aed0-c331515e9467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" Oct 29 23:27:29.772840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:29.772286 6029 patch_prober.go:29] interesting pod/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body= Oct 29 23:27:29.772840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:29.772362 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" podUID="2f9ba1bd-dab9-48e9-aa0c-90c781da120f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" Oct 29 23:27:30.634318 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:30.634281 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body= Oct 29 23:27:30.634613 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:30.634568 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" podUID="7add77b8-8cb6-48a6-8e3d-dd223f76402a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" Oct 29 23:27:30.662983 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:30.662950 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body= Oct 29 23:27:30.663364 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:30.663312 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" podUID="219edfce-514c-4adc-aed0-c331515e9467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" Oct 29 23:27:30.776840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:30.776368 6029 patch_prober.go:29] interesting pod/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body= Oct 29 23:27:30.776840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:30.776453 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" podUID="2f9ba1bd-dab9-48e9-aa0c-90c781da120f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" Oct 29 23:27:31.632183 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:31.632144 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body= Oct 29 23:27:31.632482 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:31.632450 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" podUID="7add77b8-8cb6-48a6-8e3d-dd223f76402a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" Oct 29 23:27:31.660017 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:31.659932 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body= Oct 29 23:27:31.660017 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:31.659997 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" podUID="219edfce-514c-4adc-aed0-c331515e9467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" Oct 29 23:27:31.766213 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:31.766181 6029 patch_prober.go:29] interesting pod/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body= Oct 29 23:27:31.766461 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:31.766441 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" podUID="2f9ba1bd-dab9-48e9-aa0c-90c781da120f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" Oct 29 23:27:32.673133 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:32.673103 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:32.675075 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:32.675054 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:32.678651 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:32.678628 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:27:32.715747 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:32.714484 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:32.715747 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:32.715575 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:32.727187 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:32.727108 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:27:32.764481 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:32.764420 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" podStartSLOduration=8.7643978 podStartE2EDuration="8.7643978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:27:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:27:26.028221818 +0000 UTC m=+812.754472412" watchObservedRunningTime="2026-10-29 23:27:32.7643978 +0000 UTC m=+819.490648395" Oct 29 23:27:33.026413 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:33.026380 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:33.026868 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:33.026840 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:33.028101 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:33.028080 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:27:35.117732 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:35.117643 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 29 23:27:35.123603 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:35.123560 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" podUID="3860268b-8c6e-4826-831f-e6efd1a0faf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 29 23:27:38.923592 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:27:38.923548 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:27:40.015496 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.015458 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs"] Oct 29 23:27:40.019567 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.019545 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.053721 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.053685 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs"] Oct 29 23:27:40.112372 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.112337 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-istio-envoy\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.112542 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.112388 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11ac369f-a9a0-479c-b534-6227afec3635-istio-podinfo\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.112598 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.112574 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-workload-certs\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.112634 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.112616 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbx6d\" (UniqueName: \"kubernetes.io/projected/11ac369f-a9a0-479c-b534-6227afec3635-kube-api-access-gbx6d\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.112729 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.112716 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-credential-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.112775 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.112743 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11ac369f-a9a0-479c-b534-6227afec3635-istio-token\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.112918 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.112896 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-istio-data\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.112986 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.112946 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11ac369f-a9a0-479c-b534-6227afec3635-istiod-ca-cert\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.113051 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.113031 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-workload-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.214539 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.214480 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-workload-certs\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.214539 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.214536 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbx6d\" (UniqueName: \"kubernetes.io/projected/11ac369f-a9a0-479c-b534-6227afec3635-kube-api-access-gbx6d\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.214805 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.214572 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-credential-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.214805 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.214593 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11ac369f-a9a0-479c-b534-6227afec3635-istio-token\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.214805 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.214658 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-istio-data\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.214805 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.214699 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11ac369f-a9a0-479c-b534-6227afec3635-istiod-ca-cert\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.214805 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.214743 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-workload-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.214805 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.214785 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-istio-envoy\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.215194 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.214867 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11ac369f-a9a0-479c-b534-6227afec3635-istio-podinfo\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.215194 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.214963 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-workload-certs\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.215194 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.215016 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-credential-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.215194 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.215091 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-istio-data\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.215194 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.215181 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-workload-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.215586 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.215565 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11ac369f-a9a0-479c-b534-6227afec3635-istiod-ca-cert\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.217242 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.217221 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-istio-envoy\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.217390 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.217373 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11ac369f-a9a0-479c-b534-6227afec3635-istio-podinfo\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.264962 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.264927 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4"] Oct 29 23:27:40.268147 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.268069 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11ac369f-a9a0-479c-b534-6227afec3635-istio-token\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.268614 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.268595 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbx6d\" (UniqueName: \"kubernetes.io/projected/11ac369f-a9a0-479c-b534-6227afec3635-kube-api-access-gbx6d\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-szlfs\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.270099 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.270076 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.301508 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.301475 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4"] Oct 29 23:27:40.333716 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.333682 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:40.419519 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.419478 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c828g\" (UniqueName: \"kubernetes.io/projected/ff2c3fee-90cf-4c17-bd87-5f76e8166517-kube-api-access-c828g\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.419680 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.419621 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-credential-socket\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.419876 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.419842 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-envoy\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.419958 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.419921 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-workload-socket\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.420004 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.419955 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istiod-ca-cert\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.420078 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.420033 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-workload-certs\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.420177 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.420158 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-podinfo\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.420254 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.420237 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-data\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.420318 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.420291 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-token\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.521680 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.521599 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-envoy\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.521680 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.521649 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-workload-socket\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.521947 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.521685 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istiod-ca-cert\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.521947 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.521734 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-workload-certs\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.521947 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.521805 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-podinfo\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.522164 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.522127 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-workload-socket\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.522288 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.522206 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-workload-certs\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.522359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.522281 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-data\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.522433 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.522412 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-token\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.522537 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.522518 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-data\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.522791 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.522770 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c828g\" (UniqueName: \"kubernetes.io/projected/ff2c3fee-90cf-4c17-bd87-5f76e8166517-kube-api-access-c828g\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.523064 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.522999 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-credential-socket\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.523064 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.522886 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istiod-ca-cert\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.523422 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.523390 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-credential-socket\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.524581 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.524557 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-envoy\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.525062 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.525042 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-podinfo\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.549968 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.549935 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-token\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.550159 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.550079 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c828g\" (UniqueName: \"kubernetes.io/projected/ff2c3fee-90cf-4c17-bd87-5f76e8166517-kube-api-access-c828g\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.619395 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.619359 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:40.663033 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:27:40.662996 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11ac369f_a9a0_479c_b534_6227afec3635.slice/crio-b14a691a956866b4f6151871c91c4687dd967106813a14acb55d7a44f46b076a WatchSource:0}: Error finding container b14a691a956866b4f6151871c91c4687dd967106813a14acb55d7a44f46b076a: Status 404 returned error can't find the container with id b14a691a956866b4f6151871c91c4687dd967106813a14acb55d7a44f46b076a Oct 29 23:27:40.664347 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.664323 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs"] Oct 29 23:27:40.665908 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.665870 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:27:40.665987 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.665951 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:27:40.666026 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.665994 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:27:40.940927 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.940898 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4"] Oct 29 23:27:40.942680 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:27:40.942651 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff2c3fee_90cf_4c17_bd87_5f76e8166517.slice/crio-0b5f0d7faae9d1533e831a0ff92f8f6cc73855bdcd28c20b8d27e28235667298 WatchSource:0}: Error finding container 0b5f0d7faae9d1533e831a0ff92f8f6cc73855bdcd28c20b8d27e28235667298: Status 404 returned error can't find the container with id 0b5f0d7faae9d1533e831a0ff92f8f6cc73855bdcd28c20b8d27e28235667298 Oct 29 23:27:40.946021 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.945983 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:27:40.946136 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.946068 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:27:40.946136 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:40.946114 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:27:41.349798 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:41.349765 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" event={"ID":"11ac369f-a9a0-479c-b534-6227afec3635","Type":"ContainerStarted","Data":"f4a307af5d26c5e0bb0e52a0319c88d3b7b2de411051d62ae52e656dfa6d7034"} Oct 29 23:27:41.350442 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:41.350398 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" event={"ID":"11ac369f-a9a0-479c-b534-6227afec3635","Type":"ContainerStarted","Data":"b14a691a956866b4f6151871c91c4687dd967106813a14acb55d7a44f46b076a"} Oct 29 23:27:41.359752 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:41.359716 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" event={"ID":"ff2c3fee-90cf-4c17-bd87-5f76e8166517","Type":"ContainerStarted","Data":"7ace8e739d047d646bc3a8ff31c7f4ede7a685ecaa568950092b352a87c56210"} Oct 29 23:27:41.359977 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:41.359772 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" event={"ID":"ff2c3fee-90cf-4c17-bd87-5f76e8166517","Type":"ContainerStarted","Data":"0b5f0d7faae9d1533e831a0ff92f8f6cc73855bdcd28c20b8d27e28235667298"} Oct 29 23:27:41.402569 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:41.402509 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" podStartSLOduration=2.402493984 podStartE2EDuration="2.402493984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:27:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:27:41.399827579 +0000 UTC m=+828.126078196" watchObservedRunningTime="2026-10-29 23:27:41.402493984 +0000 UTC m=+828.128744575" Oct 29 23:27:41.619949 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:41.619869 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:42.347840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:42.347197 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:42.353853 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:42.352071 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body= Oct 29 23:27:42.353853 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:42.352137 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" podUID="11ac369f-a9a0-479c-b534-6227afec3635" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" Oct 29 23:27:42.621908 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:42.621764 6029 patch_prober.go:29] interesting pod/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body= Oct 29 23:27:42.621908 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:42.621865 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" podUID="ff2c3fee-90cf-4c17-bd87-5f76e8166517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" Oct 29 23:27:43.351291 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:43.351248 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body= Oct 29 23:27:43.352752 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:43.352714 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" podUID="11ac369f-a9a0-479c-b534-6227afec3635" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" Oct 29 23:27:43.620259 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:43.620171 6029 patch_prober.go:29] interesting pod/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body= Oct 29 23:27:43.620259 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:43.620243 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" podUID="ff2c3fee-90cf-4c17-bd87-5f76e8166517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" Oct 29 23:27:44.344840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:44.335201 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body= Oct 29 23:27:44.344840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:44.335263 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" podUID="11ac369f-a9a0-479c-b534-6227afec3635" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" Oct 29 23:27:44.620622 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:44.620540 6029 patch_prober.go:29] interesting pod/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body= Oct 29 23:27:44.620622 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:44.620591 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" podUID="ff2c3fee-90cf-4c17-bd87-5f76e8166517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" Oct 29 23:27:45.338842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:45.335297 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body= Oct 29 23:27:45.338842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:45.335376 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" podUID="11ac369f-a9a0-479c-b534-6227afec3635" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" Oct 29 23:27:45.620151 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:45.620057 6029 patch_prober.go:29] interesting pod/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body= Oct 29 23:27:45.620151 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:45.620108 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" podUID="ff2c3fee-90cf-4c17-bd87-5f76e8166517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" Oct 29 23:27:46.335688 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:46.335652 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body= Oct 29 23:27:46.336371 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:46.336337 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" podUID="11ac369f-a9a0-479c-b534-6227afec3635" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" Oct 29 23:27:46.620580 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:46.620496 6029 patch_prober.go:29] interesting pod/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body= Oct 29 23:27:46.620778 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:46.620757 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" podUID="ff2c3fee-90cf-4c17-bd87-5f76e8166517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" Oct 29 23:27:47.334390 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:47.334353 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body= Oct 29 23:27:47.334665 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:47.334637 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" podUID="11ac369f-a9a0-479c-b534-6227afec3635" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" Oct 29 23:27:47.619958 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:47.619876 6029 patch_prober.go:29] interesting pod/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body= Oct 29 23:27:47.620446 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:47.620421 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" podUID="ff2c3fee-90cf-4c17-bd87-5f76e8166517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" Oct 29 23:27:48.340198 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:48.340163 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:48.341735 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:48.341581 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:48.342280 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:48.342256 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:27:48.419802 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:48.419753 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" podStartSLOduration=8.419738316 podStartE2EDuration="8.419738316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:27:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:27:41.462992908 +0000 UTC m=+828.189243510" watchObservedRunningTime="2026-10-29 23:27:48.419738316 +0000 UTC m=+835.145988910" Oct 29 23:27:48.624513 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:48.624432 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:48.624998 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:48.624829 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:27:48.625686 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:27:48.625664 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:28:08.922332 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:28:08.922256 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:28:18.357809 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.357769 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k"] Oct 29 23:28:18.364201 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.364167 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:18.384693 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.384662 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k"] Oct 29 23:28:18.392759 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.392730 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-837245\"/\"default-dockercfg-gx7pm\"" Oct 29 23:28:18.393077 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.392864 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-837245\"/\"distinct-2-w6-837245-kserve-self-signed-certs\"" Oct 29 23:28:18.394387 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.394365 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-837245\"/\"kube-root-ca.crt\"" Oct 29 23:28:18.394478 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.394387 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-837245\"/\"openshift-service-ca.crt\"" Oct 29 23:28:18.401149 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.401115 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-tmp-dir\") pod \"distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:18.401266 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.401186 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-home\") pod \"distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:18.401324 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.401302 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-model-cache\") pod \"distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:18.401367 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.401344 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b44l\" (UniqueName: \"kubernetes.io/projected/d5e267ab-8b18-469a-a986-78beb7b635fa-kube-api-access-5b44l\") pod \"distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:18.401512 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.401496 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-dshm\") pod \"distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:18.401622 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.401599 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5e267ab-8b18-469a-a986-78beb7b635fa-tls-certs\") pod \"distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:18.503193 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.503149 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-tmp-dir\") pod \"distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:18.503384 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.503327 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-home\") pod \"distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:18.503445 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.503382 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-model-cache\") pod \"distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:18.503445 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.503415 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b44l\" (UniqueName: \"kubernetes.io/projected/d5e267ab-8b18-469a-a986-78beb7b635fa-kube-api-access-5b44l\") pod \"distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:18.503588 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.503534 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-dshm\") pod \"distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:18.503722 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.503624 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5e267ab-8b18-469a-a986-78beb7b635fa-tls-certs\") pod \"distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:18.503722 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.503645 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-tmp-dir\") pod \"distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:18.503722 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.503682 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-home\") pod \"distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:18.503722 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.503699 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-model-cache\") pod \"distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:18.505844 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.505807 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-dshm\") pod \"distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:18.506224 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.506202 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5e267ab-8b18-469a-a986-78beb7b635fa-tls-certs\") pod \"distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:18.524754 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.524718 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b44l\" (UniqueName: \"kubernetes.io/projected/d5e267ab-8b18-469a-a986-78beb7b635fa-kube-api-access-5b44l\") pod \"distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:18.681306 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.681217 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:18.987802 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:28:18.987751 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5e267ab_8b18_469a_a986_78beb7b635fa.slice/crio-d7b6bc12834c8a3abf5c6bfdb3d0c73704b07ae44652281e38ba9b10f4b74980 WatchSource:0}: Error finding container d7b6bc12834c8a3abf5c6bfdb3d0c73704b07ae44652281e38ba9b10f4b74980: Status 404 returned error can't find the container with id d7b6bc12834c8a3abf5c6bfdb3d0c73704b07ae44652281e38ba9b10f4b74980 Oct 29 23:28:18.987972 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:18.987877 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k"] Oct 29 23:28:19.707576 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:19.707543 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" event={"ID":"d5e267ab-8b18-469a-a986-78beb7b635fa","Type":"ContainerStarted","Data":"3515a8f3a41d99d5afaa16e9e202af8d1ada3f9d9b78d73cf429f951e169f8ba"} Oct 29 23:28:19.707576 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:19.707583 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" event={"ID":"d5e267ab-8b18-469a-a986-78beb7b635fa","Type":"ContainerStarted","Data":"d7b6bc12834c8a3abf5c6bfdb3d0c73704b07ae44652281e38ba9b10f4b74980"} Oct 29 23:28:19.752447 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:19.752378 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" podStartSLOduration=1.7523588220000001 podStartE2EDuration="1.752358822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:28:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:28:19.748449936 +0000 UTC m=+866.474700548" watchObservedRunningTime="2026-10-29 23:28:19.752358822 +0000 UTC m=+866.478609416" Oct 29 23:28:20.682370 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:20.682336 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:24.810275 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.810234 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8"] Oct 29 23:28:24.818098 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.818071 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj"] Oct 29 23:28:24.819912 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.818358 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.827966 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.827941 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.846292 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.846253 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-credential-socket\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.846458 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.846320 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55084dd3-2a7c-4cc3-a302-67f9eb258336-istiod-ca-cert\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.846458 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.846347 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-workload-socket\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.846458 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.846374 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-podinfo\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.846458 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.846402 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-data\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.846458 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.846454 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-token\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.846741 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.846484 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8e651dc-428f-4cb0-95b2-513a6f325880-istiod-ca-cert\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.846741 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.846514 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-token\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.846741 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.846550 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-data\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.846741 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.846606 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-envoy\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.846741 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.846637 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-workload-certs\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.846741 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.846675 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-workload-certs\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.847065 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.846749 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-envoy\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.847065 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.846802 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-workload-socket\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.847065 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.846922 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2lkf\" (UniqueName: \"kubernetes.io/projected/55084dd3-2a7c-4cc3-a302-67f9eb258336-kube-api-access-n2lkf\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.847065 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.846959 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-credential-socket\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.847065 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.846981 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-podinfo\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.847065 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.847014 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnmq6\" (UniqueName: \"kubernetes.io/projected/a8e651dc-428f-4cb0-95b2-513a6f325880-kube-api-access-rnmq6\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.853844 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.851877 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8"] Oct 29 23:28:24.854307 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.854173 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj"] Oct 29 23:28:24.949328 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.949119 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2lkf\" (UniqueName: \"kubernetes.io/projected/55084dd3-2a7c-4cc3-a302-67f9eb258336-kube-api-access-n2lkf\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.949654 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.949619 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-credential-socket\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.950054 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.950027 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-podinfo\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.952838 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.952787 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnmq6\" (UniqueName: \"kubernetes.io/projected/a8e651dc-428f-4cb0-95b2-513a6f325880-kube-api-access-rnmq6\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.974929 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.974888 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-credential-socket\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.975120 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.974990 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55084dd3-2a7c-4cc3-a302-67f9eb258336-istiod-ca-cert\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.975120 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.975040 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-workload-socket\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.975120 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.975044 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-credential-socket\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.975120 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.975079 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-podinfo\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.975402 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.975380 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-data\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.975889 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.975862 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-data\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.976164 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.976143 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-token\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.976386 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.976354 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8e651dc-428f-4cb0-95b2-513a6f325880-istiod-ca-cert\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.976950 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.976929 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-token\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.977093 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.976224 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-credential-socket\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.977200 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.976874 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55084dd3-2a7c-4cc3-a302-67f9eb258336-istiod-ca-cert\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.977270 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.977186 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-data\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.977270 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.976248 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-workload-socket\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.977564 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.977540 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-envoy\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.977644 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.977618 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-workload-certs\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.977644 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.977632 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8e651dc-428f-4cb0-95b2-513a6f325880-istiod-ca-cert\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.977777 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.977688 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-workload-certs\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.977872 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.977797 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-envoy\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.977936 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.977894 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-workload-socket\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.977995 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.977961 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-workload-certs\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.978316 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.978292 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-workload-certs\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.978673 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.978644 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-workload-socket\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.979065 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.979042 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-podinfo\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.979348 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.979329 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-data\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.980788 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.980741 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2lkf\" (UniqueName: \"kubernetes.io/projected/55084dd3-2a7c-4cc3-a302-67f9eb258336-kube-api-access-n2lkf\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.981454 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.981429 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnmq6\" (UniqueName: \"kubernetes.io/projected/a8e651dc-428f-4cb0-95b2-513a6f325880-kube-api-access-rnmq6\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.981790 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.981771 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-podinfo\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:24.983827 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.983764 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-envoy\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:24.984218 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:24.984180 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-envoy\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:25.000354 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:25.000324 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-token\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:25.000502 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:25.000322 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-token\") pod \"e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:25.199332 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:25.199235 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:25.212656 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:25.212402 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:25.540337 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:25.540309 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8"] Oct 29 23:28:25.540851 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:28:25.540789 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e651dc_428f_4cb0_95b2_513a6f325880.slice/crio-e41045917480571d02fccdcba675b03b30d3f35c7863ee0c71c637eff1c2b6ff WatchSource:0}: Error finding container e41045917480571d02fccdcba675b03b30d3f35c7863ee0c71c637eff1c2b6ff: Status 404 returned error can't find the container with id e41045917480571d02fccdcba675b03b30d3f35c7863ee0c71c637eff1c2b6ff Oct 29 23:28:25.543534 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:25.543494 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:28:25.543644 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:25.543580 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:28:25.543644 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:25.543623 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:28:25.560207 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:25.560153 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:28:25.560328 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:25.560254 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:28:25.560328 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:25.560302 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:28:25.561116 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:25.560904 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj"] Oct 29 23:28:25.821039 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:25.820307 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" event={"ID":"55084dd3-2a7c-4cc3-a302-67f9eb258336","Type":"ContainerStarted","Data":"4debafd71912e919469ef8350dbfc80d98b530a9a88cf5d1c064721387cbacff"} Oct 29 23:28:25.821039 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:25.820376 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" event={"ID":"55084dd3-2a7c-4cc3-a302-67f9eb258336","Type":"ContainerStarted","Data":"ed196b77116406ca38c0c63a786d92550b607c4ecb43fe5091a4a7caa6872614"} Oct 29 23:28:25.823342 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:25.823308 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" event={"ID":"a8e651dc-428f-4cb0-95b2-513a6f325880","Type":"ContainerStarted","Data":"a57af1447da79705e7b023ec103bc270a734b88c84144df2b1500e51dcc970af"} Oct 29 23:28:25.823342 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:25.823365 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" event={"ID":"a8e651dc-428f-4cb0-95b2-513a6f325880","Type":"ContainerStarted","Data":"e41045917480571d02fccdcba675b03b30d3f35c7863ee0c71c637eff1c2b6ff"} Oct 29 23:28:25.872509 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:25.872441 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" podStartSLOduration=1.8724195620000001 podStartE2EDuration="1.872419562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:28:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:28:25.868462044 +0000 UTC m=+872.594712638" watchObservedRunningTime="2026-10-29 23:28:25.872419562 +0000 UTC m=+872.598670145" Oct 29 23:28:25.919207 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:25.919138 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" podStartSLOduration=1.919117023 podStartE2EDuration="1.919117023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:28:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:28:25.916408122 +0000 UTC m=+872.642658755" watchObservedRunningTime="2026-10-29 23:28:25.919117023 +0000 UTC m=+872.645367616" Oct 29 23:28:26.199766 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:26.199651 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:26.202072 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:26.202029 6029 patch_prober.go:29] interesting pod/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body= Oct 29 23:28:26.202258 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:26.202091 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" podUID="a8e651dc-428f-4cb0-95b2-513a6f325880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" Oct 29 23:28:26.214097 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:26.214060 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:26.225843 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:26.222802 6029 patch_prober.go:29] interesting pod/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body= Oct 29 23:28:26.225843 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:26.222882 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" podUID="55084dd3-2a7c-4cc3-a302-67f9eb258336" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" Oct 29 23:28:27.199926 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:27.199579 6029 patch_prober.go:29] interesting pod/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body= Oct 29 23:28:27.199926 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:27.199636 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" podUID="a8e651dc-428f-4cb0-95b2-513a6f325880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" Oct 29 23:28:27.213747 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:27.213695 6029 patch_prober.go:29] interesting pod/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body= Oct 29 23:28:27.213921 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:27.213762 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" podUID="55084dd3-2a7c-4cc3-a302-67f9eb258336" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" Oct 29 23:28:28.200218 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:28.200179 6029 patch_prober.go:29] interesting pod/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body= Oct 29 23:28:28.200629 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:28.200241 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" podUID="a8e651dc-428f-4cb0-95b2-513a6f325880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" Oct 29 23:28:28.213774 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:28.213744 6029 patch_prober.go:29] interesting pod/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body= Oct 29 23:28:28.213921 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:28.213851 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" podUID="55084dd3-2a7c-4cc3-a302-67f9eb258336" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" Oct 29 23:28:28.682600 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:28.682562 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:28.695791 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:28.695760 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:28.906689 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:28.906664 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:28:29.200172 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:29.200143 6029 patch_prober.go:29] interesting pod/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body= Oct 29 23:28:29.200405 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:29.200385 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" podUID="a8e651dc-428f-4cb0-95b2-513a6f325880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" Oct 29 23:28:29.214457 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:29.214428 6029 patch_prober.go:29] interesting pod/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body= Oct 29 23:28:29.214593 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:29.214480 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" podUID="55084dd3-2a7c-4cc3-a302-67f9eb258336" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" Oct 29 23:28:30.199881 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:30.199848 6029 patch_prober.go:29] interesting pod/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body= Oct 29 23:28:30.200067 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:30.199899 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" podUID="a8e651dc-428f-4cb0-95b2-513a6f325880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" Oct 29 23:28:30.214489 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:30.214458 6029 patch_prober.go:29] interesting pod/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body= Oct 29 23:28:30.214883 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:30.214508 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" podUID="55084dd3-2a7c-4cc3-a302-67f9eb258336" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" Oct 29 23:28:31.200114 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:31.200084 6029 patch_prober.go:29] interesting pod/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body= Oct 29 23:28:31.200425 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:31.200401 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" podUID="a8e651dc-428f-4cb0-95b2-513a6f325880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" Oct 29 23:28:31.213681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:31.213655 6029 patch_prober.go:29] interesting pod/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body= Oct 29 23:28:31.213911 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:31.213891 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" podUID="55084dd3-2a7c-4cc3-a302-67f9eb258336" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" Oct 29 23:28:32.200066 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:32.200027 6029 patch_prober.go:29] interesting pod/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body= Oct 29 23:28:32.200572 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:32.200096 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" podUID="a8e651dc-428f-4cb0-95b2-513a6f325880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" Oct 29 23:28:32.214066 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:32.214028 6029 patch_prober.go:29] interesting pod/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body= Oct 29 23:28:32.214254 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:32.214094 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" podUID="55084dd3-2a7c-4cc3-a302-67f9eb258336" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" Oct 29 23:28:33.370059 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:33.369221 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:33.370805 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:33.370721 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:33.372165 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:33.372141 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:28:33.591945 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:33.591889 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:33.592723 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:33.592699 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:33.601642 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:33.599896 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:28:38.926858 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:28:38.923352 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:28:54.429637 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.429601 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn"] Oct 29 23:28:54.435601 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.435578 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.456974 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.456947 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz"] Oct 29 23:28:54.461165 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.461140 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.473227 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.473201 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn"] Oct 29 23:28:54.486659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.486632 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz"] Oct 29 23:28:54.596777 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.596742 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-envoy\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.596777 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.596784 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-podinfo\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.597002 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.596834 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-podinfo\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.597002 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.596858 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-credential-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.597002 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.596880 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-data\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.597002 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.596906 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istiod-ca-cert\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.597002 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.596956 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-workload-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.597002 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.596995 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-workload-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.597198 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.597020 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx"] Oct 29 23:28:54.597198 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.597035 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d47qt\" (UniqueName: \"kubernetes.io/projected/1060b6c4-b5ad-4297-98a2-c2a241ed9186-kube-api-access-d47qt\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.597198 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.597074 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-token\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.597198 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.597097 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-envoy\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.597198 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.597125 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-data\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.597198 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.597156 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-workload-certs\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.597198 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.597171 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d32e3f33-6877-4d39-924b-746ea13ab6c5-istiod-ca-cert\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.597198 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.597198 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdhzh\" (UniqueName: \"kubernetes.io/projected/d32e3f33-6877-4d39-924b-746ea13ab6c5-kube-api-access-zdhzh\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.597451 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.597213 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-credential-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.597451 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.597238 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-workload-certs\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.597451 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.597279 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-token\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.601166 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.601146 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.684895 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.681191 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx"] Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.700982 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-workload-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.701040 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-workload-certs\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.701104 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d47qt\" (UniqueName: \"kubernetes.io/projected/1060b6c4-b5ad-4297-98a2-c2a241ed9186-kube-api-access-d47qt\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.701138 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-workload-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.701191 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-podinfo\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.701224 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-token\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.701264 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-envoy\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.701314 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-data\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.701340 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-token\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.701392 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-workload-certs\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.701418 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d32e3f33-6877-4d39-924b-746ea13ab6c5-istiod-ca-cert\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.701458 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdhzh\" (UniqueName: \"kubernetes.io/projected/d32e3f33-6877-4d39-924b-746ea13ab6c5-kube-api-access-zdhzh\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.701485 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-credential-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.701518 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tl48\" (UniqueName: \"kubernetes.io/projected/adf4cd4e-959b-4d9b-983d-19dcc6122050-kube-api-access-4tl48\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.701556 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-workload-certs\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.701625 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-token\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.701656 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-envoy\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.701694 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-podinfo\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.701761 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-podinfo\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.701798 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-credential-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.701841 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-data\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.701884 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-data\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.701926 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adf4cd4e-959b-4d9b-983d-19dcc6122050-istiod-ca-cert\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.701956 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istiod-ca-cert\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.702024 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-workload-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.702049 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-credential-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.702082 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-envoy\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.702611 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-workload-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.704123 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-data\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.704467 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-credential-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.705020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.704499 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-data\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.706864 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.706127 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d32e3f33-6877-4d39-924b-746ea13ab6c5-istiod-ca-cert\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.706864 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.706328 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-workload-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.706864 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.706476 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-workload-certs\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.710499 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.709284 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istiod-ca-cert\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.710499 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.710455 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-podinfo\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.725539 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.725228 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-credential-socket\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.725539 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.725247 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-workload-certs\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.728438 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.728392 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-token\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.729473 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.729448 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d47qt\" (UniqueName: \"kubernetes.io/projected/1060b6c4-b5ad-4297-98a2-c2a241ed9186-kube-api-access-d47qt\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.730357 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.730332 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-token\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.731386 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.731361 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdhzh\" (UniqueName: \"kubernetes.io/projected/d32e3f33-6877-4d39-924b-746ea13ab6c5-kube-api-access-zdhzh\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.732251 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.732227 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-envoy\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.732417 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.732400 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-podinfo\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.733495 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.733469 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-envoy\") pod \"e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.749990 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.749962 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:54.783094 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.783055 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:54.803415 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.803268 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tl48\" (UniqueName: \"kubernetes.io/projected/adf4cd4e-959b-4d9b-983d-19dcc6122050-kube-api-access-4tl48\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.803793 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.803765 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-data\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.804374 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.804350 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-data\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.804639 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.804583 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adf4cd4e-959b-4d9b-983d-19dcc6122050-istiod-ca-cert\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.804930 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.804907 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-credential-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.805016 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.804949 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-envoy\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.805080 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.805016 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-workload-certs\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.805133 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.805085 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-workload-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.805183 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.805142 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-podinfo\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.805246 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.805210 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-token\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.805301 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.805258 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adf4cd4e-959b-4d9b-983d-19dcc6122050-istiod-ca-cert\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.805619 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.805595 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-workload-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.805863 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.805840 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-workload-certs\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.805997 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.805890 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-credential-socket\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.808084 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.808059 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-envoy\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.808346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.808325 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-podinfo\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.849695 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.843660 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tl48\" (UniqueName: \"kubernetes.io/projected/adf4cd4e-959b-4d9b-983d-19dcc6122050-kube-api-access-4tl48\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.849695 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.846544 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-token\") pod \"e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:54.917552 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:54.917522 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:55.079905 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:28:55.079875 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1060b6c4_b5ad_4297_98a2_c2a241ed9186.slice/crio-2e1704a82f04b258d8c7992869b2741795b0fa4f2b9b2c8f68295de75e67ed78 WatchSource:0}: Error finding container 2e1704a82f04b258d8c7992869b2741795b0fa4f2b9b2c8f68295de75e67ed78: Status 404 returned error can't find the container with id 2e1704a82f04b258d8c7992869b2741795b0fa4f2b9b2c8f68295de75e67ed78 Oct 29 23:28:55.081557 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:55.081530 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn"] Oct 29 23:28:55.082801 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:55.082769 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:28:55.082909 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:55.082851 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:28:55.082909 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:55.082883 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:28:55.123026 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:55.119331 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz"] Oct 29 23:28:55.127304 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:28:55.127272 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd32e3f33_6877_4d39_924b_746ea13ab6c5.slice/crio-52b254cb903be7fe364ad45aca5f57c4b15c3054b20cfc250e6625124c57864c WatchSource:0}: Error finding container 52b254cb903be7fe364ad45aca5f57c4b15c3054b20cfc250e6625124c57864c: Status 404 returned error can't find the container with id 52b254cb903be7fe364ad45aca5f57c4b15c3054b20cfc250e6625124c57864c Oct 29 23:28:55.131222 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:55.131184 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:28:55.131328 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:55.131280 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:28:55.131377 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:55.131332 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:28:55.234506 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:28:55.234307 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf4cd4e_959b_4d9b_983d_19dcc6122050.slice/crio-8638cc404990557f3c89b60b4a04375ea00af6c4066ddce956507203f24833bb WatchSource:0}: Error finding container 8638cc404990557f3c89b60b4a04375ea00af6c4066ddce956507203f24833bb: Status 404 returned error can't find the container with id 8638cc404990557f3c89b60b4a04375ea00af6c4066ddce956507203f24833bb Oct 29 23:28:55.235040 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:55.235004 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx"] Oct 29 23:28:55.236532 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:55.236496 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:28:55.236626 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:55.236574 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:28:55.236626 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:55.236619 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:28:55.830836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:55.829228 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" event={"ID":"adf4cd4e-959b-4d9b-983d-19dcc6122050","Type":"ContainerStarted","Data":"053786596d8647b3c507554fdb20932726372698a12e13e4500ac27c76fe4a4c"} Oct 29 23:28:55.830836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:55.829293 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" event={"ID":"adf4cd4e-959b-4d9b-983d-19dcc6122050","Type":"ContainerStarted","Data":"8638cc404990557f3c89b60b4a04375ea00af6c4066ddce956507203f24833bb"} Oct 29 23:28:55.883837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:55.883297 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" event={"ID":"d32e3f33-6877-4d39-924b-746ea13ab6c5","Type":"ContainerStarted","Data":"5df8c09a4c6523e118314923c7a05d61de19d8eef8d764618fde0afaa68acee8"} Oct 29 23:28:55.883837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:55.883369 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" event={"ID":"d32e3f33-6877-4d39-924b-746ea13ab6c5","Type":"ContainerStarted","Data":"52b254cb903be7fe364ad45aca5f57c4b15c3054b20cfc250e6625124c57864c"} Oct 29 23:28:55.917064 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:55.917017 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" event={"ID":"1060b6c4-b5ad-4297-98a2-c2a241ed9186","Type":"ContainerStarted","Data":"5ce41860106138b6dc6b331bc0ef0a71f2b704e6a00735bf46a07a363bf993c6"} Oct 29 23:28:55.917334 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:55.917313 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" event={"ID":"1060b6c4-b5ad-4297-98a2-c2a241ed9186","Type":"ContainerStarted","Data":"2e1704a82f04b258d8c7992869b2741795b0fa4f2b9b2c8f68295de75e67ed78"} Oct 29 23:28:55.918352 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:55.918327 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:28:55.975036 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:55.974916 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" podStartSLOduration=1.974890066 podStartE2EDuration="1.974890066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:28:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:28:55.913461203 +0000 UTC m=+902.639711796" watchObservedRunningTime="2026-10-29 23:28:55.974890066 +0000 UTC m=+902.701140660" Oct 29 23:28:55.997543 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:55.997473 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" podStartSLOduration=1.997450713 podStartE2EDuration="1.997450713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:28:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:28:55.990203015 +0000 UTC m=+902.716453610" watchObservedRunningTime="2026-10-29 23:28:55.997450713 +0000 UTC m=+902.723701306" Oct 29 23:28:56.068838 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:56.064708 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" podStartSLOduration=2.064681552 podStartE2EDuration="2.064681552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:28:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:28:56.055161168 +0000 UTC m=+902.781411773" watchObservedRunningTime="2026-10-29 23:28:56.064681552 +0000 UTC m=+902.790932145" Oct 29 23:28:56.804733 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:56.804698 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:28:56.817925 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:56.816038 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:28:56.817925 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:56.815877 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body= Oct 29 23:28:56.817925 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:56.816127 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" podUID="1060b6c4-b5ad-4297-98a2-c2a241ed9186" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" Oct 29 23:28:56.817925 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:56.817113 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body= Oct 29 23:28:56.817925 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:56.817164 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" podUID="d32e3f33-6877-4d39-924b-746ea13ab6c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" Oct 29 23:28:56.919090 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:56.919062 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body= Oct 29 23:28:56.919518 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:56.919108 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" podUID="adf4cd4e-959b-4d9b-983d-19dcc6122050" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" Oct 29 23:28:57.754300 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:57.754264 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body= Oct 29 23:28:57.755665 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:57.755632 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" podUID="1060b6c4-b5ad-4297-98a2-c2a241ed9186" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" Oct 29 23:28:57.784222 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:57.784186 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body= Oct 29 23:28:57.794891 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:57.794852 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" podUID="d32e3f33-6877-4d39-924b-746ea13ab6c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" Oct 29 23:28:57.930839 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:57.922194 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body= Oct 29 23:28:57.930839 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:57.922273 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" podUID="adf4cd4e-959b-4d9b-983d-19dcc6122050" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" Oct 29 23:28:58.763841 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:58.761268 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body= Oct 29 23:28:58.763841 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:58.761336 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" podUID="1060b6c4-b5ad-4297-98a2-c2a241ed9186" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" Oct 29 23:28:58.784370 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:58.784335 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body= Oct 29 23:28:58.784670 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:58.784625 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" podUID="d32e3f33-6877-4d39-924b-746ea13ab6c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" Oct 29 23:28:58.919360 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:58.918771 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body= Oct 29 23:28:58.919360 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:58.918849 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" podUID="adf4cd4e-959b-4d9b-983d-19dcc6122050" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" Oct 29 23:28:59.752321 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:59.752281 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body= Oct 29 23:28:59.752952 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:59.752919 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" podUID="1060b6c4-b5ad-4297-98a2-c2a241ed9186" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" Oct 29 23:28:59.787284 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:59.787247 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body= Oct 29 23:28:59.787561 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:59.787533 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" podUID="d32e3f33-6877-4d39-924b-746ea13ab6c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" Oct 29 23:28:59.927840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:59.919274 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body= Oct 29 23:28:59.927840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:28:59.919338 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" podUID="adf4cd4e-959b-4d9b-983d-19dcc6122050" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" Oct 29 23:29:00.758840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:00.756024 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body= Oct 29 23:29:00.758840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:00.756082 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" podUID="1060b6c4-b5ad-4297-98a2-c2a241ed9186" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" Oct 29 23:29:00.788837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:00.787992 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body= Oct 29 23:29:00.788837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:00.788053 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" podUID="d32e3f33-6877-4d39-924b-746ea13ab6c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" Oct 29 23:29:00.920405 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:00.920357 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body= Oct 29 23:29:00.920599 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:00.920425 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" podUID="adf4cd4e-959b-4d9b-983d-19dcc6122050" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" Oct 29 23:29:01.751586 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:01.751544 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body= Oct 29 23:29:01.751783 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:01.751610 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" podUID="1060b6c4-b5ad-4297-98a2-c2a241ed9186" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" Oct 29 23:29:01.784683 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:01.784647 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body= Oct 29 23:29:01.785078 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:01.784715 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" podUID="d32e3f33-6877-4d39-924b-746ea13ab6c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" Oct 29 23:29:01.918919 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:01.918882 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body= Oct 29 23:29:01.919087 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:01.918948 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" podUID="adf4cd4e-959b-4d9b-983d-19dcc6122050" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" Oct 29 23:29:03.439370 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:03.439338 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:29:03.443735 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:03.441421 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:29:03.446692 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:03.446663 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:29:03.466840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:03.466748 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:29:03.468740 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:03.468400 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:29:03.476323 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:03.476293 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:29:03.528849 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:03.527692 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:29:03.530885 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:03.529265 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:29:03.531614 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:03.531594 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:29:09.673885 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:29:09.667021 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:29:09.733841 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:09.733626 6029 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" podUID="d5e267ab-8b18-469a-a986-78beb7b635fa" containerName="main" probeResult="failure" output="Get \"https://10.134.0.81:8000/health\": context deadline exceeded" Oct 29 23:29:09.990067 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:09.989954 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" podUID="d5e267ab-8b18-469a-a986-78beb7b635fa" containerName="main" probeResult="failure" output="Get \"https://10.134.0.81:8000/ready\": context deadline exceeded" Oct 29 23:29:10.331842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:10.305905 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx"] Oct 29 23:29:10.358841 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:10.335354 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:10.428842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:10.404611 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5"] Oct 29 23:29:10.915877 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:10.827803 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-istio-envoy\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:10.915877 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:10.906571 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1768326-83dd-4203-a9ba-a855c88d5874-istio-podinfo\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:10.915877 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:10.906643 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-credential-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:10.915877 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:10.906762 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1768326-83dd-4203-a9ba-a855c88d5874-istio-token\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:10.915877 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:10.906870 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1768326-83dd-4203-a9ba-a855c88d5874-istiod-ca-cert\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:10.915877 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:10.906993 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s678j\" (UniqueName: \"kubernetes.io/projected/c1768326-83dd-4203-a9ba-a855c88d5874-kube-api-access-s678j\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:10.915877 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:10.907120 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-istio-data\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:10.915877 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:10.907173 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-workload-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:10.915877 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:10.907234 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-workload-certs\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:11.011979 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:10.991692 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx"] Oct 29 23:29:11.011979 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:10.991745 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5"] Oct 29 23:29:11.011979 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:10.991869 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.052289 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.052240 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1768326-83dd-4203-a9ba-a855c88d5874-istiod-ca-cert\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:11.052652 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.052622 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s678j\" (UniqueName: \"kubernetes.io/projected/c1768326-83dd-4203-a9ba-a855c88d5874-kube-api-access-s678j\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:11.052916 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.052893 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-istio-data\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:11.053067 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.053051 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-workload-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:11.053202 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.053188 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-workload-certs\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:11.053344 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.053325 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-istio-envoy\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:11.053510 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.053495 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1768326-83dd-4203-a9ba-a855c88d5874-istio-podinfo\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:11.053864 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.053845 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-credential-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:11.054271 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.054251 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1768326-83dd-4203-a9ba-a855c88d5874-istio-token\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:11.063846 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.059106 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-credential-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:11.088842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.065804 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-istio-data\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:11.088842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.066511 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1768326-83dd-4203-a9ba-a855c88d5874-istiod-ca-cert\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:11.088842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.066777 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-workload-certs\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:11.088842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.081137 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-workload-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:11.179589 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.179499 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-istio-envoy\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:11.198585 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.198542 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1768326-83dd-4203-a9ba-a855c88d5874-istio-podinfo\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:11.202209 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.202174 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-envoy\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.293978 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.293940 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-token\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.294332 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.294311 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-data\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.294554 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.294535 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-credential-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.294728 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.294711 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b4sc\" (UniqueName: \"kubernetes.io/projected/3cd04199-f906-4d0f-a0c6-4d45c20208bf-kube-api-access-8b4sc\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.294970 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.294950 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-workload-certs\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.295206 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.295187 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-podinfo\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.295558 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.295539 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istiod-ca-cert\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.299045 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.299013 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-workload-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.299471 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.299226 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6"] Oct 29 23:29:11.299691 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.257636 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s678j\" (UniqueName: \"kubernetes.io/projected/c1768326-83dd-4203-a9ba-a855c88d5874-kube-api-access-s678j\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:11.315184 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.315147 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.351700 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.351663 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6"] Oct 29 23:29:11.439904 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.416486 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1768326-83dd-4203-a9ba-a855c88d5874-istio-token\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:11.481842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.451695 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-data\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.481842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.451766 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-credential-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.481842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.451800 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b4sc\" (UniqueName: \"kubernetes.io/projected/3cd04199-f906-4d0f-a0c6-4d45c20208bf-kube-api-access-8b4sc\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.481842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.451888 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-workload-certs\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.481842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.451955 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-podinfo\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.481842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.452130 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istiod-ca-cert\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.481842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.452181 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-workload-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.481842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.452246 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-envoy\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.481842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.452278 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-token\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.481842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.452724 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:11.481842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.469493 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-workload-certs\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.481842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.470153 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-data\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.481842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.470410 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-credential-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.481842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.471048 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-workload-socket\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.507841 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.502708 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istiod-ca-cert\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.616392 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.565278 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-credential-socket\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.616392 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.565350 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-data\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.616392 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.565406 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istiod-ca-cert\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.616392 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.565496 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-workload-socket\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.616392 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.565524 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-token\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.616392 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.565626 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnbtz\" (UniqueName: \"kubernetes.io/projected/245515db-5ab4-46a3-a45b-2bd8c4b1bade-kube-api-access-wnbtz\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.616392 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.565662 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-envoy\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.616392 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.565717 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-podinfo\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.616392 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.577304 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-workload-certs\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.616392 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.587378 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-envoy\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:11.805966 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.693834 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-workload-socket\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.805966 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.693892 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-token\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.805966 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.693995 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnbtz\" (UniqueName: \"kubernetes.io/projected/245515db-5ab4-46a3-a45b-2bd8c4b1bade-kube-api-access-wnbtz\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.805966 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.694030 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-envoy\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.805966 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.694084 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-podinfo\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.805966 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.694180 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-workload-certs\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.805966 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.694323 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-credential-socket\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.805966 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.694372 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-data\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.805966 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.694421 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istiod-ca-cert\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.805966 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.695441 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istiod-ca-cert\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.805966 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.695743 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-workload-socket\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.805966 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.716384 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-workload-certs\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.805966 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.737582 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-credential-socket\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.805966 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.737990 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-data\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.823896 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.822488 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-podinfo\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:11.918717 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:11.918681 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b4sc\" (UniqueName: \"kubernetes.io/projected/3cd04199-f906-4d0f-a0c6-4d45c20208bf-kube-api-access-8b4sc\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:12.033854 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:12.026268 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" podUID="d5e267ab-8b18-469a-a986-78beb7b635fa" containerName="main" probeResult="failure" output="Get \"https://10.134.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 29 23:29:12.457449 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:29:12.457411 6029 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.067s" Oct 29 23:29:12.858330 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:12.858299 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnbtz\" (UniqueName: \"kubernetes.io/projected/245515db-5ab4-46a3-a45b-2bd8c4b1bade-kube-api-access-wnbtz\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:12.866841 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:12.858830 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-envoy\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:13.005538 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:12.877880 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-token\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:13.006118 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:12.880672 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-podinfo\") pod \"e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:13.033371 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:13.019870 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-token\") pod \"e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:13.212892 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:13.212497 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:13.216770 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:13.216743 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:13.521740 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:13.521702 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:29:13.521883 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:13.521800 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:29:13.521883 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:13.521873 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:29:13.522280 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:13.522252 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx"] Oct 29 23:29:13.721443 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:13.721410 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6"] Oct 29 23:29:13.723353 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:29:13.723324 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod245515db_5ab4_46a3_a45b_2bd8c4b1bade.slice/crio-efaa28ec4a32b85610f7ac494009c889f8e48d3f4d98301eac06b75acc971deb WatchSource:0}: Error finding container efaa28ec4a32b85610f7ac494009c889f8e48d3f4d98301eac06b75acc971deb: Status 404 returned error can't find the container with id efaa28ec4a32b85610f7ac494009c889f8e48d3f4d98301eac06b75acc971deb Oct 29 23:29:13.726577 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:13.726538 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:29:13.726673 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:13.726612 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:29:13.726673 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:13.726643 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:29:13.737479 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:13.737456 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5"] Oct 29 23:29:13.741571 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:29:13.741546 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cd04199_f906_4d0f_a0c6_4d45c20208bf.slice/crio-2b141653c4a1865cda7001a01e9687370a8e2fdf1ae4e560129d35b3e19e8489 WatchSource:0}: Error finding container 2b141653c4a1865cda7001a01e9687370a8e2fdf1ae4e560129d35b3e19e8489: Status 404 returned error can't find the container with id 2b141653c4a1865cda7001a01e9687370a8e2fdf1ae4e560129d35b3e19e8489 Oct 29 23:29:13.745079 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:13.745039 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:29:13.745213 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:13.745131 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:29:13.745213 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:13.745177 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:29:14.431117 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:14.430143 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" event={"ID":"3cd04199-f906-4d0f-a0c6-4d45c20208bf","Type":"ContainerStarted","Data":"fe55643ea926cd29f10da9d7b518418a185d7444ae318139e9183d4323f1127c"} Oct 29 23:29:14.431117 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:14.430210 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" event={"ID":"3cd04199-f906-4d0f-a0c6-4d45c20208bf","Type":"ContainerStarted","Data":"2b141653c4a1865cda7001a01e9687370a8e2fdf1ae4e560129d35b3e19e8489"} Oct 29 23:29:14.434466 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:14.434433 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" event={"ID":"c1768326-83dd-4203-a9ba-a855c88d5874","Type":"ContainerStarted","Data":"8013c9a5a776c5f092d536f3900dfdccc035216af7b3762e9acaa43ff06e429a"} Oct 29 23:29:14.434683 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:14.434666 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" event={"ID":"c1768326-83dd-4203-a9ba-a855c88d5874","Type":"ContainerStarted","Data":"8b82109cadd66582305a99654e2dd4ff3eecbe7686cd4ae4af3c46e5ddc5a870"} Oct 29 23:29:14.437843 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:14.437802 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" event={"ID":"245515db-5ab4-46a3-a45b-2bd8c4b1bade","Type":"ContainerStarted","Data":"ae268cc0411a7a652ed15c092815b314fd76fa850029ac54a376638f9d28d0aa"} Oct 29 23:29:14.438023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:14.438008 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" event={"ID":"245515db-5ab4-46a3-a45b-2bd8c4b1bade","Type":"ContainerStarted","Data":"efaa28ec4a32b85610f7ac494009c889f8e48d3f4d98301eac06b75acc971deb"} Oct 29 23:29:14.507126 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:14.506681 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:14.507126 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:14.506827 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body= Oct 29 23:29:14.507126 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:14.506870 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" podUID="c1768326-83dd-4203-a9ba-a855c88d5874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" Oct 29 23:29:14.533839 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:14.529730 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" podStartSLOduration=4.529709825 podStartE2EDuration="4.529709825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:29:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:29:14.50495006 +0000 UTC m=+921.231200682" watchObservedRunningTime="2026-10-29 23:29:14.529709825 +0000 UTC m=+921.255960420" Oct 29 23:29:14.953840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:14.949346 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" podStartSLOduration=4.949322579 podStartE2EDuration="4.949322579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:29:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:29:14.794487639 +0000 UTC m=+921.520738232" watchObservedRunningTime="2026-10-29 23:29:14.949322579 +0000 UTC m=+921.675573176" Oct 29 23:29:14.953840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:14.950025 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" podStartSLOduration=4.950006794 podStartE2EDuration="4.950006794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:29:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:29:14.579623928 +0000 UTC m=+921.305874557" watchObservedRunningTime="2026-10-29 23:29:14.950006794 +0000 UTC m=+921.676257386" Oct 29 23:29:15.226902 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:15.224201 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:15.226902 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:15.224343 6029 patch_prober.go:29] interesting pod/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body= Oct 29 23:29:15.226902 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:15.224385 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" podUID="245515db-5ab4-46a3-a45b-2bd8c4b1bade" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" Oct 29 23:29:15.245850 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:15.244108 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:15.291852 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:15.290129 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body= Oct 29 23:29:15.291852 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:15.290188 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" podUID="3cd04199-f906-4d0f-a0c6-4d45c20208bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" Oct 29 23:29:15.734995 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:15.730299 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body= Oct 29 23:29:15.734995 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:15.730355 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" podUID="c1768326-83dd-4203-a9ba-a855c88d5874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" Oct 29 23:29:15.928848 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:15.926834 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" podUID="d5e267ab-8b18-469a-a986-78beb7b635fa" containerName="main" probeResult="failure" output="Get \"https://10.134.0.81:8000/ready\": context deadline exceeded" Oct 29 23:29:16.278108 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:16.217439 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body= Oct 29 23:29:16.278108 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:16.217519 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" podUID="3cd04199-f906-4d0f-a0c6-4d45c20208bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" Oct 29 23:29:16.278108 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:16.231201 6029 patch_prober.go:29] interesting pod/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body= Oct 29 23:29:16.278108 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:16.231259 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" podUID="245515db-5ab4-46a3-a45b-2bd8c4b1bade" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" Oct 29 23:29:16.508841 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:16.505680 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body= Oct 29 23:29:16.508841 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:16.505744 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" podUID="c1768326-83dd-4203-a9ba-a855c88d5874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" Oct 29 23:29:17.321856 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:17.319785 6029 patch_prober.go:29] interesting pod/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body= Oct 29 23:29:17.321856 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:17.319868 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" podUID="245515db-5ab4-46a3-a45b-2bd8c4b1bade" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" Oct 29 23:29:17.375839 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:17.358321 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body= Oct 29 23:29:17.375839 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:17.358386 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" podUID="3cd04199-f906-4d0f-a0c6-4d45c20208bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" Oct 29 23:29:17.538576 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:17.538516 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body= Oct 29 23:29:17.561176 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:17.561131 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" podUID="c1768326-83dd-4203-a9ba-a855c88d5874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" Oct 29 23:29:18.226719 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:18.226674 6029 patch_prober.go:29] interesting pod/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body= Oct 29 23:29:18.227097 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:18.227049 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" podUID="245515db-5ab4-46a3-a45b-2bd8c4b1bade" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" Oct 29 23:29:18.227397 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:18.227375 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body= Oct 29 23:29:18.227562 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:18.227542 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" podUID="3cd04199-f906-4d0f-a0c6-4d45c20208bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" Oct 29 23:29:18.504307 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:18.504271 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body= Oct 29 23:29:18.504871 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:18.504844 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" podUID="c1768326-83dd-4203-a9ba-a855c88d5874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" Oct 29 23:29:19.236871 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:19.235367 6029 patch_prober.go:29] interesting pod/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body= Oct 29 23:29:19.236871 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:19.235426 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" podUID="245515db-5ab4-46a3-a45b-2bd8c4b1bade" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" Oct 29 23:29:19.236871 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:19.236640 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body= Oct 29 23:29:19.236871 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:19.236686 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" podUID="3cd04199-f906-4d0f-a0c6-4d45c20208bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" Oct 29 23:29:19.509147 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:19.509112 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body= Oct 29 23:29:19.509746 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:19.509716 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" podUID="c1768326-83dd-4203-a9ba-a855c88d5874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" Oct 29 23:29:20.318652 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:20.318615 6029 patch_prober.go:29] interesting pod/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body= Oct 29 23:29:20.318968 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:20.318935 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" podUID="245515db-5ab4-46a3-a45b-2bd8c4b1bade" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" Oct 29 23:29:20.326853 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:20.319749 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body= Oct 29 23:29:20.327117 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:20.327088 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" podUID="3cd04199-f906-4d0f-a0c6-4d45c20208bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" Oct 29 23:29:20.510454 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:20.510417 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body= Oct 29 23:29:20.511084 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:20.511050 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" podUID="c1768326-83dd-4203-a9ba-a855c88d5874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" Oct 29 23:29:21.214933 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:21.214896 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body= Oct 29 23:29:21.215195 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:21.215166 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" podUID="3cd04199-f906-4d0f-a0c6-4d45c20208bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" Oct 29 23:29:21.217585 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:21.217533 6029 patch_prober.go:29] interesting pod/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body= Oct 29 23:29:21.217798 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:21.217624 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" podUID="245515db-5ab4-46a3-a45b-2bd8c4b1bade" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" Oct 29 23:29:21.503243 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:21.503202 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body= Oct 29 23:29:21.503459 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:21.503261 6029 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" podUID="c1768326-83dd-4203-a9ba-a855c88d5874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" Oct 29 23:29:22.492619 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:22.490619 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:22.492619 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:22.492080 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:22.496640 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:22.496618 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:29:22.560728 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:22.558586 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:22.563859 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:22.563478 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:22.569100 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:22.569042 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:29:22.685248 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:22.683127 6029 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:22.685248 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:22.684688 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:22.690638 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:22.687060 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:29:34.398360 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:34.397985 6029 patch_prober.go:29] interesting pod/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 29 23:29:34.398360 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:34.398054 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" podUID="c26dda21-42b8-4789-8658-e91d387542e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 29 23:29:34.399305 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:34.399265 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 29 23:29:34.399504 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:34.399482 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" podUID="11ac369f-a9a0-479c-b534-6227afec3635" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 29 23:29:34.696359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:34.695941 6029 patch_prober.go:29] interesting pod/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 29 23:29:34.696359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:34.696008 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" podUID="ff2c3fee-90cf-4c17-bd87-5f76e8166517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 29 23:29:34.911839 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:34.902203 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" podUID="d5e267ab-8b18-469a-a986-78beb7b635fa" containerName="main" probeResult="failure" output="Get \"https://10.134.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 29 23:29:35.959885 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:35.957936 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" podUID="d5e267ab-8b18-469a-a986-78beb7b635fa" containerName="main" probeResult="failure" output="Get \"https://10.134.0.81:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 29 23:29:35.959885 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:35.958601 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:29:36.983842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:36.973233 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" podUID="d5e267ab-8b18-469a-a986-78beb7b635fa" containerName="main" probeResult="failure" output="Get \"https://10.134.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 29 23:29:38.028276 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.028234 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" podUID="d5e267ab-8b18-469a-a986-78beb7b635fa" containerName="main" probeResult="failure" output="Get \"https://10.134.0.81:8000/ready\": context deadline exceeded" Oct 29 23:29:38.143206 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.141930 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 29 23:29:38.143206 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.142008 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" podUID="ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 29 23:29:38.167731 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.167700 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c"] Oct 29 23:29:38.290489 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.282540 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:38.303288 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.303261 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Oct 29 23:29:38.303728 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.303699 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fms52\"" Oct 29 23:29:38.395843 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.391924 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c"] Oct 29 23:29:38.424506 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.424467 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Oct 29 23:29:38.475437 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.450050 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Oct 29 23:29:38.526870 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.526837 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-jb86c\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:38.527176 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.527156 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7tmm\" (UniqueName: \"kubernetes.io/projected/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-kube-api-access-r7tmm\") pod \"istiod-openshift-gateway-7ddd9cfdc8-jb86c\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:38.527330 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.527315 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-jb86c\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:38.527452 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.527436 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-jb86c\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:38.530840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.527541 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-jb86c\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:38.546896 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.531283 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-jb86c\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:38.548563 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.548536 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-jb86c\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:38.680091 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.680047 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7tmm\" (UniqueName: \"kubernetes.io/projected/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-kube-api-access-r7tmm\") pod \"istiod-openshift-gateway-7ddd9cfdc8-jb86c\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:38.767469 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.767435 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-jb86c\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:38.768271 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.742642 6029 patch_prober.go:29] interesting pod/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 29 23:29:38.768521 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.768491 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" podUID="245515db-5ab4-46a3-a45b-2bd8c4b1bade" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 29 23:29:38.769710 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.769630 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-jb86c\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:38.769930 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.769907 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-jb86c\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:38.770084 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.770069 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-jb86c\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:38.770567 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.770548 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-jb86c\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:38.771175 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.771154 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-jb86c\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:38.771911 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.771890 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-jb86c\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:38.961353 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:38.961270 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-jb86c\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:39.065311 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:39.005987 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:29:39.132657 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:39.021572 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-jb86c\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:39.245804 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:39.156109 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-jb86c\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:39.245804 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:39.165524 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-jb86c\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:39.287943 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:39.286985 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7tmm\" (UniqueName: \"kubernetes.io/projected/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-kube-api-access-r7tmm\") pod \"istiod-openshift-gateway-7ddd9cfdc8-jb86c\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:39.307113 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:39.305534 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-jb86c\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:39.414854 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:39.414358 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:39.578004 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:29:39.577959 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:29:39.732968 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:39.732923 6029 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" podUID="d5e267ab-8b18-469a-a986-78beb7b635fa" containerName="main" probeResult="failure" output="Get \"https://10.134.0.81:8000/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 29 23:29:40.202183 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:29:40.202150 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48468ed7_2a06_4bb8_b71d_874f36e6c2e6.slice/crio-f160ed72bb2d64ba726ef0c56f5fa83bc7694f2023bdf491670d33240ba6a2aa WatchSource:0}: Error finding container f160ed72bb2d64ba726ef0c56f5fa83bc7694f2023bdf491670d33240ba6a2aa: Status 404 returned error can't find the container with id f160ed72bb2d64ba726ef0c56f5fa83bc7694f2023bdf491670d33240ba6a2aa Oct 29 23:29:40.204577 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:40.204544 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c"] Oct 29 23:29:40.205432 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:40.205392 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:29:40.205496 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:40.205474 6029 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"} Oct 29 23:29:40.917991 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:40.917937 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" event={"ID":"48468ed7-2a06-4bb8-b71d-874f36e6c2e6","Type":"ContainerStarted","Data":"45734eb8ca5183a35a4f4aa0a9bbdf1c6e8b39ade4b4928df643902389247212"} Oct 29 23:29:40.918185 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:40.918025 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:40.918185 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:40.918069 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" event={"ID":"48468ed7-2a06-4bb8-b71d-874f36e6c2e6","Type":"ContainerStarted","Data":"f160ed72bb2d64ba726ef0c56f5fa83bc7694f2023bdf491670d33240ba6a2aa"} Oct 29 23:29:40.997303 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:40.997247 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" podStartSLOduration=3.997230315 podStartE2EDuration="3.997230315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:29:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:29:40.996158954 +0000 UTC m=+947.722409546" watchObservedRunningTime="2026-10-29 23:29:40.997230315 +0000 UTC m=+947.723480907" Oct 29 23:29:41.926951 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:41.926921 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:29:53.303848 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:53.302511 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 29 23:29:53.303848 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:53.302608 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" podUID="ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 29 23:29:53.628216 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:53.628109 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 29 23:29:53.628929 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:53.628892 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" podUID="3cd04199-f906-4d0f-a0c6-4d45c20208bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 29 23:29:53.714589 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:53.714551 6029 patch_prober.go:29] interesting pod/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 29 23:29:53.720756 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:53.720714 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" podUID="c1768326-83dd-4203-a9ba-a855c88d5874" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 29 23:29:54.059902 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:54.054104 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" podUID="d5e267ab-8b18-469a-a986-78beb7b635fa" containerName="main" probeResult="failure" output="Get \"https://10.134.0.81:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 29 23:29:55.550894 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:29:55.550852 6029 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf4cd4e_959b_4d9b_983d_19dcc6122050.slice/crio-8638cc404990557f3c89b60b4a04375ea00af6c4066ddce956507203f24833bb\": RecentStats: unable to find data in memory cache]" Oct 29 23:29:56.068846 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:29:56.022937 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" podUID="d5e267ab-8b18-469a-a986-78beb7b635fa" containerName="main" probeResult="failure" output="Get \"https://10.134.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 29 23:30:05.090298 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:05.090261 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp"] Oct 29 23:30:05.090881 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:05.090550 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" podUID="8e026a2b-f88b-43eb-845a-d97e66bb8656" containerName="maas-api" containerID="cri-o://acab7eef8f9a1305db2ba48283121aa5773dbd1ed20630f855ca0c157abb4acc" gracePeriod=30 Oct 29 23:30:05.796015 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:05.795971 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" podUID="8e026a2b-f88b-43eb-845a-d97e66bb8656" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.67:8443/health\": dial tcp 10.134.0.67:8443: connect: connection refused" Oct 29 23:30:06.384065 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:06.384039 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" Oct 29 23:30:06.451987 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:06.451896 6029 generic.go:356] "Generic (PLEG): container finished" podID="8e026a2b-f88b-43eb-845a-d97e66bb8656" containerID="acab7eef8f9a1305db2ba48283121aa5773dbd1ed20630f855ca0c157abb4acc" exitCode=0 Oct 29 23:30:06.451987 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:06.451958 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" Oct 29 23:30:06.452280 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:06.451978 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" event={"ID":"8e026a2b-f88b-43eb-845a-d97e66bb8656","Type":"ContainerDied","Data":"acab7eef8f9a1305db2ba48283121aa5773dbd1ed20630f855ca0c157abb4acc"} Oct 29 23:30:06.452280 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:06.452040 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp" event={"ID":"8e026a2b-f88b-43eb-845a-d97e66bb8656","Type":"ContainerDied","Data":"a4094faf6ebe955b02afd29d002ee1454b7496ee56b0b995bb980b1a1b892562"} Oct 29 23:30:06.452280 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:06.452072 6029 scope.go:122] "RemoveContainer" containerID="acab7eef8f9a1305db2ba48283121aa5773dbd1ed20630f855ca0c157abb4acc" Oct 29 23:30:06.464744 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:06.464724 6029 scope.go:122] "RemoveContainer" containerID="acab7eef8f9a1305db2ba48283121aa5773dbd1ed20630f855ca0c157abb4acc" Oct 29 23:30:06.465131 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:30:06.465107 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acab7eef8f9a1305db2ba48283121aa5773dbd1ed20630f855ca0c157abb4acc\": container with ID starting with acab7eef8f9a1305db2ba48283121aa5773dbd1ed20630f855ca0c157abb4acc not found: ID does not exist" containerID="acab7eef8f9a1305db2ba48283121aa5773dbd1ed20630f855ca0c157abb4acc" Oct 29 23:30:06.465202 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:06.465145 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acab7eef8f9a1305db2ba48283121aa5773dbd1ed20630f855ca0c157abb4acc"} err="failed to get container status \"acab7eef8f9a1305db2ba48283121aa5773dbd1ed20630f855ca0c157abb4acc\": rpc error: code = NotFound desc = could not find container \"acab7eef8f9a1305db2ba48283121aa5773dbd1ed20630f855ca0c157abb4acc\": container with ID starting with acab7eef8f9a1305db2ba48283121aa5773dbd1ed20630f855ca0c157abb4acc not found: ID does not exist" Oct 29 23:30:06.502271 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:06.502239 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8e026a2b-f88b-43eb-845a-d97e66bb8656-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e026a2b-f88b-43eb-845a-d97e66bb8656-openshift-service-ca\") pod \"8e026a2b-f88b-43eb-845a-d97e66bb8656\" (UID: \"8e026a2b-f88b-43eb-845a-d97e66bb8656\") " Oct 29 23:30:06.502504 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:06.502393 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8e026a2b-f88b-43eb-845a-d97e66bb8656-kube-api-access-vkrxq\" (UniqueName: \"kubernetes.io/projected/8e026a2b-f88b-43eb-845a-d97e66bb8656-kube-api-access-vkrxq\") pod \"8e026a2b-f88b-43eb-845a-d97e66bb8656\" (UID: \"8e026a2b-f88b-43eb-845a-d97e66bb8656\") " Oct 29 23:30:06.502504 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:06.502474 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8e026a2b-f88b-43eb-845a-d97e66bb8656-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e026a2b-f88b-43eb-845a-d97e66bb8656-metrics-certs\") pod \"8e026a2b-f88b-43eb-845a-d97e66bb8656\" (UID: \"8e026a2b-f88b-43eb-845a-d97e66bb8656\") " Oct 29 23:30:06.502636 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:06.502559 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8e026a2b-f88b-43eb-845a-d97e66bb8656-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e026a2b-f88b-43eb-845a-d97e66bb8656-maas-api-tls\") pod \"8e026a2b-f88b-43eb-845a-d97e66bb8656\" (UID: \"8e026a2b-f88b-43eb-845a-d97e66bb8656\") " Oct 29 23:30:06.502693 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:06.502639 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e026a2b-f88b-43eb-845a-d97e66bb8656-openshift-service-ca" pod "8e026a2b-f88b-43eb-845a-d97e66bb8656" (UID: "8e026a2b-f88b-43eb-845a-d97e66bb8656"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:30:06.503760 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:06.503735 6029 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e026a2b-f88b-43eb-845a-d97e66bb8656-openshift-service-ca\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:06.505787 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:06.505761 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e026a2b-f88b-43eb-845a-d97e66bb8656-metrics-certs" pod "8e026a2b-f88b-43eb-845a-d97e66bb8656" (UID: "8e026a2b-f88b-43eb-845a-d97e66bb8656"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:30:06.505787 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:06.505777 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e026a2b-f88b-43eb-845a-d97e66bb8656-maas-api-tls" pod "8e026a2b-f88b-43eb-845a-d97e66bb8656" (UID: "8e026a2b-f88b-43eb-845a-d97e66bb8656"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:30:06.505999 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:06.505966 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e026a2b-f88b-43eb-845a-d97e66bb8656-kube-api-access-vkrxq" pod "8e026a2b-f88b-43eb-845a-d97e66bb8656" (UID: "8e026a2b-f88b-43eb-845a-d97e66bb8656"). InnerVolumeSpecName "kube-api-access-vkrxq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:06.605325 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:06.605285 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkrxq\" (UniqueName: \"kubernetes.io/projected/8e026a2b-f88b-43eb-845a-d97e66bb8656-kube-api-access-vkrxq\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:06.605325 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:06.605321 6029 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e026a2b-f88b-43eb-845a-d97e66bb8656-metrics-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:06.605325 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:06.605330 6029 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e026a2b-f88b-43eb-845a-d97e66bb8656-maas-api-tls\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:06.802516 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:06.802477 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp"] Oct 29 23:30:06.815799 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:06.815770 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-313d9c-6fb95b9fd-5bzwp"] Oct 29 23:30:07.392980 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:07.392952 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8e026a2b-f88b-43eb-845a-d97e66bb8656" path="/var/lib/kubelet/pods/8e026a2b-f88b-43eb-845a-d97e66bb8656/volumes" Oct 29 23:30:08.922769 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:30:08.922729 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:30:13.495302 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:13.495267 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l"] Oct 29 23:30:13.496131 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:13.496093 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" podUID="6bafc705-c3f4-4532-a67a-77e1536256d1" containerName="istio-proxy" containerID="cri-o://f5a894fb9c0fe8bfce96a5c104aadc4bba663a64e670b7bd5f96e066d36a80f2" gracePeriod=30 Oct 29 23:30:13.503235 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:13.503203 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8"] Oct 29 23:30:13.503555 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:13.503497 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" podUID="a8e651dc-428f-4cb0-95b2-513a6f325880" containerName="istio-proxy" containerID="cri-o://a57af1447da79705e7b023ec103bc270a734b88c84144df2b1500e51dcc970af" gracePeriod=30 Oct 29 23:30:13.510634 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:13.510602 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k"] Oct 29 23:30:13.518027 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:13.517998 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj"] Oct 29 23:30:13.518290 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:13.518241 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" podUID="55084dd3-2a7c-4cc3-a302-67f9eb258336" containerName="istio-proxy" containerID="cri-o://4debafd71912e919469ef8350dbfc80d98b530a9a88cf5d1c064721387cbacff" gracePeriod=30 Oct 29 23:30:16.977000 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:16.976938 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" podUID="d5e267ab-8b18-469a-a986-78beb7b635fa" containerName="main" probeResult="failure" output="Get \"https://10.134.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 29 23:30:17.412044 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:17.411970 6029 patch_prober.go:29] interesting pod/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 29 23:30:17.412393 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:17.412342 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" podUID="6bafc705-c3f4-4532-a67a-77e1536256d1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 29 23:30:17.991014 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:17.990868 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" podUID="d5e267ab-8b18-469a-a986-78beb7b635fa" containerName="main" probeResult="failure" output="Get \"https://10.134.0.81:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 29 23:30:18.071250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:18.071220 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:30:18.422171 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:18.422133 6029 patch_prober.go:29] interesting pod/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 29 23:30:18.422417 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:18.422389 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" podUID="a8e651dc-428f-4cb0-95b2-513a6f325880" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 29 23:30:18.595070 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:18.593887 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 29 23:30:18.595070 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:18.593963 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" podUID="6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 29 23:30:18.679176 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:18.678355 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:30:18.826859 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:18.822962 6029 patch_prober.go:29] interesting pod/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body= Oct 29 23:30:18.826859 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:18.823049 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" podUID="55084dd3-2a7c-4cc3-a302-67f9eb258336" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" Oct 29 23:30:18.842007 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:18.841941 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 29 23:30:18.842839 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:18.842774 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" podUID="219edfce-514c-4adc-aed0-c331515e9467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 29 23:30:18.940035 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:18.939842 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 29 23:30:19.020213 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:19.015908 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" podUID="7add77b8-8cb6-48a6-8e3d-dd223f76402a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 29 23:30:19.494371 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:19.494329 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 29 23:30:19.494639 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:19.494612 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" podUID="d32e3f33-6877-4d39-924b-746ea13ab6c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 29 23:30:20.193570 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.193540 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:30:20.258338 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.258291 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-workload-certs\") pod \"55084dd3-2a7c-4cc3-a302-67f9eb258336\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " Oct 29 23:30:20.258655 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.258634 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-token\" (UniqueName: \"kubernetes.io/projected/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-token\") pod \"55084dd3-2a7c-4cc3-a302-67f9eb258336\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " Oct 29 23:30:20.266983 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.266949 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-workload-socket\") pod \"55084dd3-2a7c-4cc3-a302-67f9eb258336\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " Oct 29 23:30:20.267232 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.267214 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-podinfo\") pod \"55084dd3-2a7c-4cc3-a302-67f9eb258336\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " Oct 29 23:30:20.274057 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.274025 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/55084dd3-2a7c-4cc3-a302-67f9eb258336-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55084dd3-2a7c-4cc3-a302-67f9eb258336-istiod-ca-cert\") pod \"55084dd3-2a7c-4cc3-a302-67f9eb258336\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " Oct 29 23:30:20.307180 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.307153 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-data\") pod \"55084dd3-2a7c-4cc3-a302-67f9eb258336\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " Oct 29 23:30:20.313264 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.268692 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-workload-certs" pod "55084dd3-2a7c-4cc3-a302-67f9eb258336" (UID: "55084dd3-2a7c-4cc3-a302-67f9eb258336"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:20.313264 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.312935 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-envoy\") pod \"55084dd3-2a7c-4cc3-a302-67f9eb258336\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " Oct 29 23:30:20.313264 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.312999 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/55084dd3-2a7c-4cc3-a302-67f9eb258336-kube-api-access-n2lkf\" (UniqueName: \"kubernetes.io/projected/55084dd3-2a7c-4cc3-a302-67f9eb258336-kube-api-access-n2lkf\") pod \"55084dd3-2a7c-4cc3-a302-67f9eb258336\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " Oct 29 23:30:20.313264 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.313053 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-credential-socket\") pod \"55084dd3-2a7c-4cc3-a302-67f9eb258336\" (UID: \"55084dd3-2a7c-4cc3-a302-67f9eb258336\") " Oct 29 23:30:20.313795 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.313771 6029 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-workload-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.321118 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.285585 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-workload-socket" pod "55084dd3-2a7c-4cc3-a302-67f9eb258336" (UID: "55084dd3-2a7c-4cc3-a302-67f9eb258336"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:20.321118 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.287007 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55084dd3-2a7c-4cc3-a302-67f9eb258336-istiod-ca-cert" pod "55084dd3-2a7c-4cc3-a302-67f9eb258336" (UID: "55084dd3-2a7c-4cc3-a302-67f9eb258336"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:30:20.321118 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.306943 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-podinfo" pod "55084dd3-2a7c-4cc3-a302-67f9eb258336" (UID: "55084dd3-2a7c-4cc3-a302-67f9eb258336"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:30:20.321118 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.312653 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-data" pod "55084dd3-2a7c-4cc3-a302-67f9eb258336" (UID: "55084dd3-2a7c-4cc3-a302-67f9eb258336"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:20.357836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.356977 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-credential-socket" pod "55084dd3-2a7c-4cc3-a302-67f9eb258336" (UID: "55084dd3-2a7c-4cc3-a302-67f9eb258336"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:20.406840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.379948 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-envoy" pod "55084dd3-2a7c-4cc3-a302-67f9eb258336" (UID: "55084dd3-2a7c-4cc3-a302-67f9eb258336"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:20.418619 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.418578 6029 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-workload-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.418619 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.418612 6029 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-podinfo\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.418826 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.418627 6029 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55084dd3-2a7c-4cc3-a302-67f9eb258336-istiod-ca-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.418826 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.418640 6029 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-data\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.418826 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.418654 6029 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-envoy\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.418826 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.418666 6029 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55084dd3-2a7c-4cc3-a302-67f9eb258336-credential-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.423806 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.423773 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55084dd3-2a7c-4cc3-a302-67f9eb258336-kube-api-access-n2lkf" pod "55084dd3-2a7c-4cc3-a302-67f9eb258336" (UID: "55084dd3-2a7c-4cc3-a302-67f9eb258336"). InnerVolumeSpecName "kube-api-access-n2lkf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:20.423945 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.423876 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-token" pod "55084dd3-2a7c-4cc3-a302-67f9eb258336" (UID: "55084dd3-2a7c-4cc3-a302-67f9eb258336"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:20.434601 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.434280 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:30:20.455102 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.454027 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:30:20.520628 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.520593 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-data\") pod \"a8e651dc-428f-4cb0-95b2-513a6f325880\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " Oct 29 23:30:20.521049 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.521027 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-data\") pod \"6bafc705-c3f4-4532-a67a-77e1536256d1\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " Oct 29 23:30:20.521272 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.521257 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-envoy\") pod \"6bafc705-c3f4-4532-a67a-77e1536256d1\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " Oct 29 23:30:20.521490 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.521475 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-podinfo\") pod \"6bafc705-c3f4-4532-a67a-77e1536256d1\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " Oct 29 23:30:20.521663 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.521650 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6bafc705-c3f4-4532-a67a-77e1536256d1-kube-api-access-2tbs2\" (UniqueName: \"kubernetes.io/projected/6bafc705-c3f4-4532-a67a-77e1536256d1-kube-api-access-2tbs2\") pod \"6bafc705-c3f4-4532-a67a-77e1536256d1\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " Oct 29 23:30:20.521787 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.521773 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6bafc705-c3f4-4532-a67a-77e1536256d1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bafc705-c3f4-4532-a67a-77e1536256d1-istiod-ca-cert\") pod \"6bafc705-c3f4-4532-a67a-77e1536256d1\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " Oct 29 23:30:20.521935 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.521919 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-workload-certs\") pod \"a8e651dc-428f-4cb0-95b2-513a6f325880\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " Oct 29 23:30:20.522067 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.522052 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-envoy\") pod \"a8e651dc-428f-4cb0-95b2-513a6f325880\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " Oct 29 23:30:20.522241 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.522212 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-credential-socket\") pod \"a8e651dc-428f-4cb0-95b2-513a6f325880\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " Oct 29 23:30:20.522371 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.522356 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-credential-socket\") pod \"6bafc705-c3f4-4532-a67a-77e1536256d1\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " Oct 29 23:30:20.522540 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.522514 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-podinfo\") pod \"a8e651dc-428f-4cb0-95b2-513a6f325880\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " Oct 29 23:30:20.522662 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.522650 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-token\" (UniqueName: \"kubernetes.io/projected/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-token\") pod \"a8e651dc-428f-4cb0-95b2-513a6f325880\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " Oct 29 23:30:20.522773 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.522761 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a8e651dc-428f-4cb0-95b2-513a6f325880-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8e651dc-428f-4cb0-95b2-513a6f325880-istiod-ca-cert\") pod \"a8e651dc-428f-4cb0-95b2-513a6f325880\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " Oct 29 23:30:20.522906 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.522893 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-workload-certs\") pod \"6bafc705-c3f4-4532-a67a-77e1536256d1\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " Oct 29 23:30:20.523040 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.523026 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-workload-socket\") pod \"a8e651dc-428f-4cb0-95b2-513a6f325880\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " Oct 29 23:30:20.523217 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.523189 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-token\" (UniqueName: \"kubernetes.io/projected/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-token\") pod \"6bafc705-c3f4-4532-a67a-77e1536256d1\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " Oct 29 23:30:20.523355 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.523339 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a8e651dc-428f-4cb0-95b2-513a6f325880-kube-api-access-rnmq6\" (UniqueName: \"kubernetes.io/projected/a8e651dc-428f-4cb0-95b2-513a6f325880-kube-api-access-rnmq6\") pod \"a8e651dc-428f-4cb0-95b2-513a6f325880\" (UID: \"a8e651dc-428f-4cb0-95b2-513a6f325880\") " Oct 29 23:30:20.523609 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.523594 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-workload-socket\") pod \"6bafc705-c3f4-4532-a67a-77e1536256d1\" (UID: \"6bafc705-c3f4-4532-a67a-77e1536256d1\") " Oct 29 23:30:20.524622 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.524600 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2lkf\" (UniqueName: \"kubernetes.io/projected/55084dd3-2a7c-4cc3-a302-67f9eb258336-kube-api-access-n2lkf\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.524754 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.524741 6029 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55084dd3-2a7c-4cc3-a302-67f9eb258336-istio-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.525343 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.525322 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-data" pod "a8e651dc-428f-4cb0-95b2-513a6f325880" (UID: "a8e651dc-428f-4cb0-95b2-513a6f325880"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:20.525684 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.525664 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-data" pod "6bafc705-c3f4-4532-a67a-77e1536256d1" (UID: "6bafc705-c3f4-4532-a67a-77e1536256d1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:20.528710 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.527617 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-workload-certs" pod "6bafc705-c3f4-4532-a67a-77e1536256d1" (UID: "6bafc705-c3f4-4532-a67a-77e1536256d1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:20.528710 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.527966 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8e651dc-428f-4cb0-95b2-513a6f325880-istiod-ca-cert" pod "a8e651dc-428f-4cb0-95b2-513a6f325880" (UID: "a8e651dc-428f-4cb0-95b2-513a6f325880"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:30:20.528710 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.528433 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-workload-certs" pod "a8e651dc-428f-4cb0-95b2-513a6f325880" (UID: "a8e651dc-428f-4cb0-95b2-513a6f325880"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:20.529694 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.529472 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-workload-socket" pod "6bafc705-c3f4-4532-a67a-77e1536256d1" (UID: "6bafc705-c3f4-4532-a67a-77e1536256d1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:20.530030 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.529842 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-workload-socket" pod "a8e651dc-428f-4cb0-95b2-513a6f325880" (UID: "a8e651dc-428f-4cb0-95b2-513a6f325880"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:20.530486 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.530266 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bafc705-c3f4-4532-a67a-77e1536256d1-istiod-ca-cert" pod "6bafc705-c3f4-4532-a67a-77e1536256d1" (UID: "6bafc705-c3f4-4532-a67a-77e1536256d1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:30:20.530895 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.530608 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-credential-socket" pod "a8e651dc-428f-4cb0-95b2-513a6f325880" (UID: "a8e651dc-428f-4cb0-95b2-513a6f325880"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:20.533236 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.533211 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-credential-socket" pod "6bafc705-c3f4-4532-a67a-77e1536256d1" (UID: "6bafc705-c3f4-4532-a67a-77e1536256d1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:20.539156 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.539055 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-podinfo" pod "6bafc705-c3f4-4532-a67a-77e1536256d1" (UID: "6bafc705-c3f4-4532-a67a-77e1536256d1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:30:20.539156 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.539087 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-envoy" pod "a8e651dc-428f-4cb0-95b2-513a6f325880" (UID: "a8e651dc-428f-4cb0-95b2-513a6f325880"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:20.539156 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.539128 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-envoy" pod "6bafc705-c3f4-4532-a67a-77e1536256d1" (UID: "6bafc705-c3f4-4532-a67a-77e1536256d1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:20.539558 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.539536 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-token" pod "a8e651dc-428f-4cb0-95b2-513a6f325880" (UID: "a8e651dc-428f-4cb0-95b2-513a6f325880"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:20.540013 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.539932 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-podinfo" pod "a8e651dc-428f-4cb0-95b2-513a6f325880" (UID: "a8e651dc-428f-4cb0-95b2-513a6f325880"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:30:20.540158 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.540067 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bafc705-c3f4-4532-a67a-77e1536256d1-kube-api-access-2tbs2" pod "6bafc705-c3f4-4532-a67a-77e1536256d1" (UID: "6bafc705-c3f4-4532-a67a-77e1536256d1"). InnerVolumeSpecName "kube-api-access-2tbs2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:20.540973 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.540798 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-token" pod "6bafc705-c3f4-4532-a67a-77e1536256d1" (UID: "6bafc705-c3f4-4532-a67a-77e1536256d1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:20.541460 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.541436 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8e651dc-428f-4cb0-95b2-513a6f325880-kube-api-access-rnmq6" pod "a8e651dc-428f-4cb0-95b2-513a6f325880" (UID: "a8e651dc-428f-4cb0-95b2-513a6f325880"). InnerVolumeSpecName "kube-api-access-rnmq6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:20.627269 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.627189 6029 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-podinfo\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.627504 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.627462 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tbs2\" (UniqueName: \"kubernetes.io/projected/6bafc705-c3f4-4532-a67a-77e1536256d1-kube-api-access-2tbs2\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.627504 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.627494 6029 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bafc705-c3f4-4532-a67a-77e1536256d1-istiod-ca-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.627674 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.627512 6029 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-workload-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.627674 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.627524 6029 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-envoy\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.627674 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.627536 6029 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-credential-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.627674 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.627551 6029 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-credential-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.627674 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.627566 6029 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-podinfo\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.627674 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.627579 6029 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.627674 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.627591 6029 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8e651dc-428f-4cb0-95b2-513a6f325880-istiod-ca-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.627674 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.627604 6029 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-workload-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.627674 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.627616 6029 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-workload-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.627674 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.627630 6029 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.627674 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.627644 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnmq6\" (UniqueName: \"kubernetes.io/projected/a8e651dc-428f-4cb0-95b2-513a6f325880-kube-api-access-rnmq6\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.627674 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.627657 6029 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-workload-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.627674 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.627670 6029 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8e651dc-428f-4cb0-95b2-513a6f325880-istio-data\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.628141 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.627685 6029 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-data\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.628141 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.627696 6029 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bafc705-c3f4-4532-a67a-77e1536256d1-istio-envoy\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:20.677690 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.677654 6029 generic.go:356] "Generic (PLEG): container finished" podID="55084dd3-2a7c-4cc3-a302-67f9eb258336" containerID="4debafd71912e919469ef8350dbfc80d98b530a9a88cf5d1c064721387cbacff" exitCode=0 Oct 29 23:30:20.677888 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.677699 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" Oct 29 23:30:20.677888 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.677734 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" event={"ID":"55084dd3-2a7c-4cc3-a302-67f9eb258336","Type":"ContainerDied","Data":"4debafd71912e919469ef8350dbfc80d98b530a9a88cf5d1c064721387cbacff"} Oct 29 23:30:20.677888 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.677791 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj" event={"ID":"55084dd3-2a7c-4cc3-a302-67f9eb258336","Type":"ContainerDied","Data":"ed196b77116406ca38c0c63a786d92550b607c4ecb43fe5091a4a7caa6872614"} Oct 29 23:30:20.677888 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.677829 6029 scope.go:122] "RemoveContainer" containerID="4debafd71912e919469ef8350dbfc80d98b530a9a88cf5d1c064721387cbacff" Oct 29 23:30:20.681492 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.681468 6029 generic.go:356] "Generic (PLEG): container finished" podID="6bafc705-c3f4-4532-a67a-77e1536256d1" containerID="f5a894fb9c0fe8bfce96a5c104aadc4bba663a64e670b7bd5f96e066d36a80f2" exitCode=0 Oct 29 23:30:20.681626 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.681545 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" Oct 29 23:30:20.681626 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.681568 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" event={"ID":"6bafc705-c3f4-4532-a67a-77e1536256d1","Type":"ContainerDied","Data":"f5a894fb9c0fe8bfce96a5c104aadc4bba663a64e670b7bd5f96e066d36a80f2"} Oct 29 23:30:20.681626 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.681612 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l" event={"ID":"6bafc705-c3f4-4532-a67a-77e1536256d1","Type":"ContainerDied","Data":"c4b404116849c4e3dcca5f058eda960ee77f16787e063cbd0446d96d5aa90efb"} Oct 29 23:30:20.693346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.692928 6029 generic.go:356] "Generic (PLEG): container finished" podID="a8e651dc-428f-4cb0-95b2-513a6f325880" containerID="a57af1447da79705e7b023ec103bc270a734b88c84144df2b1500e51dcc970af" exitCode=0 Oct 29 23:30:20.693346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.693143 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" event={"ID":"a8e651dc-428f-4cb0-95b2-513a6f325880","Type":"ContainerDied","Data":"a57af1447da79705e7b023ec103bc270a734b88c84144df2b1500e51dcc970af"} Oct 29 23:30:20.693346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.693196 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" event={"ID":"a8e651dc-428f-4cb0-95b2-513a6f325880","Type":"ContainerDied","Data":"e41045917480571d02fccdcba675b03b30d3f35c7863ee0c71c637eff1c2b6ff"} Oct 29 23:30:20.693346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.693279 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8" Oct 29 23:30:20.694559 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.694332 6029 scope.go:122] "RemoveContainer" containerID="4debafd71912e919469ef8350dbfc80d98b530a9a88cf5d1c064721387cbacff" Oct 29 23:30:20.695147 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:30:20.694676 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4debafd71912e919469ef8350dbfc80d98b530a9a88cf5d1c064721387cbacff\": container with ID starting with 4debafd71912e919469ef8350dbfc80d98b530a9a88cf5d1c064721387cbacff not found: ID does not exist" containerID="4debafd71912e919469ef8350dbfc80d98b530a9a88cf5d1c064721387cbacff" Oct 29 23:30:20.695147 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.694706 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4debafd71912e919469ef8350dbfc80d98b530a9a88cf5d1c064721387cbacff"} err="failed to get container status \"4debafd71912e919469ef8350dbfc80d98b530a9a88cf5d1c064721387cbacff\": rpc error: code = NotFound desc = could not find container \"4debafd71912e919469ef8350dbfc80d98b530a9a88cf5d1c064721387cbacff\": container with ID starting with 4debafd71912e919469ef8350dbfc80d98b530a9a88cf5d1c064721387cbacff not found: ID does not exist" Oct 29 23:30:20.695147 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.694728 6029 scope.go:122] "RemoveContainer" containerID="f5a894fb9c0fe8bfce96a5c104aadc4bba663a64e670b7bd5f96e066d36a80f2" Oct 29 23:30:20.706628 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.706608 6029 scope.go:122] "RemoveContainer" containerID="92ffb89d10b640b4b4c2036e94572010dcb11c4021611aa07aa60c82596a3ed6" Oct 29 23:30:20.716545 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.716526 6029 scope.go:122] "RemoveContainer" containerID="f5a894fb9c0fe8bfce96a5c104aadc4bba663a64e670b7bd5f96e066d36a80f2" Oct 29 23:30:20.716966 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:30:20.716942 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5a894fb9c0fe8bfce96a5c104aadc4bba663a64e670b7bd5f96e066d36a80f2\": container with ID starting with f5a894fb9c0fe8bfce96a5c104aadc4bba663a64e670b7bd5f96e066d36a80f2 not found: ID does not exist" containerID="f5a894fb9c0fe8bfce96a5c104aadc4bba663a64e670b7bd5f96e066d36a80f2" Oct 29 23:30:20.717046 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.716975 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5a894fb9c0fe8bfce96a5c104aadc4bba663a64e670b7bd5f96e066d36a80f2"} err="failed to get container status \"f5a894fb9c0fe8bfce96a5c104aadc4bba663a64e670b7bd5f96e066d36a80f2\": rpc error: code = NotFound desc = could not find container \"f5a894fb9c0fe8bfce96a5c104aadc4bba663a64e670b7bd5f96e066d36a80f2\": container with ID starting with f5a894fb9c0fe8bfce96a5c104aadc4bba663a64e670b7bd5f96e066d36a80f2 not found: ID does not exist" Oct 29 23:30:20.717046 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.716992 6029 scope.go:122] "RemoveContainer" containerID="92ffb89d10b640b4b4c2036e94572010dcb11c4021611aa07aa60c82596a3ed6" Oct 29 23:30:20.717316 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:30:20.717301 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92ffb89d10b640b4b4c2036e94572010dcb11c4021611aa07aa60c82596a3ed6\": container with ID starting with 92ffb89d10b640b4b4c2036e94572010dcb11c4021611aa07aa60c82596a3ed6 not found: ID does not exist" containerID="92ffb89d10b640b4b4c2036e94572010dcb11c4021611aa07aa60c82596a3ed6" Oct 29 23:30:20.717358 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.717323 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92ffb89d10b640b4b4c2036e94572010dcb11c4021611aa07aa60c82596a3ed6"} err="failed to get container status \"92ffb89d10b640b4b4c2036e94572010dcb11c4021611aa07aa60c82596a3ed6\": rpc error: code = NotFound desc = could not find container \"92ffb89d10b640b4b4c2036e94572010dcb11c4021611aa07aa60c82596a3ed6\": container with ID starting with 92ffb89d10b640b4b4c2036e94572010dcb11c4021611aa07aa60c82596a3ed6 not found: ID does not exist" Oct 29 23:30:20.717358 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.717338 6029 scope.go:122] "RemoveContainer" containerID="a57af1447da79705e7b023ec103bc270a734b88c84144df2b1500e51dcc970af" Oct 29 23:30:20.726774 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.726752 6029 scope.go:122] "RemoveContainer" containerID="a57af1447da79705e7b023ec103bc270a734b88c84144df2b1500e51dcc970af" Oct 29 23:30:20.727150 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:30:20.727118 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a57af1447da79705e7b023ec103bc270a734b88c84144df2b1500e51dcc970af\": container with ID starting with a57af1447da79705e7b023ec103bc270a734b88c84144df2b1500e51dcc970af not found: ID does not exist" containerID="a57af1447da79705e7b023ec103bc270a734b88c84144df2b1500e51dcc970af" Oct 29 23:30:20.727231 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.727159 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a57af1447da79705e7b023ec103bc270a734b88c84144df2b1500e51dcc970af"} err="failed to get container status \"a57af1447da79705e7b023ec103bc270a734b88c84144df2b1500e51dcc970af\": rpc error: code = NotFound desc = could not find container \"a57af1447da79705e7b023ec103bc270a734b88c84144df2b1500e51dcc970af\": container with ID starting with a57af1447da79705e7b023ec103bc270a734b88c84144df2b1500e51dcc970af not found: ID does not exist" Oct 29 23:30:20.761412 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.761376 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l"] Oct 29 23:30:20.765315 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.765287 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-f9h4l"] Oct 29 23:30:20.804603 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.804575 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj"] Oct 29 23:30:20.807863 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.807830 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-89vwj"] Oct 29 23:30:20.850166 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.850136 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8"] Oct 29 23:30:20.855438 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:20.855406 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-313d9c-openshift-default-d98bdc757-bxhm8"] Oct 29 23:30:21.391376 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:21.391338 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="55084dd3-2a7c-4cc3-a302-67f9eb258336" path="/var/lib/kubelet/pods/55084dd3-2a7c-4cc3-a302-67f9eb258336/volumes" Oct 29 23:30:21.392044 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:21.392026 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6bafc705-c3f4-4532-a67a-77e1536256d1" path="/var/lib/kubelet/pods/6bafc705-c3f4-4532-a67a-77e1536256d1/volumes" Oct 29 23:30:21.392532 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:21.392518 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a8e651dc-428f-4cb0-95b2-513a6f325880" path="/var/lib/kubelet/pods/a8e651dc-428f-4cb0-95b2-513a6f325880/volumes" Oct 29 23:30:26.600207 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:26.600169 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh"] Oct 29 23:30:26.600746 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:26.600483 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" podUID="6300192f-3f51-49b3-8889-e52171fa3e8e" containerName="maas-api" containerID="cri-o://4dcb2f6167914c10ef2725fe33469db9771d815f47cd4ef1952c5ce5d1591cc1" gracePeriod=30 Oct 29 23:30:26.745738 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:26.745703 6029 generic.go:356] "Generic (PLEG): container finished" podID="6300192f-3f51-49b3-8889-e52171fa3e8e" containerID="4dcb2f6167914c10ef2725fe33469db9771d815f47cd4ef1952c5ce5d1591cc1" exitCode=0 Oct 29 23:30:26.746012 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:26.745753 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" event={"ID":"6300192f-3f51-49b3-8889-e52171fa3e8e","Type":"ContainerDied","Data":"4dcb2f6167914c10ef2725fe33469db9771d815f47cd4ef1952c5ce5d1591cc1"} Oct 29 23:30:27.047405 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:27.047376 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" Oct 29 23:30:27.246895 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:27.241967 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6300192f-3f51-49b3-8889-e52171fa3e8e-metrics-certs\" (UniqueName: \"kubernetes.io/secret/6300192f-3f51-49b3-8889-e52171fa3e8e-metrics-certs\") pod \"6300192f-3f51-49b3-8889-e52171fa3e8e\" (UID: \"6300192f-3f51-49b3-8889-e52171fa3e8e\") " Oct 29 23:30:27.246895 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:27.242053 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6300192f-3f51-49b3-8889-e52171fa3e8e-kube-api-access-kp84d\" (UniqueName: \"kubernetes.io/projected/6300192f-3f51-49b3-8889-e52171fa3e8e-kube-api-access-kp84d\") pod \"6300192f-3f51-49b3-8889-e52171fa3e8e\" (UID: \"6300192f-3f51-49b3-8889-e52171fa3e8e\") " Oct 29 23:30:27.246895 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:27.242159 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6300192f-3f51-49b3-8889-e52171fa3e8e-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6300192f-3f51-49b3-8889-e52171fa3e8e-openshift-service-ca\") pod \"6300192f-3f51-49b3-8889-e52171fa3e8e\" (UID: \"6300192f-3f51-49b3-8889-e52171fa3e8e\") " Oct 29 23:30:27.246895 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:27.242238 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6300192f-3f51-49b3-8889-e52171fa3e8e-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6300192f-3f51-49b3-8889-e52171fa3e8e-maas-api-tls\") pod \"6300192f-3f51-49b3-8889-e52171fa3e8e\" (UID: \"6300192f-3f51-49b3-8889-e52171fa3e8e\") " Oct 29 23:30:27.268449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:27.247495 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6300192f-3f51-49b3-8889-e52171fa3e8e-maas-api-tls" pod "6300192f-3f51-49b3-8889-e52171fa3e8e" (UID: "6300192f-3f51-49b3-8889-e52171fa3e8e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:30:27.268449 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:27.252511 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6300192f-3f51-49b3-8889-e52171fa3e8e-metrics-certs" pod "6300192f-3f51-49b3-8889-e52171fa3e8e" (UID: "6300192f-3f51-49b3-8889-e52171fa3e8e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:30:27.282716 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:27.274237 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6300192f-3f51-49b3-8889-e52171fa3e8e-openshift-service-ca" pod "6300192f-3f51-49b3-8889-e52171fa3e8e" (UID: "6300192f-3f51-49b3-8889-e52171fa3e8e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:30:27.339842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:27.334787 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6300192f-3f51-49b3-8889-e52171fa3e8e-kube-api-access-kp84d" pod "6300192f-3f51-49b3-8889-e52171fa3e8e" (UID: "6300192f-3f51-49b3-8889-e52171fa3e8e"). InnerVolumeSpecName "kube-api-access-kp84d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:27.355669 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:27.346216 6029 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6300192f-3f51-49b3-8889-e52171fa3e8e-maas-api-tls\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:27.355669 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:27.346253 6029 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6300192f-3f51-49b3-8889-e52171fa3e8e-metrics-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:27.355669 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:27.346268 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kp84d\" (UniqueName: \"kubernetes.io/projected/6300192f-3f51-49b3-8889-e52171fa3e8e-kube-api-access-kp84d\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:27.355669 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:27.346288 6029 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6300192f-3f51-49b3-8889-e52171fa3e8e-openshift-service-ca\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:27.758234 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:27.758202 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" Oct 29 23:30:27.758657 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:27.758203 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh" event={"ID":"6300192f-3f51-49b3-8889-e52171fa3e8e","Type":"ContainerDied","Data":"f44f02074e8b2fa8b02db8ffcd854d60f2df3c3496395228c4780876f6a3a482"} Oct 29 23:30:27.758657 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:27.758343 6029 scope.go:122] "RemoveContainer" containerID="4dcb2f6167914c10ef2725fe33469db9771d815f47cd4ef1952c5ce5d1591cc1" Oct 29 23:30:27.827008 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:27.826866 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh"] Oct 29 23:30:27.840410 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:27.840376 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-032fa8-6fb9758f4d-qh9hh"] Oct 29 23:30:28.535769 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:28.535693 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" podUID="d5e267ab-8b18-469a-a986-78beb7b635fa" containerName="main" containerID="cri-o://3515a8f3a41d99d5afaa16e9e202af8d1ada3f9d9b78d73cf429f951e169f8ba" gracePeriod=45 Oct 29 23:30:28.771666 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:28.771637 6029 generic.go:356] "Generic (PLEG): container finished" podID="d5e267ab-8b18-469a-a986-78beb7b635fa" containerID="3515a8f3a41d99d5afaa16e9e202af8d1ada3f9d9b78d73cf429f951e169f8ba" exitCode=0 Oct 29 23:30:28.772460 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:28.771786 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" event={"ID":"d5e267ab-8b18-469a-a986-78beb7b635fa","Type":"ContainerDied","Data":"3515a8f3a41d99d5afaa16e9e202af8d1ada3f9d9b78d73cf429f951e169f8ba"} Oct 29 23:30:28.835332 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:28.835305 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:30:28.867465 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:28.867437 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-home\" (UniqueName: \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-home\") pod \"d5e267ab-8b18-469a-a986-78beb7b635fa\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " Oct 29 23:30:28.867638 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:28.867540 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d5e267ab-8b18-469a-a986-78beb7b635fa-tls-certs\" (UniqueName: \"kubernetes.io/secret/d5e267ab-8b18-469a-a986-78beb7b635fa-tls-certs\") pod \"d5e267ab-8b18-469a-a986-78beb7b635fa\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " Oct 29 23:30:28.867638 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:28.867594 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-model-cache\") pod \"d5e267ab-8b18-469a-a986-78beb7b635fa\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " Oct 29 23:30:28.868187 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:28.867641 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-dshm\") pod \"d5e267ab-8b18-469a-a986-78beb7b635fa\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " Oct 29 23:30:28.868187 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:28.867720 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-home" pod "d5e267ab-8b18-469a-a986-78beb7b635fa" (UID: "d5e267ab-8b18-469a-a986-78beb7b635fa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:28.868187 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:28.867747 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d5e267ab-8b18-469a-a986-78beb7b635fa-kube-api-access-5b44l\" (UniqueName: \"kubernetes.io/projected/d5e267ab-8b18-469a-a986-78beb7b635fa-kube-api-access-5b44l\") pod \"d5e267ab-8b18-469a-a986-78beb7b635fa\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " Oct 29 23:30:28.868187 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:28.867798 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-tmp-dir\") pod \"d5e267ab-8b18-469a-a986-78beb7b635fa\" (UID: \"d5e267ab-8b18-469a-a986-78beb7b635fa\") " Oct 29 23:30:28.868187 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:28.867928 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-model-cache" pod "d5e267ab-8b18-469a-a986-78beb7b635fa" (UID: "d5e267ab-8b18-469a-a986-78beb7b635fa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:28.868492 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:28.868201 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-tmp-dir" pod "d5e267ab-8b18-469a-a986-78beb7b635fa" (UID: "d5e267ab-8b18-469a-a986-78beb7b635fa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:28.868492 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:28.868469 6029 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-model-cache\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:28.868492 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:28.868490 6029 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-tmp-dir\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:28.868653 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:28.868503 6029 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-home\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:28.870022 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:28.869997 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-dshm" pod "d5e267ab-8b18-469a-a986-78beb7b635fa" (UID: "d5e267ab-8b18-469a-a986-78beb7b635fa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:28.870022 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:28.870010 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5e267ab-8b18-469a-a986-78beb7b635fa-tls-certs" pod "d5e267ab-8b18-469a-a986-78beb7b635fa" (UID: "d5e267ab-8b18-469a-a986-78beb7b635fa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:30:28.870179 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:28.870156 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5e267ab-8b18-469a-a986-78beb7b635fa-kube-api-access-5b44l" pod "d5e267ab-8b18-469a-a986-78beb7b635fa" (UID: "d5e267ab-8b18-469a-a986-78beb7b635fa"). InnerVolumeSpecName "kube-api-access-5b44l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:28.970515 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:28.970473 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5b44l\" (UniqueName: \"kubernetes.io/projected/d5e267ab-8b18-469a-a986-78beb7b635fa-kube-api-access-5b44l\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:28.970515 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:28.970516 6029 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5e267ab-8b18-469a-a986-78beb7b635fa-tls-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:28.970780 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:28.970531 6029 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5e267ab-8b18-469a-a986-78beb7b635fa-dshm\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:29.393938 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:29.393906 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6300192f-3f51-49b3-8889-e52171fa3e8e" path="/var/lib/kubelet/pods/6300192f-3f51-49b3-8889-e52171fa3e8e/volumes" Oct 29 23:30:29.782587 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:29.782558 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" Oct 29 23:30:29.783107 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:29.782588 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k" event={"ID":"d5e267ab-8b18-469a-a986-78beb7b635fa","Type":"ContainerDied","Data":"d7b6bc12834c8a3abf5c6bfdb3d0c73704b07ae44652281e38ba9b10f4b74980"} Oct 29 23:30:29.783107 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:29.782644 6029 scope.go:122] "RemoveContainer" containerID="3515a8f3a41d99d5afaa16e9e202af8d1ada3f9d9b78d73cf429f951e169f8ba" Oct 29 23:30:29.839403 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:29.839269 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k"] Oct 29 23:30:29.852733 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:29.852704 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-837245/distinct-2-w6-837245-kserve-7f59c99fc9-dcd5k"] Oct 29 23:30:31.391072 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:31.391037 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d5e267ab-8b18-469a-a986-78beb7b635fa" path="/var/lib/kubelet/pods/d5e267ab-8b18-469a-a986-78beb7b635fa/volumes" Oct 29 23:30:35.851366 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:35.851179 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx"] Oct 29 23:30:35.851975 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:35.851428 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" podUID="adf4cd4e-959b-4d9b-983d-19dcc6122050" containerName="istio-proxy" containerID="cri-o://053786596d8647b3c507554fdb20932726372698a12e13e4500ac27c76fe4a4c" gracePeriod=30 Oct 29 23:30:35.865936 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:35.865910 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h"] Oct 29 23:30:35.866278 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:35.866248 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" podUID="219edfce-514c-4adc-aed0-c331515e9467" containerName="istio-proxy" containerID="cri-o://d8aaae0e1d749183f788ce74b6bd3fac05ea1a0d20888200b5b0f225167b2708" gracePeriod=30 Oct 29 23:30:35.880596 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:35.880567 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl"] Oct 29 23:30:35.880807 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:35.880786 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" podUID="7add77b8-8cb6-48a6-8e3d-dd223f76402a" containerName="istio-proxy" containerID="cri-o://919004d763d6b0ae055097c3285e1874aef48ea971f564bca0b1b0de516717a7" gracePeriod=30 Oct 29 23:30:35.887349 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:35.887321 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq"] Oct 29 23:30:35.887718 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:35.887689 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" podUID="ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" containerName="istio-proxy" containerID="cri-o://c0751b3abd472846c59e1f7b0670563859d62a6be819a993dbe435d36ee7f476" gracePeriod=30 Oct 29 23:30:37.054625 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:37.053394 6029 patch_prober.go:29] interesting pod/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 29 23:30:37.054625 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:37.053459 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" podUID="ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 29 23:30:39.158230 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:30:39.158190 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:30:40.987180 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:40.987140 6029 generic.go:356] "Generic (PLEG): container finished" podID="adf4cd4e-959b-4d9b-983d-19dcc6122050" containerID="053786596d8647b3c507554fdb20932726372698a12e13e4500ac27c76fe4a4c" exitCode=0 Oct 29 23:30:40.987740 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:40.987194 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" event={"ID":"adf4cd4e-959b-4d9b-983d-19dcc6122050","Type":"ContainerDied","Data":"053786596d8647b3c507554fdb20932726372698a12e13e4500ac27c76fe4a4c"} Oct 29 23:30:41.234769 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.234736 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:30:41.259396 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.258129 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:30:41.270408 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.270370 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:30:41.280038 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.280011 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/219edfce-514c-4adc-aed0-c331515e9467-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/219edfce-514c-4adc-aed0-c331515e9467-istio-podinfo\") pod \"219edfce-514c-4adc-aed0-c331515e9467\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " Oct 29 23:30:41.280304 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.280289 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/adf4cd4e-959b-4d9b-983d-19dcc6122050-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adf4cd4e-959b-4d9b-983d-19dcc6122050-istiod-ca-cert\") pod \"adf4cd4e-959b-4d9b-983d-19dcc6122050\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " Oct 29 23:30:41.280450 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.280428 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-workload-socket\") pod \"adf4cd4e-959b-4d9b-983d-19dcc6122050\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " Oct 29 23:30:41.280566 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.280554 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-token\" (UniqueName: \"kubernetes.io/projected/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-token\") pod \"adf4cd4e-959b-4d9b-983d-19dcc6122050\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " Oct 29 23:30:41.280691 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.280680 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-credential-socket\") pod \"adf4cd4e-959b-4d9b-983d-19dcc6122050\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " Oct 29 23:30:41.280777 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.280768 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/adf4cd4e-959b-4d9b-983d-19dcc6122050-kube-api-access-4tl48\" (UniqueName: \"kubernetes.io/projected/adf4cd4e-959b-4d9b-983d-19dcc6122050-kube-api-access-4tl48\") pod \"adf4cd4e-959b-4d9b-983d-19dcc6122050\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " Oct 29 23:30:41.280871 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.280861 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-credential-socket\") pod \"219edfce-514c-4adc-aed0-c331515e9467\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " Oct 29 23:30:41.280963 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.280954 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-workload-certs\") pod \"adf4cd4e-959b-4d9b-983d-19dcc6122050\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " Oct 29 23:30:41.281087 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.281078 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/219edfce-514c-4adc-aed0-c331515e9467-kube-api-access-8jnks\" (UniqueName: \"kubernetes.io/projected/219edfce-514c-4adc-aed0-c331515e9467-kube-api-access-8jnks\") pod \"219edfce-514c-4adc-aed0-c331515e9467\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " Oct 29 23:30:41.281167 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.281158 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-data\") pod \"adf4cd4e-959b-4d9b-983d-19dcc6122050\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " Oct 29 23:30:41.281238 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.281230 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-workload-socket\") pod \"219edfce-514c-4adc-aed0-c331515e9467\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " Oct 29 23:30:41.281299 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.281291 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-istio-envoy\") pod \"219edfce-514c-4adc-aed0-c331515e9467\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " Oct 29 23:30:41.281396 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.281388 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-istio-data\") pod \"219edfce-514c-4adc-aed0-c331515e9467\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " Oct 29 23:30:41.281507 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.281499 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/219edfce-514c-4adc-aed0-c331515e9467-istio-token\" (UniqueName: \"kubernetes.io/projected/219edfce-514c-4adc-aed0-c331515e9467-istio-token\") pod \"219edfce-514c-4adc-aed0-c331515e9467\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " Oct 29 23:30:41.281623 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.281613 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-envoy\") pod \"adf4cd4e-959b-4d9b-983d-19dcc6122050\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " Oct 29 23:30:41.281696 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.281687 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-workload-certs\") pod \"219edfce-514c-4adc-aed0-c331515e9467\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " Oct 29 23:30:41.281759 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.281750 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-podinfo\") pod \"adf4cd4e-959b-4d9b-983d-19dcc6122050\" (UID: \"adf4cd4e-959b-4d9b-983d-19dcc6122050\") " Oct 29 23:30:41.281889 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.281875 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/219edfce-514c-4adc-aed0-c331515e9467-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/219edfce-514c-4adc-aed0-c331515e9467-istiod-ca-cert\") pod \"219edfce-514c-4adc-aed0-c331515e9467\" (UID: \"219edfce-514c-4adc-aed0-c331515e9467\") " Oct 29 23:30:41.283738 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.282101 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-workload-certs" pod "adf4cd4e-959b-4d9b-983d-19dcc6122050" (UID: "adf4cd4e-959b-4d9b-983d-19dcc6122050"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:41.283915 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.282727 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-istio-data" pod "219edfce-514c-4adc-aed0-c331515e9467" (UID: "219edfce-514c-4adc-aed0-c331515e9467"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:41.283989 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.282860 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-workload-socket" pod "219edfce-514c-4adc-aed0-c331515e9467" (UID: "219edfce-514c-4adc-aed0-c331515e9467"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:41.284062 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.283155 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-data" pod "adf4cd4e-959b-4d9b-983d-19dcc6122050" (UID: "adf4cd4e-959b-4d9b-983d-19dcc6122050"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:41.284164 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.283373 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-credential-socket" pod "219edfce-514c-4adc-aed0-c331515e9467" (UID: "219edfce-514c-4adc-aed0-c331515e9467"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:41.284589 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.284563 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/219edfce-514c-4adc-aed0-c331515e9467-istiod-ca-cert" pod "219edfce-514c-4adc-aed0-c331515e9467" (UID: "219edfce-514c-4adc-aed0-c331515e9467"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:30:41.284972 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.284950 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-credential-socket" pod "adf4cd4e-959b-4d9b-983d-19dcc6122050" (UID: "adf4cd4e-959b-4d9b-983d-19dcc6122050"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:41.285683 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.285666 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adf4cd4e-959b-4d9b-983d-19dcc6122050-istiod-ca-cert" pod "adf4cd4e-959b-4d9b-983d-19dcc6122050" (UID: "adf4cd4e-959b-4d9b-983d-19dcc6122050"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:30:41.286031 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.286013 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-workload-socket" pod "adf4cd4e-959b-4d9b-983d-19dcc6122050" (UID: "adf4cd4e-959b-4d9b-983d-19dcc6122050"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:41.286359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.286340 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-workload-certs" pod "219edfce-514c-4adc-aed0-c331515e9467" (UID: "219edfce-514c-4adc-aed0-c331515e9467"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:41.286541 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.286502 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-podinfo" pod "adf4cd4e-959b-4d9b-983d-19dcc6122050" (UID: "adf4cd4e-959b-4d9b-983d-19dcc6122050"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:30:41.288547 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.288522 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/219edfce-514c-4adc-aed0-c331515e9467-istio-token" pod "219edfce-514c-4adc-aed0-c331515e9467" (UID: "219edfce-514c-4adc-aed0-c331515e9467"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:41.289231 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.289207 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/219edfce-514c-4adc-aed0-c331515e9467-istio-podinfo" pod "219edfce-514c-4adc-aed0-c331515e9467" (UID: "219edfce-514c-4adc-aed0-c331515e9467"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:30:41.289329 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.289237 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/219edfce-514c-4adc-aed0-c331515e9467-kube-api-access-8jnks" pod "219edfce-514c-4adc-aed0-c331515e9467" (UID: "219edfce-514c-4adc-aed0-c331515e9467"). InnerVolumeSpecName "kube-api-access-8jnks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:41.289329 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.289321 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-envoy" pod "adf4cd4e-959b-4d9b-983d-19dcc6122050" (UID: "adf4cd4e-959b-4d9b-983d-19dcc6122050"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:41.290108 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.290077 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-token" pod "adf4cd4e-959b-4d9b-983d-19dcc6122050" (UID: "adf4cd4e-959b-4d9b-983d-19dcc6122050"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:41.291027 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.291003 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-istio-envoy" pod "219edfce-514c-4adc-aed0-c331515e9467" (UID: "219edfce-514c-4adc-aed0-c331515e9467"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:41.291622 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.291595 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adf4cd4e-959b-4d9b-983d-19dcc6122050-kube-api-access-4tl48" pod "adf4cd4e-959b-4d9b-983d-19dcc6122050" (UID: "adf4cd4e-959b-4d9b-983d-19dcc6122050"). InnerVolumeSpecName "kube-api-access-4tl48". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:41.320983 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.320948 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:30:41.384741 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.384700 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-workload-certs\") pod \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " Oct 29 23:30:41.384967 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.384751 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istiod-ca-cert\") pod \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " Oct 29 23:30:41.384967 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.384790 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-credential-socket\") pod \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " Oct 29 23:30:41.384967 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.384887 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-kube-api-access-4t8n7\" (UniqueName: \"kubernetes.io/projected/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-kube-api-access-4t8n7\") pod \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " Oct 29 23:30:41.384967 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.384923 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-data\") pod \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " Oct 29 23:30:41.385203 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.384991 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-envoy\") pod \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " Oct 29 23:30:41.385203 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.385037 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-envoy\") pod \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " Oct 29 23:30:41.385203 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.385120 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-workload-certs" pod "ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" (UID: "ee5b3e7f-2efc-4ac7-b00e-8426ea94c250"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:41.385203 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.385152 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-data\") pod \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " Oct 29 23:30:41.385203 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.385190 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istiod-ca-cert" pod "7add77b8-8cb6-48a6-8e3d-dd223f76402a" (UID: "7add77b8-8cb6-48a6-8e3d-dd223f76402a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:30:41.385203 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.385204 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-token\" (UniqueName: \"kubernetes.io/projected/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-token\") pod \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " Oct 29 23:30:41.385511 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.385245 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-podinfo\") pod \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " Oct 29 23:30:41.385511 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.385314 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-workload-certs\") pod \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " Oct 29 23:30:41.385511 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.385350 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istiod-ca-cert\") pod \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " Oct 29 23:30:41.385511 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.385427 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-workload-socket\") pod \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " Oct 29 23:30:41.385511 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.385456 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-data" pod "7add77b8-8cb6-48a6-8e3d-dd223f76402a" (UID: "7add77b8-8cb6-48a6-8e3d-dd223f76402a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:41.385755 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.385462 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7add77b8-8cb6-48a6-8e3d-dd223f76402a-kube-api-access-8mx27\" (UniqueName: \"kubernetes.io/projected/7add77b8-8cb6-48a6-8e3d-dd223f76402a-kube-api-access-8mx27\") pod \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " Oct 29 23:30:41.385755 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.385569 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-token\" (UniqueName: \"kubernetes.io/projected/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-token\") pod \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " Oct 29 23:30:41.385755 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.385650 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-podinfo\") pod \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\" (UID: \"7add77b8-8cb6-48a6-8e3d-dd223f76402a\") " Oct 29 23:30:41.385755 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.385707 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-workload-socket\") pod \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " Oct 29 23:30:41.385956 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.385762 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-credential-socket\") pod \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\" (UID: \"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250\") " Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.385511 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-credential-socket" pod "7add77b8-8cb6-48a6-8e3d-dd223f76402a" (UID: "7add77b8-8cb6-48a6-8e3d-dd223f76402a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.386376 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-workload-socket" pod "ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" (UID: "ee5b3e7f-2efc-4ac7-b00e-8426ea94c250"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.386387 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-workload-certs" pod "7add77b8-8cb6-48a6-8e3d-dd223f76402a" (UID: "7add77b8-8cb6-48a6-8e3d-dd223f76402a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.386569 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-credential-socket" pod "ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" (UID: "ee5b3e7f-2efc-4ac7-b00e-8426ea94c250"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.386499 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jnks\" (UniqueName: \"kubernetes.io/projected/219edfce-514c-4adc-aed0-c331515e9467-kube-api-access-8jnks\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.386723 6029 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-data\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.386739 6029 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-workload-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.386752 6029 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-istio-envoy\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.386763 6029 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-istio-data\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.386775 6029 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-workload-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.386792 6029 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/219edfce-514c-4adc-aed0-c331515e9467-istio-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.386829 6029 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-workload-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.386852 6029 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istiod-ca-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.386871 6029 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-envoy\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.386889 6029 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-workload-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.386906 6029 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-credential-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.386923 6029 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-podinfo\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.386941 6029 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/219edfce-514c-4adc-aed0-c331515e9467-istiod-ca-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.386959 6029 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/219edfce-514c-4adc-aed0-c331515e9467-istio-podinfo\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.386973 6029 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-data\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.386989 6029 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adf4cd4e-959b-4d9b-983d-19dcc6122050-istiod-ca-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.387003 6029 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-workload-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.387016 6029 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adf4cd4e-959b-4d9b-983d-19dcc6122050-istio-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.387028 6029 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-credential-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.387043 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tl48\" (UniqueName: \"kubernetes.io/projected/adf4cd4e-959b-4d9b-983d-19dcc6122050-kube-api-access-4tl48\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.387058 6029 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/219edfce-514c-4adc-aed0-c331515e9467-credential-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.387346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.387072 6029 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adf4cd4e-959b-4d9b-983d-19dcc6122050-workload-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.389692 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.388097 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7add77b8-8cb6-48a6-8e3d-dd223f76402a-kube-api-access-8mx27" pod "7add77b8-8cb6-48a6-8e3d-dd223f76402a" (UID: "7add77b8-8cb6-48a6-8e3d-dd223f76402a"). InnerVolumeSpecName "kube-api-access-8mx27". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:41.389692 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.388713 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istiod-ca-cert" pod "ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" (UID: "ee5b3e7f-2efc-4ac7-b00e-8426ea94c250"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:30:41.389692 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.388984 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-workload-socket" pod "7add77b8-8cb6-48a6-8e3d-dd223f76402a" (UID: "7add77b8-8cb6-48a6-8e3d-dd223f76402a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:41.389692 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.389487 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-kube-api-access-4t8n7" pod "ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" (UID: "ee5b3e7f-2efc-4ac7-b00e-8426ea94c250"). InnerVolumeSpecName "kube-api-access-4t8n7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:41.390240 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.390220 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-data" pod "ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" (UID: "ee5b3e7f-2efc-4ac7-b00e-8426ea94c250"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:41.390970 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.390931 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-podinfo" pod "ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" (UID: "ee5b3e7f-2efc-4ac7-b00e-8426ea94c250"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:30:41.391289 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.391263 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-token" pod "7add77b8-8cb6-48a6-8e3d-dd223f76402a" (UID: "7add77b8-8cb6-48a6-8e3d-dd223f76402a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:41.391870 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.391835 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-envoy" pod "7add77b8-8cb6-48a6-8e3d-dd223f76402a" (UID: "7add77b8-8cb6-48a6-8e3d-dd223f76402a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:41.392009 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.391987 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-envoy" pod "ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" (UID: "ee5b3e7f-2efc-4ac7-b00e-8426ea94c250"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:41.392532 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.392510 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-token" pod "ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" (UID: "ee5b3e7f-2efc-4ac7-b00e-8426ea94c250"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:41.392937 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.392898 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-podinfo" pod "7add77b8-8cb6-48a6-8e3d-dd223f76402a" (UID: "7add77b8-8cb6-48a6-8e3d-dd223f76402a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:30:41.488408 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.488314 6029 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-workload-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.488408 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.488351 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mx27\" (UniqueName: \"kubernetes.io/projected/7add77b8-8cb6-48a6-8e3d-dd223f76402a-kube-api-access-8mx27\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.488408 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.488370 6029 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.488408 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.488384 6029 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-podinfo\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.488408 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.488396 6029 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-credential-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.488408 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.488410 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4t8n7\" (UniqueName: \"kubernetes.io/projected/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-kube-api-access-4t8n7\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.488789 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.488424 6029 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-envoy\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.488789 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.488436 6029 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-istio-envoy\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.488789 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.488450 6029 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-data\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.488789 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.488463 6029 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.488789 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.488478 6029 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istio-podinfo\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.488789 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.488492 6029 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7add77b8-8cb6-48a6-8e3d-dd223f76402a-workload-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.488789 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.488506 6029 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250-istiod-ca-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:41.996985 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.996949 6029 generic.go:356] "Generic (PLEG): container finished" podID="ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" containerID="c0751b3abd472846c59e1f7b0670563859d62a6be819a993dbe435d36ee7f476" exitCode=0 Oct 29 23:30:41.997427 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.996997 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" Oct 29 23:30:41.997427 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.997055 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" event={"ID":"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250","Type":"ContainerDied","Data":"c0751b3abd472846c59e1f7b0670563859d62a6be819a993dbe435d36ee7f476"} Oct 29 23:30:41.997427 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.997102 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq" event={"ID":"ee5b3e7f-2efc-4ac7-b00e-8426ea94c250","Type":"ContainerDied","Data":"b4efad55b5a327b5adea4859d08ed8689334e9888b7b1e231838efd46a1e6ee7"} Oct 29 23:30:41.997427 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.997128 6029 scope.go:122] "RemoveContainer" containerID="c0751b3abd472846c59e1f7b0670563859d62a6be819a993dbe435d36ee7f476" Oct 29 23:30:41.998760 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.998735 6029 generic.go:356] "Generic (PLEG): container finished" podID="219edfce-514c-4adc-aed0-c331515e9467" containerID="d8aaae0e1d749183f788ce74b6bd3fac05ea1a0d20888200b5b0f225167b2708" exitCode=0 Oct 29 23:30:41.998848 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.998782 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" Oct 29 23:30:41.998898 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.998841 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" event={"ID":"219edfce-514c-4adc-aed0-c331515e9467","Type":"ContainerDied","Data":"d8aaae0e1d749183f788ce74b6bd3fac05ea1a0d20888200b5b0f225167b2708"} Oct 29 23:30:41.998960 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:41.998898 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h" event={"ID":"219edfce-514c-4adc-aed0-c331515e9467","Type":"ContainerDied","Data":"0d71f9393708e1e766d37a4936cdfe6a4577d5c8ec31752da14cbf6df94c279b"} Oct 29 23:30:42.000614 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.000581 6029 generic.go:356] "Generic (PLEG): container finished" podID="7add77b8-8cb6-48a6-8e3d-dd223f76402a" containerID="919004d763d6b0ae055097c3285e1874aef48ea971f564bca0b1b0de516717a7" exitCode=0 Oct 29 23:30:42.000721 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.000658 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" event={"ID":"7add77b8-8cb6-48a6-8e3d-dd223f76402a","Type":"ContainerDied","Data":"919004d763d6b0ae055097c3285e1874aef48ea971f564bca0b1b0de516717a7"} Oct 29 23:30:42.000721 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.000681 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" Oct 29 23:30:42.000721 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.000717 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl" event={"ID":"7add77b8-8cb6-48a6-8e3d-dd223f76402a","Type":"ContainerDied","Data":"305c87f671259f17dbd3384a18722a993810f4a9c4247123295bcd06e2add38b"} Oct 29 23:30:42.002381 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.002359 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" event={"ID":"adf4cd4e-959b-4d9b-983d-19dcc6122050","Type":"ContainerDied","Data":"8638cc404990557f3c89b60b4a04375ea00af6c4066ddce956507203f24833bb"} Oct 29 23:30:42.002479 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.002384 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx" Oct 29 23:30:42.009254 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.009230 6029 scope.go:122] "RemoveContainer" containerID="a248c413c68c2021e35ca9ddf330661ba8035bdc14da783f0014fa3646a012ae" Oct 29 23:30:42.019005 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.018986 6029 scope.go:122] "RemoveContainer" containerID="c0751b3abd472846c59e1f7b0670563859d62a6be819a993dbe435d36ee7f476" Oct 29 23:30:42.019293 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:30:42.019275 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0751b3abd472846c59e1f7b0670563859d62a6be819a993dbe435d36ee7f476\": container with ID starting with c0751b3abd472846c59e1f7b0670563859d62a6be819a993dbe435d36ee7f476 not found: ID does not exist" containerID="c0751b3abd472846c59e1f7b0670563859d62a6be819a993dbe435d36ee7f476" Oct 29 23:30:42.019354 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.019305 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0751b3abd472846c59e1f7b0670563859d62a6be819a993dbe435d36ee7f476"} err="failed to get container status \"c0751b3abd472846c59e1f7b0670563859d62a6be819a993dbe435d36ee7f476\": rpc error: code = NotFound desc = could not find container \"c0751b3abd472846c59e1f7b0670563859d62a6be819a993dbe435d36ee7f476\": container with ID starting with c0751b3abd472846c59e1f7b0670563859d62a6be819a993dbe435d36ee7f476 not found: ID does not exist" Oct 29 23:30:42.019354 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.019325 6029 scope.go:122] "RemoveContainer" containerID="a248c413c68c2021e35ca9ddf330661ba8035bdc14da783f0014fa3646a012ae" Oct 29 23:30:42.019580 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:30:42.019558 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a248c413c68c2021e35ca9ddf330661ba8035bdc14da783f0014fa3646a012ae\": container with ID starting with a248c413c68c2021e35ca9ddf330661ba8035bdc14da783f0014fa3646a012ae not found: ID does not exist" containerID="a248c413c68c2021e35ca9ddf330661ba8035bdc14da783f0014fa3646a012ae" Oct 29 23:30:42.019629 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.019592 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a248c413c68c2021e35ca9ddf330661ba8035bdc14da783f0014fa3646a012ae"} err="failed to get container status \"a248c413c68c2021e35ca9ddf330661ba8035bdc14da783f0014fa3646a012ae\": rpc error: code = NotFound desc = could not find container \"a248c413c68c2021e35ca9ddf330661ba8035bdc14da783f0014fa3646a012ae\": container with ID starting with a248c413c68c2021e35ca9ddf330661ba8035bdc14da783f0014fa3646a012ae not found: ID does not exist" Oct 29 23:30:42.019629 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.019614 6029 scope.go:122] "RemoveContainer" containerID="d8aaae0e1d749183f788ce74b6bd3fac05ea1a0d20888200b5b0f225167b2708" Oct 29 23:30:42.030309 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.030287 6029 scope.go:122] "RemoveContainer" containerID="d8aaae0e1d749183f788ce74b6bd3fac05ea1a0d20888200b5b0f225167b2708" Oct 29 23:30:42.030762 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:30:42.030723 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8aaae0e1d749183f788ce74b6bd3fac05ea1a0d20888200b5b0f225167b2708\": container with ID starting with d8aaae0e1d749183f788ce74b6bd3fac05ea1a0d20888200b5b0f225167b2708 not found: ID does not exist" containerID="d8aaae0e1d749183f788ce74b6bd3fac05ea1a0d20888200b5b0f225167b2708" Oct 29 23:30:42.030879 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.030760 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8aaae0e1d749183f788ce74b6bd3fac05ea1a0d20888200b5b0f225167b2708"} err="failed to get container status \"d8aaae0e1d749183f788ce74b6bd3fac05ea1a0d20888200b5b0f225167b2708\": rpc error: code = NotFound desc = could not find container \"d8aaae0e1d749183f788ce74b6bd3fac05ea1a0d20888200b5b0f225167b2708\": container with ID starting with d8aaae0e1d749183f788ce74b6bd3fac05ea1a0d20888200b5b0f225167b2708 not found: ID does not exist" Oct 29 23:30:42.030879 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.030787 6029 scope.go:122] "RemoveContainer" containerID="919004d763d6b0ae055097c3285e1874aef48ea971f564bca0b1b0de516717a7" Oct 29 23:30:42.042739 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.042715 6029 scope.go:122] "RemoveContainer" containerID="919004d763d6b0ae055097c3285e1874aef48ea971f564bca0b1b0de516717a7" Oct 29 23:30:42.043099 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:30:42.043077 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"919004d763d6b0ae055097c3285e1874aef48ea971f564bca0b1b0de516717a7\": container with ID starting with 919004d763d6b0ae055097c3285e1874aef48ea971f564bca0b1b0de516717a7 not found: ID does not exist" containerID="919004d763d6b0ae055097c3285e1874aef48ea971f564bca0b1b0de516717a7" Oct 29 23:30:42.043170 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.043106 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"919004d763d6b0ae055097c3285e1874aef48ea971f564bca0b1b0de516717a7"} err="failed to get container status \"919004d763d6b0ae055097c3285e1874aef48ea971f564bca0b1b0de516717a7\": rpc error: code = NotFound desc = could not find container \"919004d763d6b0ae055097c3285e1874aef48ea971f564bca0b1b0de516717a7\": container with ID starting with 919004d763d6b0ae055097c3285e1874aef48ea971f564bca0b1b0de516717a7 not found: ID does not exist" Oct 29 23:30:42.043170 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.043123 6029 scope.go:122] "RemoveContainer" containerID="053786596d8647b3c507554fdb20932726372698a12e13e4500ac27c76fe4a4c" Oct 29 23:30:42.061074 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.061036 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx"] Oct 29 23:30:42.075036 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.075013 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-82npx"] Oct 29 23:30:42.112805 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.112774 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h"] Oct 29 23:30:42.117989 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.117958 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-vtx8h"] Oct 29 23:30:42.155492 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.155390 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq"] Oct 29 23:30:42.159613 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.159579 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-zxdhq"] Oct 29 23:30:42.195506 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.195474 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl"] Oct 29 23:30:42.201246 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:42.201217 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-032fa8-openshift-default-7b6d48f8fc-f9knl"] Oct 29 23:30:43.390355 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:43.390324 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="219edfce-514c-4adc-aed0-c331515e9467" path="/var/lib/kubelet/pods/219edfce-514c-4adc-aed0-c331515e9467/volumes" Oct 29 23:30:43.390849 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:43.390833 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7add77b8-8cb6-48a6-8e3d-dd223f76402a" path="/var/lib/kubelet/pods/7add77b8-8cb6-48a6-8e3d-dd223f76402a/volumes" Oct 29 23:30:43.393748 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:43.393719 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="adf4cd4e-959b-4d9b-983d-19dcc6122050" path="/var/lib/kubelet/pods/adf4cd4e-959b-4d9b-983d-19dcc6122050/volumes" Oct 29 23:30:43.394479 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:43.394452 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" path="/var/lib/kubelet/pods/ee5b3e7f-2efc-4ac7-b00e-8426ea94c250/volumes" Oct 29 23:30:44.539921 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:44.539879 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj"] Oct 29 23:30:44.540517 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:44.540164 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" podUID="a5a87768-faea-4bd4-a252-c518bb2b809c" containerName="maas-api" containerID="cri-o://b5aec051ceea42a5730ee280fe14348ccd79219628244eb75c133750528184cf" gracePeriod=30 Oct 29 23:30:44.700369 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:44.700330 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" podUID="a5a87768-faea-4bd4-a252-c518bb2b809c" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.64:8443/health\": dial tcp 10.134.0.64:8443: connect: connection refused" Oct 29 23:30:44.935899 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:44.927621 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht"] Oct 29 23:30:44.935899 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:44.928257 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" podUID="d0cd24af-80e1-4336-8f97-cdedd3e1ef0e" containerName="maas-api" containerID="cri-o://98ad0d23045b06cd4ff58691ea7a1f7aff90810117d59e89ec1b4c95e5046e4d" gracePeriod=30 Oct 29 23:30:45.086631 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.086318 6029 generic.go:356] "Generic (PLEG): container finished" podID="a5a87768-faea-4bd4-a252-c518bb2b809c" containerID="b5aec051ceea42a5730ee280fe14348ccd79219628244eb75c133750528184cf" exitCode=0 Oct 29 23:30:45.086631 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.086474 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" event={"ID":"a5a87768-faea-4bd4-a252-c518bb2b809c","Type":"ContainerDied","Data":"b5aec051ceea42a5730ee280fe14348ccd79219628244eb75c133750528184cf"} Oct 29 23:30:45.086631 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.086521 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" event={"ID":"a5a87768-faea-4bd4-a252-c518bb2b809c","Type":"ContainerDied","Data":"5b73763f815908143c102a7d5ae2dff92016ad322e04b8fb1991de811487e705"} Oct 29 23:30:45.086631 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.086545 6029 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b73763f815908143c102a7d5ae2dff92016ad322e04b8fb1991de811487e705" Oct 29 23:30:45.094264 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.094222 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" Oct 29 23:30:45.249233 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.233627 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a5a87768-faea-4bd4-a252-c518bb2b809c-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5a87768-faea-4bd4-a252-c518bb2b809c-openshift-service-ca\") pod \"a5a87768-faea-4bd4-a252-c518bb2b809c\" (UID: \"a5a87768-faea-4bd4-a252-c518bb2b809c\") " Oct 29 23:30:45.249233 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.233687 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a5a87768-faea-4bd4-a252-c518bb2b809c-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5a87768-faea-4bd4-a252-c518bb2b809c-maas-api-tls\") pod \"a5a87768-faea-4bd4-a252-c518bb2b809c\" (UID: \"a5a87768-faea-4bd4-a252-c518bb2b809c\") " Oct 29 23:30:45.249233 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.233735 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a5a87768-faea-4bd4-a252-c518bb2b809c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5a87768-faea-4bd4-a252-c518bb2b809c-metrics-certs\") pod \"a5a87768-faea-4bd4-a252-c518bb2b809c\" (UID: \"a5a87768-faea-4bd4-a252-c518bb2b809c\") " Oct 29 23:30:45.249233 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.240613 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5a87768-faea-4bd4-a252-c518bb2b809c-maas-api-tls" pod "a5a87768-faea-4bd4-a252-c518bb2b809c" (UID: "a5a87768-faea-4bd4-a252-c518bb2b809c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:30:45.249233 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.245426 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5a87768-faea-4bd4-a252-c518bb2b809c-metrics-certs" pod "a5a87768-faea-4bd4-a252-c518bb2b809c" (UID: "a5a87768-faea-4bd4-a252-c518bb2b809c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:30:45.249233 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.248118 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a5a87768-faea-4bd4-a252-c518bb2b809c-kube-api-access-fk7sk\" (UniqueName: \"kubernetes.io/projected/a5a87768-faea-4bd4-a252-c518bb2b809c-kube-api-access-fk7sk\") pod \"a5a87768-faea-4bd4-a252-c518bb2b809c\" (UID: \"a5a87768-faea-4bd4-a252-c518bb2b809c\") " Oct 29 23:30:45.249233 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.248703 6029 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5a87768-faea-4bd4-a252-c518bb2b809c-maas-api-tls\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:45.249233 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.248724 6029 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5a87768-faea-4bd4-a252-c518bb2b809c-metrics-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:45.265020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.257007 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5a87768-faea-4bd4-a252-c518bb2b809c-openshift-service-ca" pod "a5a87768-faea-4bd4-a252-c518bb2b809c" (UID: "a5a87768-faea-4bd4-a252-c518bb2b809c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:30:45.265020 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.264801 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5a87768-faea-4bd4-a252-c518bb2b809c-kube-api-access-fk7sk" pod "a5a87768-faea-4bd4-a252-c518bb2b809c" (UID: "a5a87768-faea-4bd4-a252-c518bb2b809c"). InnerVolumeSpecName "kube-api-access-fk7sk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:45.354615 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.351725 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fk7sk\" (UniqueName: \"kubernetes.io/projected/a5a87768-faea-4bd4-a252-c518bb2b809c-kube-api-access-fk7sk\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:45.354615 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.351763 6029 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5a87768-faea-4bd4-a252-c518bb2b809c-openshift-service-ca\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:45.456853 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.456527 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" Oct 29 23:30:45.675115 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.675076 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-metrics-certs\") pod \"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e\" (UID: \"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e\") " Oct 29 23:30:45.675609 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.675196 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-openshift-service-ca\") pod \"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e\" (UID: \"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e\") " Oct 29 23:30:45.675609 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.675289 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-maas-api-tls\") pod \"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e\" (UID: \"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e\") " Oct 29 23:30:45.675609 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.675432 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-kube-api-access-kkprd\" (UniqueName: \"kubernetes.io/projected/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-kube-api-access-kkprd\") pod \"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e\" (UID: \"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e\") " Oct 29 23:30:45.675609 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.675520 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-openshift-service-ca" pod "d0cd24af-80e1-4336-8f97-cdedd3e1ef0e" (UID: "d0cd24af-80e1-4336-8f97-cdedd3e1ef0e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:30:45.676010 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.675986 6029 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-openshift-service-ca\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:45.677905 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.677879 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-maas-api-tls" pod "d0cd24af-80e1-4336-8f97-cdedd3e1ef0e" (UID: "d0cd24af-80e1-4336-8f97-cdedd3e1ef0e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:30:45.678145 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.678091 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-kube-api-access-kkprd" pod "d0cd24af-80e1-4336-8f97-cdedd3e1ef0e" (UID: "d0cd24af-80e1-4336-8f97-cdedd3e1ef0e"). InnerVolumeSpecName "kube-api-access-kkprd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:45.679225 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.679204 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-metrics-certs" pod "d0cd24af-80e1-4336-8f97-cdedd3e1ef0e" (UID: "d0cd24af-80e1-4336-8f97-cdedd3e1ef0e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:30:45.776771 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.776736 6029 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-metrics-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:45.776771 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.776768 6029 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-maas-api-tls\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:45.776771 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:45.776779 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkprd\" (UniqueName: \"kubernetes.io/projected/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e-kube-api-access-kkprd\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:46.095074 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:46.095034 6029 generic.go:356] "Generic (PLEG): container finished" podID="d0cd24af-80e1-4336-8f97-cdedd3e1ef0e" containerID="98ad0d23045b06cd4ff58691ea7a1f7aff90810117d59e89ec1b4c95e5046e4d" exitCode=0 Oct 29 23:30:46.095270 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:46.095084 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" Oct 29 23:30:46.095270 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:46.095118 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" event={"ID":"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e","Type":"ContainerDied","Data":"98ad0d23045b06cd4ff58691ea7a1f7aff90810117d59e89ec1b4c95e5046e4d"} Oct 29 23:30:46.095270 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:46.095171 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht" event={"ID":"d0cd24af-80e1-4336-8f97-cdedd3e1ef0e","Type":"ContainerDied","Data":"9aeb63a3b7bde4564d354f51e5a65cac8af9a56f0b50cbb265cf8b5bf4dba999"} Oct 29 23:30:46.095270 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:46.095203 6029 scope.go:122] "RemoveContainer" containerID="98ad0d23045b06cd4ff58691ea7a1f7aff90810117d59e89ec1b4c95e5046e4d" Oct 29 23:30:46.095270 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:46.095254 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj" Oct 29 23:30:46.105572 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:46.105553 6029 scope.go:122] "RemoveContainer" containerID="98ad0d23045b06cd4ff58691ea7a1f7aff90810117d59e89ec1b4c95e5046e4d" Oct 29 23:30:46.105876 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:30:46.105857 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98ad0d23045b06cd4ff58691ea7a1f7aff90810117d59e89ec1b4c95e5046e4d\": container with ID starting with 98ad0d23045b06cd4ff58691ea7a1f7aff90810117d59e89ec1b4c95e5046e4d not found: ID does not exist" containerID="98ad0d23045b06cd4ff58691ea7a1f7aff90810117d59e89ec1b4c95e5046e4d" Oct 29 23:30:46.105946 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:46.105887 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98ad0d23045b06cd4ff58691ea7a1f7aff90810117d59e89ec1b4c95e5046e4d"} err="failed to get container status \"98ad0d23045b06cd4ff58691ea7a1f7aff90810117d59e89ec1b4c95e5046e4d\": rpc error: code = NotFound desc = could not find container \"98ad0d23045b06cd4ff58691ea7a1f7aff90810117d59e89ec1b4c95e5046e4d\": container with ID starting with 98ad0d23045b06cd4ff58691ea7a1f7aff90810117d59e89ec1b4c95e5046e4d not found: ID does not exist" Oct 29 23:30:46.173566 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:46.173528 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj"] Oct 29 23:30:46.178225 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:46.178197 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-837245-74cdf76657-7xvdj"] Oct 29 23:30:46.215302 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:46.215269 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht"] Oct 29 23:30:46.219070 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:46.219036 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-2670a5-6d6465b5df-8m9ht"] Oct 29 23:30:47.391201 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:47.391154 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a5a87768-faea-4bd4-a252-c518bb2b809c" path="/var/lib/kubelet/pods/a5a87768-faea-4bd4-a252-c518bb2b809c/volumes" Oct 29 23:30:47.391778 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:47.391756 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d0cd24af-80e1-4336-8f97-cdedd3e1ef0e" path="/var/lib/kubelet/pods/d0cd24af-80e1-4336-8f97-cdedd3e1ef0e/volumes" Oct 29 23:30:53.829832 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:53.820866 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4"] Oct 29 23:30:53.829832 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:53.821135 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" podUID="ff2c3fee-90cf-4c17-bd87-5f76e8166517" containerName="istio-proxy" containerID="cri-o://7ace8e739d047d646bc3a8ff31c7f4ede7a685ecaa568950092b352a87c56210" gracePeriod=30 Oct 29 23:30:53.976859 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:53.964965 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb"] Oct 29 23:30:53.976859 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:53.965257 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" podUID="c26dda21-42b8-4789-8658-e91d387542e3" containerName="istio-proxy" containerID="cri-o://ba32fc6824ee0aa0981efef02aded7d46344ee9ff6c4e96aa112c750f83325e2" gracePeriod=30 Oct 29 23:30:54.105904 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:54.104900 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6"] Oct 29 23:30:54.105904 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:54.105167 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" podUID="245515db-5ab4-46a3-a45b-2bd8c4b1bade" containerName="istio-proxy" containerID="cri-o://ae268cc0411a7a652ed15c092815b314fd76fa850029ac54a376638f9d28d0aa" gracePeriod=30 Oct 29 23:30:54.603317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:54.603284 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx"] Oct 29 23:30:54.605453 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:54.605419 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" podUID="c1768326-83dd-4203-a9ba-a855c88d5874" containerName="istio-proxy" containerID="cri-o://8013c9a5a776c5f092d536f3900dfdccc035216af7b3762e9acaa43ff06e429a" gracePeriod=30 Oct 29 23:30:54.614662 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:54.614632 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5"] Oct 29 23:30:54.614872 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:54.614846 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" podUID="3cd04199-f906-4d0f-a0c6-4d45c20208bf" containerName="istio-proxy" containerID="cri-o://fe55643ea926cd29f10da9d7b518418a185d7444ae318139e9183d4323f1127c" gracePeriod=30 Oct 29 23:30:54.620368 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:54.620339 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8"] Oct 29 23:30:54.620638 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:54.620576 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" podUID="6a44ecac-10fb-4a00-9596-716b57cc8dfa" containerName="istio-proxy" containerID="cri-o://fe72fb8f1ebdd62e7ba69808ddcb488bfb199f2360991ddcbb3e70f96cb5a15d" gracePeriod=30 Oct 29 23:30:54.625382 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:54.625358 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs"] Oct 29 23:30:54.625580 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:54.625547 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" podUID="11ac369f-a9a0-479c-b534-6227afec3635" containerName="istio-proxy" containerID="cri-o://f4a307af5d26c5e0bb0e52a0319c88d3b7b2de411051d62ae52e656dfa6d7034" gracePeriod=30 Oct 29 23:30:54.780106 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:54.780056 6029 scope.go:122] "RemoveContainer" containerID="b5aec051ceea42a5730ee280fe14348ccd79219628244eb75c133750528184cf" Oct 29 23:30:59.460661 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.460629 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:30:59.520881 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.520597 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:30:59.533457 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.533418 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c26dda21-42b8-4789-8658-e91d387542e3-istio-token\" (UniqueName: \"kubernetes.io/projected/c26dda21-42b8-4789-8658-e91d387542e3-istio-token\") pod \"c26dda21-42b8-4789-8658-e91d387542e3\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " Oct 29 23:30:59.533665 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.533484 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-istio-data\") pod \"c26dda21-42b8-4789-8658-e91d387542e3\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " Oct 29 23:30:59.533665 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.533562 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c26dda21-42b8-4789-8658-e91d387542e3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c26dda21-42b8-4789-8658-e91d387542e3-istiod-ca-cert\") pod \"c26dda21-42b8-4789-8658-e91d387542e3\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " Oct 29 23:30:59.533665 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.533632 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c26dda21-42b8-4789-8658-e91d387542e3-kube-api-access-d957s\" (UniqueName: \"kubernetes.io/projected/c26dda21-42b8-4789-8658-e91d387542e3-kube-api-access-d957s\") pod \"c26dda21-42b8-4789-8658-e91d387542e3\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " Oct 29 23:30:59.533919 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.533740 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-workload-certs\") pod \"c26dda21-42b8-4789-8658-e91d387542e3\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " Oct 29 23:30:59.533919 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.533783 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-istio-envoy\") pod \"c26dda21-42b8-4789-8658-e91d387542e3\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " Oct 29 23:30:59.534463 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.534410 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-istio-data" pod "c26dda21-42b8-4789-8658-e91d387542e3" (UID: "c26dda21-42b8-4789-8658-e91d387542e3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:59.534625 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.534576 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-workload-certs" pod "c26dda21-42b8-4789-8658-e91d387542e3" (UID: "c26dda21-42b8-4789-8658-e91d387542e3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:59.537989 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.537960 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c26dda21-42b8-4789-8658-e91d387542e3-kube-api-access-d957s" pod "c26dda21-42b8-4789-8658-e91d387542e3" (UID: "c26dda21-42b8-4789-8658-e91d387542e3"). InnerVolumeSpecName "kube-api-access-d957s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:59.538357 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.538322 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-istio-envoy" pod "c26dda21-42b8-4789-8658-e91d387542e3" (UID: "c26dda21-42b8-4789-8658-e91d387542e3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:59.539027 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.539004 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c26dda21-42b8-4789-8658-e91d387542e3-istiod-ca-cert" pod "c26dda21-42b8-4789-8658-e91d387542e3" (UID: "c26dda21-42b8-4789-8658-e91d387542e3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:30:59.539281 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.539262 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c26dda21-42b8-4789-8658-e91d387542e3-istio-token" pod "c26dda21-42b8-4789-8658-e91d387542e3" (UID: "c26dda21-42b8-4789-8658-e91d387542e3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:59.539943 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.539921 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-workload-socket\") pod \"c26dda21-42b8-4789-8658-e91d387542e3\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " Oct 29 23:30:59.540010 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.539977 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-credential-socket\") pod \"c26dda21-42b8-4789-8658-e91d387542e3\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " Oct 29 23:30:59.540073 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.540006 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c26dda21-42b8-4789-8658-e91d387542e3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c26dda21-42b8-4789-8658-e91d387542e3-istio-podinfo\") pod \"c26dda21-42b8-4789-8658-e91d387542e3\" (UID: \"c26dda21-42b8-4789-8658-e91d387542e3\") " Oct 29 23:30:59.540193 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.540174 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-workload-socket" pod "c26dda21-42b8-4789-8658-e91d387542e3" (UID: "c26dda21-42b8-4789-8658-e91d387542e3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:59.540350 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.540334 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-credential-socket" pod "c26dda21-42b8-4789-8658-e91d387542e3" (UID: "c26dda21-42b8-4789-8658-e91d387542e3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:59.540626 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.540610 6029 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c26dda21-42b8-4789-8658-e91d387542e3-istio-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.540712 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.540631 6029 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-istio-data\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.540712 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.540644 6029 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c26dda21-42b8-4789-8658-e91d387542e3-istiod-ca-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.540712 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.540657 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d957s\" (UniqueName: \"kubernetes.io/projected/c26dda21-42b8-4789-8658-e91d387542e3-kube-api-access-d957s\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.540712 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.540672 6029 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-workload-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.540712 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.540687 6029 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-istio-envoy\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.540712 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.540698 6029 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-workload-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.540947 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.540712 6029 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26dda21-42b8-4789-8658-e91d387542e3-credential-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.543341 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.543321 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c26dda21-42b8-4789-8658-e91d387542e3-istio-podinfo" pod "c26dda21-42b8-4789-8658-e91d387542e3" (UID: "c26dda21-42b8-4789-8658-e91d387542e3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:30:59.568826 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.568786 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:30:59.642136 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.642062 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-data\") pod \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " Oct 29 23:30:59.642284 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.642159 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-data\") pod \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " Oct 29 23:30:59.642284 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.642229 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-podinfo\") pod \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " Oct 29 23:30:59.642284 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.642256 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/245515db-5ab4-46a3-a45b-2bd8c4b1bade-kube-api-access-wnbtz\" (UniqueName: \"kubernetes.io/projected/245515db-5ab4-46a3-a45b-2bd8c4b1bade-kube-api-access-wnbtz\") pod \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " Oct 29 23:30:59.642470 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.642288 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-credential-socket\") pod \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " Oct 29 23:30:59.642470 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.642332 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-workload-socket\") pod \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " Oct 29 23:30:59.642470 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.642360 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-token\" (UniqueName: \"kubernetes.io/projected/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-token\") pod \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " Oct 29 23:30:59.642470 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.642360 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-data" pod "245515db-5ab4-46a3-a45b-2bd8c4b1bade" (UID: "245515db-5ab4-46a3-a45b-2bd8c4b1bade"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:59.642470 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.642405 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-podinfo\") pod \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " Oct 29 23:30:59.642470 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.642437 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-workload-certs\") pod \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " Oct 29 23:30:59.642780 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.642477 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-envoy\") pod \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " Oct 29 23:30:59.642780 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.642525 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istiod-ca-cert\") pod \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " Oct 29 23:30:59.642780 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.642551 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-workload-socket\") pod \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " Oct 29 23:30:59.642780 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.642577 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-credential-socket\") pod \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " Oct 29 23:30:59.642780 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.642644 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-workload-certs\") pod \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " Oct 29 23:30:59.642780 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.642674 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-envoy\") pod \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " Oct 29 23:30:59.642780 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.642733 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ff2c3fee-90cf-4c17-bd87-5f76e8166517-kube-api-access-c828g\" (UniqueName: \"kubernetes.io/projected/ff2c3fee-90cf-4c17-bd87-5f76e8166517-kube-api-access-c828g\") pod \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\" (UID: \"ff2c3fee-90cf-4c17-bd87-5f76e8166517\") " Oct 29 23:30:59.643165 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.642868 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istiod-ca-cert\") pod \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " Oct 29 23:30:59.643165 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.642929 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-token\" (UniqueName: \"kubernetes.io/projected/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-token\") pod \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\" (UID: \"245515db-5ab4-46a3-a45b-2bd8c4b1bade\") " Oct 29 23:30:59.643320 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.643296 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-data" pod "ff2c3fee-90cf-4c17-bd87-5f76e8166517" (UID: "ff2c3fee-90cf-4c17-bd87-5f76e8166517"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:59.643504 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.643488 6029 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-data\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.643570 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.643510 6029 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-data\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.643570 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.643524 6029 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c26dda21-42b8-4789-8658-e91d387542e3-istio-podinfo\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.647716 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.645888 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istiod-ca-cert" pod "245515db-5ab4-46a3-a45b-2bd8c4b1bade" (UID: "245515db-5ab4-46a3-a45b-2bd8c4b1bade"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:30:59.647716 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.646181 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff2c3fee-90cf-4c17-bd87-5f76e8166517-kube-api-access-c828g" pod "ff2c3fee-90cf-4c17-bd87-5f76e8166517" (UID: "ff2c3fee-90cf-4c17-bd87-5f76e8166517"). InnerVolumeSpecName "kube-api-access-c828g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:59.647716 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.646308 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-workload-socket" pod "245515db-5ab4-46a3-a45b-2bd8c4b1bade" (UID: "245515db-5ab4-46a3-a45b-2bd8c4b1bade"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:59.647716 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.646328 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-token" pod "245515db-5ab4-46a3-a45b-2bd8c4b1bade" (UID: "245515db-5ab4-46a3-a45b-2bd8c4b1bade"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:59.647716 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.646564 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-credential-socket" pod "ff2c3fee-90cf-4c17-bd87-5f76e8166517" (UID: "ff2c3fee-90cf-4c17-bd87-5f76e8166517"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:59.647716 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.646642 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istiod-ca-cert" pod "ff2c3fee-90cf-4c17-bd87-5f76e8166517" (UID: "ff2c3fee-90cf-4c17-bd87-5f76e8166517"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:30:59.647716 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.646880 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-workload-socket" pod "ff2c3fee-90cf-4c17-bd87-5f76e8166517" (UID: "ff2c3fee-90cf-4c17-bd87-5f76e8166517"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:59.647716 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.647446 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-workload-certs" pod "245515db-5ab4-46a3-a45b-2bd8c4b1bade" (UID: "245515db-5ab4-46a3-a45b-2bd8c4b1bade"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:59.647716 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.647520 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-credential-socket" pod "245515db-5ab4-46a3-a45b-2bd8c4b1bade" (UID: "245515db-5ab4-46a3-a45b-2bd8c4b1bade"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:59.649574 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.649543 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-workload-certs" pod "ff2c3fee-90cf-4c17-bd87-5f76e8166517" (UID: "ff2c3fee-90cf-4c17-bd87-5f76e8166517"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:59.653246 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.653221 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-envoy" pod "ff2c3fee-90cf-4c17-bd87-5f76e8166517" (UID: "ff2c3fee-90cf-4c17-bd87-5f76e8166517"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:59.663210 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.663178 6029 generic.go:356] "Generic (PLEG): container finished" podID="c26dda21-42b8-4789-8658-e91d387542e3" containerID="ba32fc6824ee0aa0981efef02aded7d46344ee9ff6c4e96aa112c750f83325e2" exitCode=0 Oct 29 23:30:59.663341 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.663232 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" Oct 29 23:30:59.663341 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.663264 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" event={"ID":"c26dda21-42b8-4789-8658-e91d387542e3","Type":"ContainerDied","Data":"ba32fc6824ee0aa0981efef02aded7d46344ee9ff6c4e96aa112c750f83325e2"} Oct 29 23:30:59.663341 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.663332 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb" event={"ID":"c26dda21-42b8-4789-8658-e91d387542e3","Type":"ContainerDied","Data":"768f4552e1ebc82645d3475d7433c24b98bd28476f552894b6129d6aabb53ba7"} Oct 29 23:30:59.663504 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.663364 6029 scope.go:122] "RemoveContainer" containerID="ba32fc6824ee0aa0981efef02aded7d46344ee9ff6c4e96aa112c750f83325e2" Oct 29 23:30:59.665303 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.665281 6029 generic.go:356] "Generic (PLEG): container finished" podID="ff2c3fee-90cf-4c17-bd87-5f76e8166517" containerID="7ace8e739d047d646bc3a8ff31c7f4ede7a685ecaa568950092b352a87c56210" exitCode=0 Oct 29 23:30:59.665513 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.665474 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" event={"ID":"ff2c3fee-90cf-4c17-bd87-5f76e8166517","Type":"ContainerDied","Data":"7ace8e739d047d646bc3a8ff31c7f4ede7a685ecaa568950092b352a87c56210"} Oct 29 23:30:59.665638 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.665523 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" event={"ID":"ff2c3fee-90cf-4c17-bd87-5f76e8166517","Type":"ContainerDied","Data":"0b5f0d7faae9d1533e831a0ff92f8f6cc73855bdcd28c20b8d27e28235667298"} Oct 29 23:30:59.665638 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.665596 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4" Oct 29 23:30:59.667365 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.667340 6029 generic.go:356] "Generic (PLEG): container finished" podID="245515db-5ab4-46a3-a45b-2bd8c4b1bade" containerID="ae268cc0411a7a652ed15c092815b314fd76fa850029ac54a376638f9d28d0aa" exitCode=0 Oct 29 23:30:59.667470 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.667375 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" Oct 29 23:30:59.667470 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.667384 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" event={"ID":"245515db-5ab4-46a3-a45b-2bd8c4b1bade","Type":"ContainerDied","Data":"ae268cc0411a7a652ed15c092815b314fd76fa850029ac54a376638f9d28d0aa"} Oct 29 23:30:59.667584 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.667495 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6" event={"ID":"245515db-5ab4-46a3-a45b-2bd8c4b1bade","Type":"ContainerDied","Data":"efaa28ec4a32b85610f7ac494009c889f8e48d3f4d98301eac06b75acc971deb"} Oct 29 23:30:59.669247 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.669206 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-token" pod "ff2c3fee-90cf-4c17-bd87-5f76e8166517" (UID: "ff2c3fee-90cf-4c17-bd87-5f76e8166517"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:59.669354 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.669239 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-podinfo" pod "ff2c3fee-90cf-4c17-bd87-5f76e8166517" (UID: "ff2c3fee-90cf-4c17-bd87-5f76e8166517"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:30:59.669354 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.669267 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/245515db-5ab4-46a3-a45b-2bd8c4b1bade-kube-api-access-wnbtz" pod "245515db-5ab4-46a3-a45b-2bd8c4b1bade" (UID: "245515db-5ab4-46a3-a45b-2bd8c4b1bade"). InnerVolumeSpecName "kube-api-access-wnbtz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:30:59.669678 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.669609 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-envoy" pod "245515db-5ab4-46a3-a45b-2bd8c4b1bade" (UID: "245515db-5ab4-46a3-a45b-2bd8c4b1bade"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:30:59.669848 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.669799 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-podinfo" pod "245515db-5ab4-46a3-a45b-2bd8c4b1bade" (UID: "245515db-5ab4-46a3-a45b-2bd8c4b1bade"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:30:59.747597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.747071 6029 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.747597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.747104 6029 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-podinfo\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.747597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.747117 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnbtz\" (UniqueName: \"kubernetes.io/projected/245515db-5ab4-46a3-a45b-2bd8c4b1bade-kube-api-access-wnbtz\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.747597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.747130 6029 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-credential-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.747597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.747143 6029 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-workload-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.747597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.747156 6029 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.747597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.747170 6029 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-podinfo\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.747597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.747181 6029 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-workload-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.747597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.747193 6029 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istio-envoy\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.747597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.747204 6029 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff2c3fee-90cf-4c17-bd87-5f76e8166517-istiod-ca-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.747597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.747214 6029 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff2c3fee-90cf-4c17-bd87-5f76e8166517-workload-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.747597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.747225 6029 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-credential-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.747597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.747237 6029 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-workload-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.747597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.747252 6029 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istio-envoy\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.747597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.747263 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c828g\" (UniqueName: \"kubernetes.io/projected/ff2c3fee-90cf-4c17-bd87-5f76e8166517-kube-api-access-c828g\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.747597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.747274 6029 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/245515db-5ab4-46a3-a45b-2bd8c4b1bade-istiod-ca-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:30:59.864333 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.863472 6029 scope.go:122] "RemoveContainer" containerID="ba32fc6824ee0aa0981efef02aded7d46344ee9ff6c4e96aa112c750f83325e2" Oct 29 23:30:59.864333 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:30:59.863933 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba32fc6824ee0aa0981efef02aded7d46344ee9ff6c4e96aa112c750f83325e2\": container with ID starting with ba32fc6824ee0aa0981efef02aded7d46344ee9ff6c4e96aa112c750f83325e2 not found: ID does not exist" containerID="ba32fc6824ee0aa0981efef02aded7d46344ee9ff6c4e96aa112c750f83325e2" Oct 29 23:30:59.864333 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.863974 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba32fc6824ee0aa0981efef02aded7d46344ee9ff6c4e96aa112c750f83325e2"} err="failed to get container status \"ba32fc6824ee0aa0981efef02aded7d46344ee9ff6c4e96aa112c750f83325e2\": rpc error: code = NotFound desc = could not find container \"ba32fc6824ee0aa0981efef02aded7d46344ee9ff6c4e96aa112c750f83325e2\": container with ID starting with ba32fc6824ee0aa0981efef02aded7d46344ee9ff6c4e96aa112c750f83325e2 not found: ID does not exist" Oct 29 23:30:59.864333 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.864000 6029 scope.go:122] "RemoveContainer" containerID="7ace8e739d047d646bc3a8ff31c7f4ede7a685ecaa568950092b352a87c56210" Oct 29 23:30:59.885319 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.885046 6029 scope.go:122] "RemoveContainer" containerID="7ace8e739d047d646bc3a8ff31c7f4ede7a685ecaa568950092b352a87c56210" Oct 29 23:30:59.886188 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:30:59.885613 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ace8e739d047d646bc3a8ff31c7f4ede7a685ecaa568950092b352a87c56210\": container with ID starting with 7ace8e739d047d646bc3a8ff31c7f4ede7a685ecaa568950092b352a87c56210 not found: ID does not exist" containerID="7ace8e739d047d646bc3a8ff31c7f4ede7a685ecaa568950092b352a87c56210" Oct 29 23:30:59.886188 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.885649 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ace8e739d047d646bc3a8ff31c7f4ede7a685ecaa568950092b352a87c56210"} err="failed to get container status \"7ace8e739d047d646bc3a8ff31c7f4ede7a685ecaa568950092b352a87c56210\": rpc error: code = NotFound desc = could not find container \"7ace8e739d047d646bc3a8ff31c7f4ede7a685ecaa568950092b352a87c56210\": container with ID starting with 7ace8e739d047d646bc3a8ff31c7f4ede7a685ecaa568950092b352a87c56210 not found: ID does not exist" Oct 29 23:30:59.886188 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.885675 6029 scope.go:122] "RemoveContainer" containerID="ae268cc0411a7a652ed15c092815b314fd76fa850029ac54a376638f9d28d0aa" Oct 29 23:30:59.896875 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.896808 6029 scope.go:122] "RemoveContainer" containerID="ae268cc0411a7a652ed15c092815b314fd76fa850029ac54a376638f9d28d0aa" Oct 29 23:30:59.898248 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:30:59.898223 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae268cc0411a7a652ed15c092815b314fd76fa850029ac54a376638f9d28d0aa\": container with ID starting with ae268cc0411a7a652ed15c092815b314fd76fa850029ac54a376638f9d28d0aa not found: ID does not exist" containerID="ae268cc0411a7a652ed15c092815b314fd76fa850029ac54a376638f9d28d0aa" Oct 29 23:30:59.898364 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.898261 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae268cc0411a7a652ed15c092815b314fd76fa850029ac54a376638f9d28d0aa"} err="failed to get container status \"ae268cc0411a7a652ed15c092815b314fd76fa850029ac54a376638f9d28d0aa\": rpc error: code = NotFound desc = could not find container \"ae268cc0411a7a652ed15c092815b314fd76fa850029ac54a376638f9d28d0aa\": container with ID starting with ae268cc0411a7a652ed15c092815b314fd76fa850029ac54a376638f9d28d0aa not found: ID does not exist" Oct 29 23:30:59.911335 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.911314 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb"] Oct 29 23:30:59.927443 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.927412 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-rzzcb"] Oct 29 23:30:59.944861 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.944833 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:30:59.955414 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:30:59.955387 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:31:00.017856 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.017830 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:31:00.032859 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.032785 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4"] Oct 29 23:31:00.036747 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.036723 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-f8mv4"] Oct 29 23:31:00.051907 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.051880 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-data\") pod \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " Oct 29 23:31:00.052059 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.051916 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-token\" (UniqueName: \"kubernetes.io/projected/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-token\") pod \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " Oct 29 23:31:00.052059 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.051954 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-data\") pod \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " Oct 29 23:31:00.052059 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.051983 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-workload-socket\") pod \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " Oct 29 23:31:00.052059 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.052017 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-podinfo\") pod \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " Oct 29 23:31:00.052295 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.052078 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-podinfo\") pod \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " Oct 29 23:31:00.052295 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.052131 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-workload-certs\") pod \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " Oct 29 23:31:00.052295 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.052223 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istiod-ca-cert\") pod \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " Oct 29 23:31:00.052295 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.052276 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6a44ecac-10fb-4a00-9596-716b57cc8dfa-kube-api-access-d4rn4\" (UniqueName: \"kubernetes.io/projected/6a44ecac-10fb-4a00-9596-716b57cc8dfa-kube-api-access-d4rn4\") pod \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " Oct 29 23:31:00.052509 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.052217 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-data" pod "6a44ecac-10fb-4a00-9596-716b57cc8dfa" (UID: "6a44ecac-10fb-4a00-9596-716b57cc8dfa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:00.052509 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.052321 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-envoy\") pod \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " Oct 29 23:31:00.052509 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.052401 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-envoy\") pod \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " Oct 29 23:31:00.052509 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.052444 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3cd04199-f906-4d0f-a0c6-4d45c20208bf-kube-api-access-8b4sc\" (UniqueName: \"kubernetes.io/projected/3cd04199-f906-4d0f-a0c6-4d45c20208bf-kube-api-access-8b4sc\") pod \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " Oct 29 23:31:00.052509 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.052456 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-workload-certs" pod "3cd04199-f906-4d0f-a0c6-4d45c20208bf" (UID: "3cd04199-f906-4d0f-a0c6-4d45c20208bf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:00.052509 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.052489 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-credential-socket\") pod \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " Oct 29 23:31:00.052836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.052550 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-token\" (UniqueName: \"kubernetes.io/projected/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-token\") pod \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " Oct 29 23:31:00.052836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.052555 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-data" pod "3cd04199-f906-4d0f-a0c6-4d45c20208bf" (UID: "3cd04199-f906-4d0f-a0c6-4d45c20208bf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:00.052836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.052568 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-workload-socket" pod "3cd04199-f906-4d0f-a0c6-4d45c20208bf" (UID: "3cd04199-f906-4d0f-a0c6-4d45c20208bf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:00.052836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.052566 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istiod-ca-cert" pod "6a44ecac-10fb-4a00-9596-716b57cc8dfa" (UID: "6a44ecac-10fb-4a00-9596-716b57cc8dfa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:31:00.052836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.052593 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-workload-socket\") pod \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " Oct 29 23:31:00.052836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.052622 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-workload-certs\") pod \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " Oct 29 23:31:00.052836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.052755 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-credential-socket\") pod \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\" (UID: \"6a44ecac-10fb-4a00-9596-716b57cc8dfa\") " Oct 29 23:31:00.052836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.052797 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-credential-socket" pod "3cd04199-f906-4d0f-a0c6-4d45c20208bf" (UID: "3cd04199-f906-4d0f-a0c6-4d45c20208bf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:00.052836 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.052834 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istiod-ca-cert\") pod \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\" (UID: \"3cd04199-f906-4d0f-a0c6-4d45c20208bf\") " Oct 29 23:31:00.053314 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.053009 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-workload-socket" pod "6a44ecac-10fb-4a00-9596-716b57cc8dfa" (UID: "6a44ecac-10fb-4a00-9596-716b57cc8dfa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:00.055174 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.054919 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-envoy" pod "6a44ecac-10fb-4a00-9596-716b57cc8dfa" (UID: "6a44ecac-10fb-4a00-9596-716b57cc8dfa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:00.055298 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.055213 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-podinfo" pod "3cd04199-f906-4d0f-a0c6-4d45c20208bf" (UID: "3cd04199-f906-4d0f-a0c6-4d45c20208bf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:31:00.055435 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.055417 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-workload-certs" pod "6a44ecac-10fb-4a00-9596-716b57cc8dfa" (UID: "6a44ecac-10fb-4a00-9596-716b57cc8dfa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:00.055602 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.055579 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-token" pod "6a44ecac-10fb-4a00-9596-716b57cc8dfa" (UID: "6a44ecac-10fb-4a00-9596-716b57cc8dfa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:00.055687 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.055584 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-credential-socket" pod "6a44ecac-10fb-4a00-9596-716b57cc8dfa" (UID: "6a44ecac-10fb-4a00-9596-716b57cc8dfa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:00.055968 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.055947 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istiod-ca-cert" pod "3cd04199-f906-4d0f-a0c6-4d45c20208bf" (UID: "3cd04199-f906-4d0f-a0c6-4d45c20208bf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:31:00.056716 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.056622 6029 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-credential-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.056716 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.056651 6029 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.056994 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.056667 6029 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-workload-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.057144 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.057007 6029 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-workload-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.057144 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.057025 6029 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-credential-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.057144 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.057039 6029 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istiod-ca-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.057144 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.057053 6029 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-data\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.057144 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.057092 6029 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-data\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.057144 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.057108 6029 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-workload-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.057144 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.057122 6029 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-podinfo\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.057144 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.057136 6029 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-workload-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.057553 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.057149 6029 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istiod-ca-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.057553 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.057164 6029 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-envoy\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.057553 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.057324 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-token" pod "3cd04199-f906-4d0f-a0c6-4d45c20208bf" (UID: "3cd04199-f906-4d0f-a0c6-4d45c20208bf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:00.057553 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.057391 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a44ecac-10fb-4a00-9596-716b57cc8dfa-kube-api-access-d4rn4" pod "6a44ecac-10fb-4a00-9596-716b57cc8dfa" (UID: "6a44ecac-10fb-4a00-9596-716b57cc8dfa"). InnerVolumeSpecName "kube-api-access-d4rn4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:00.057553 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.057448 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-podinfo" pod "6a44ecac-10fb-4a00-9596-716b57cc8dfa" (UID: "6a44ecac-10fb-4a00-9596-716b57cc8dfa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:31:00.058107 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.057632 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cd04199-f906-4d0f-a0c6-4d45c20208bf-kube-api-access-8b4sc" pod "3cd04199-f906-4d0f-a0c6-4d45c20208bf" (UID: "3cd04199-f906-4d0f-a0c6-4d45c20208bf"). InnerVolumeSpecName "kube-api-access-8b4sc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:00.058107 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.057909 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-envoy" pod "3cd04199-f906-4d0f-a0c6-4d45c20208bf" (UID: "3cd04199-f906-4d0f-a0c6-4d45c20208bf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:00.076794 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.076766 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6"] Oct 29 23:31:00.083234 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.083206 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-2670a5-openshift-default-9f9b57bbc-qs9f6"] Oct 29 23:31:00.159689 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.159649 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/11ac369f-a9a0-479c-b534-6227afec3635-istio-token\" (UniqueName: \"kubernetes.io/projected/11ac369f-a9a0-479c-b534-6227afec3635-istio-token\") pod \"11ac369f-a9a0-479c-b534-6227afec3635\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " Oct 29 23:31:00.159972 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.159952 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/11ac369f-a9a0-479c-b534-6227afec3635-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11ac369f-a9a0-479c-b534-6227afec3635-istiod-ca-cert\") pod \"11ac369f-a9a0-479c-b534-6227afec3635\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " Oct 29 23:31:00.160306 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.160285 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/11ac369f-a9a0-479c-b534-6227afec3635-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11ac369f-a9a0-479c-b534-6227afec3635-istio-podinfo\") pod \"11ac369f-a9a0-479c-b534-6227afec3635\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " Oct 29 23:31:00.160524 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.160508 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-credential-socket\") pod \"11ac369f-a9a0-479c-b534-6227afec3635\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " Oct 29 23:31:00.162346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.160630 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11ac369f-a9a0-479c-b534-6227afec3635-istiod-ca-cert" pod "11ac369f-a9a0-479c-b534-6227afec3635" (UID: "11ac369f-a9a0-479c-b534-6227afec3635"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:31:00.162346 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.160802 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-credential-socket" pod "11ac369f-a9a0-479c-b534-6227afec3635" (UID: "11ac369f-a9a0-479c-b534-6227afec3635"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:00.163656 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.163103 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/11ac369f-a9a0-479c-b534-6227afec3635-kube-api-access-gbx6d\" (UniqueName: \"kubernetes.io/projected/11ac369f-a9a0-479c-b534-6227afec3635-kube-api-access-gbx6d\") pod \"11ac369f-a9a0-479c-b534-6227afec3635\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " Oct 29 23:31:00.163869 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.163852 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-istio-envoy\") pod \"11ac369f-a9a0-479c-b534-6227afec3635\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " Oct 29 23:31:00.164388 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.163995 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11ac369f-a9a0-479c-b534-6227afec3635-kube-api-access-gbx6d" pod "11ac369f-a9a0-479c-b534-6227afec3635" (UID: "11ac369f-a9a0-479c-b534-6227afec3635"). InnerVolumeSpecName "kube-api-access-gbx6d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:00.164388 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.164022 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-workload-certs\") pod \"11ac369f-a9a0-479c-b534-6227afec3635\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " Oct 29 23:31:00.164388 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.164114 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-workload-socket\") pod \"11ac369f-a9a0-479c-b534-6227afec3635\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " Oct 29 23:31:00.164388 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.164220 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-istio-data\") pod \"11ac369f-a9a0-479c-b534-6227afec3635\" (UID: \"11ac369f-a9a0-479c-b534-6227afec3635\") " Oct 29 23:31:00.164388 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.164355 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-workload-certs" pod "11ac369f-a9a0-479c-b534-6227afec3635" (UID: "11ac369f-a9a0-479c-b534-6227afec3635"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:00.164738 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.164663 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-workload-socket" pod "11ac369f-a9a0-479c-b534-6227afec3635" (UID: "11ac369f-a9a0-479c-b534-6227afec3635"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:00.164910 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.164807 6029 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-envoy\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.164910 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.164852 6029 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11ac369f-a9a0-479c-b534-6227afec3635-istiod-ca-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.164910 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.164866 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8b4sc\" (UniqueName: \"kubernetes.io/projected/3cd04199-f906-4d0f-a0c6-4d45c20208bf-kube-api-access-8b4sc\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.164910 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.164880 6029 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-credential-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.164910 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.164890 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-istio-data" pod "11ac369f-a9a0-479c-b534-6227afec3635" (UID: "11ac369f-a9a0-479c-b534-6227afec3635"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:00.164910 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.164895 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbx6d\" (UniqueName: \"kubernetes.io/projected/11ac369f-a9a0-479c-b534-6227afec3635-kube-api-access-gbx6d\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.165408 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.164943 6029 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-workload-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.165408 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.164961 6029 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cd04199-f906-4d0f-a0c6-4d45c20208bf-istio-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.165408 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.164974 6029 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-workload-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.165408 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.164989 6029 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a44ecac-10fb-4a00-9596-716b57cc8dfa-istio-podinfo\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.165408 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.165005 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4rn4\" (UniqueName: \"kubernetes.io/projected/6a44ecac-10fb-4a00-9596-716b57cc8dfa-kube-api-access-d4rn4\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.167001 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.166963 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-istio-envoy" pod "11ac369f-a9a0-479c-b534-6227afec3635" (UID: "11ac369f-a9a0-479c-b534-6227afec3635"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:00.167428 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.167407 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/11ac369f-a9a0-479c-b534-6227afec3635-istio-podinfo" pod "11ac369f-a9a0-479c-b534-6227afec3635" (UID: "11ac369f-a9a0-479c-b534-6227afec3635"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:31:00.168756 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.168732 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11ac369f-a9a0-479c-b534-6227afec3635-istio-token" pod "11ac369f-a9a0-479c-b534-6227afec3635" (UID: "11ac369f-a9a0-479c-b534-6227afec3635"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:00.266364 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.266322 6029 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11ac369f-a9a0-479c-b534-6227afec3635-istio-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.266364 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.266357 6029 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11ac369f-a9a0-479c-b534-6227afec3635-istio-podinfo\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.266364 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.266371 6029 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-istio-envoy\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.266364 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.266384 6029 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11ac369f-a9a0-479c-b534-6227afec3635-istio-data\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.344540 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.344512 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:31:00.470379 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.468994 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-credential-socket\") pod \"c1768326-83dd-4203-a9ba-a855c88d5874\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " Oct 29 23:31:00.470379 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.469062 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-istio-envoy\") pod \"c1768326-83dd-4203-a9ba-a855c88d5874\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " Oct 29 23:31:00.470379 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.469091 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-istio-data\") pod \"c1768326-83dd-4203-a9ba-a855c88d5874\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " Oct 29 23:31:00.470379 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.469118 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-workload-certs\") pod \"c1768326-83dd-4203-a9ba-a855c88d5874\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " Oct 29 23:31:00.470379 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.469242 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c1768326-83dd-4203-a9ba-a855c88d5874-kube-api-access-s678j\" (UniqueName: \"kubernetes.io/projected/c1768326-83dd-4203-a9ba-a855c88d5874-kube-api-access-s678j\") pod \"c1768326-83dd-4203-a9ba-a855c88d5874\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " Oct 29 23:31:00.470379 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.469283 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-credential-socket" pod "c1768326-83dd-4203-a9ba-a855c88d5874" (UID: "c1768326-83dd-4203-a9ba-a855c88d5874"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:00.470379 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.469316 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-workload-socket\") pod \"c1768326-83dd-4203-a9ba-a855c88d5874\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " Oct 29 23:31:00.470379 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.469356 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c1768326-83dd-4203-a9ba-a855c88d5874-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1768326-83dd-4203-a9ba-a855c88d5874-istio-podinfo\") pod \"c1768326-83dd-4203-a9ba-a855c88d5874\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " Oct 29 23:31:00.470379 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.469391 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c1768326-83dd-4203-a9ba-a855c88d5874-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1768326-83dd-4203-a9ba-a855c88d5874-istiod-ca-cert\") pod \"c1768326-83dd-4203-a9ba-a855c88d5874\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " Oct 29 23:31:00.470379 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.469456 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c1768326-83dd-4203-a9ba-a855c88d5874-istio-token\" (UniqueName: \"kubernetes.io/projected/c1768326-83dd-4203-a9ba-a855c88d5874-istio-token\") pod \"c1768326-83dd-4203-a9ba-a855c88d5874\" (UID: \"c1768326-83dd-4203-a9ba-a855c88d5874\") " Oct 29 23:31:00.470379 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.469461 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-istio-data" pod "c1768326-83dd-4203-a9ba-a855c88d5874" (UID: "c1768326-83dd-4203-a9ba-a855c88d5874"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:00.470379 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.469962 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-workload-socket" pod "c1768326-83dd-4203-a9ba-a855c88d5874" (UID: "c1768326-83dd-4203-a9ba-a855c88d5874"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:00.470379 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.469995 6029 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-credential-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.470379 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.470017 6029 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-istio-data\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.470379 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.470027 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-workload-certs" pod "c1768326-83dd-4203-a9ba-a855c88d5874" (UID: "c1768326-83dd-4203-a9ba-a855c88d5874"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:00.472090 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.471949 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1768326-83dd-4203-a9ba-a855c88d5874-istiod-ca-cert" pod "c1768326-83dd-4203-a9ba-a855c88d5874" (UID: "c1768326-83dd-4203-a9ba-a855c88d5874"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:31:00.481163 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.481119 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1768326-83dd-4203-a9ba-a855c88d5874-istio-token" pod "c1768326-83dd-4203-a9ba-a855c88d5874" (UID: "c1768326-83dd-4203-a9ba-a855c88d5874"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:00.481163 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.481133 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1768326-83dd-4203-a9ba-a855c88d5874-kube-api-access-s678j" pod "c1768326-83dd-4203-a9ba-a855c88d5874" (UID: "c1768326-83dd-4203-a9ba-a855c88d5874"). InnerVolumeSpecName "kube-api-access-s678j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:00.481362 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.481241 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-istio-envoy" pod "c1768326-83dd-4203-a9ba-a855c88d5874" (UID: "c1768326-83dd-4203-a9ba-a855c88d5874"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:00.482755 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.482730 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c1768326-83dd-4203-a9ba-a855c88d5874-istio-podinfo" pod "c1768326-83dd-4203-a9ba-a855c88d5874" (UID: "c1768326-83dd-4203-a9ba-a855c88d5874"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:31:00.570863 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.570797 6029 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1768326-83dd-4203-a9ba-a855c88d5874-istio-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.570863 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.570854 6029 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-istio-envoy\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.570863 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.570864 6029 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-workload-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.570863 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.570873 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s678j\" (UniqueName: \"kubernetes.io/projected/c1768326-83dd-4203-a9ba-a855c88d5874-kube-api-access-s678j\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.571141 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.570885 6029 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1768326-83dd-4203-a9ba-a855c88d5874-workload-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.571141 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.570893 6029 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1768326-83dd-4203-a9ba-a855c88d5874-istio-podinfo\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.571141 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.570903 6029 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1768326-83dd-4203-a9ba-a855c88d5874-istiod-ca-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:00.677982 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.677944 6029 generic.go:356] "Generic (PLEG): container finished" podID="3cd04199-f906-4d0f-a0c6-4d45c20208bf" containerID="fe55643ea926cd29f10da9d7b518418a185d7444ae318139e9183d4323f1127c" exitCode=0 Oct 29 23:31:00.678152 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.677995 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" Oct 29 23:31:00.678152 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.678023 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" event={"ID":"3cd04199-f906-4d0f-a0c6-4d45c20208bf","Type":"ContainerDied","Data":"fe55643ea926cd29f10da9d7b518418a185d7444ae318139e9183d4323f1127c"} Oct 29 23:31:00.678152 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.678093 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5" event={"ID":"3cd04199-f906-4d0f-a0c6-4d45c20208bf","Type":"ContainerDied","Data":"2b141653c4a1865cda7001a01e9687370a8e2fdf1ae4e560129d35b3e19e8489"} Oct 29 23:31:00.678152 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.678128 6029 scope.go:122] "RemoveContainer" containerID="fe55643ea926cd29f10da9d7b518418a185d7444ae318139e9183d4323f1127c" Oct 29 23:31:00.679389 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.679366 6029 generic.go:356] "Generic (PLEG): container finished" podID="11ac369f-a9a0-479c-b534-6227afec3635" containerID="f4a307af5d26c5e0bb0e52a0319c88d3b7b2de411051d62ae52e656dfa6d7034" exitCode=0 Oct 29 23:31:00.679520 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.679416 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" Oct 29 23:31:00.679520 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.679454 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" event={"ID":"11ac369f-a9a0-479c-b534-6227afec3635","Type":"ContainerDied","Data":"f4a307af5d26c5e0bb0e52a0319c88d3b7b2de411051d62ae52e656dfa6d7034"} Oct 29 23:31:00.679520 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.679495 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs" event={"ID":"11ac369f-a9a0-479c-b534-6227afec3635","Type":"ContainerDied","Data":"b14a691a956866b4f6151871c91c4687dd967106813a14acb55d7a44f46b076a"} Oct 29 23:31:00.681149 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.681113 6029 generic.go:356] "Generic (PLEG): container finished" podID="c1768326-83dd-4203-a9ba-a855c88d5874" containerID="8013c9a5a776c5f092d536f3900dfdccc035216af7b3762e9acaa43ff06e429a" exitCode=0 Oct 29 23:31:00.681286 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.681165 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" Oct 29 23:31:00.681286 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.681194 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" event={"ID":"c1768326-83dd-4203-a9ba-a855c88d5874","Type":"ContainerDied","Data":"8013c9a5a776c5f092d536f3900dfdccc035216af7b3762e9acaa43ff06e429a"} Oct 29 23:31:00.681286 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.681240 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx" event={"ID":"c1768326-83dd-4203-a9ba-a855c88d5874","Type":"ContainerDied","Data":"8b82109cadd66582305a99654e2dd4ff3eecbe7686cd4ae4af3c46e5ddc5a870"} Oct 29 23:31:00.688073 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.688048 6029 generic.go:356] "Generic (PLEG): container finished" podID="6a44ecac-10fb-4a00-9596-716b57cc8dfa" containerID="fe72fb8f1ebdd62e7ba69808ddcb488bfb199f2360991ddcbb3e70f96cb5a15d" exitCode=0 Oct 29 23:31:00.688209 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.688094 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" event={"ID":"6a44ecac-10fb-4a00-9596-716b57cc8dfa","Type":"ContainerDied","Data":"fe72fb8f1ebdd62e7ba69808ddcb488bfb199f2360991ddcbb3e70f96cb5a15d"} Oct 29 23:31:00.688209 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.688102 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" Oct 29 23:31:00.688209 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.688137 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8" event={"ID":"6a44ecac-10fb-4a00-9596-716b57cc8dfa","Type":"ContainerDied","Data":"e835d367b48264900d6e36ad8184a033c91ee8b233a84a3e4114b4a92cea64a5"} Oct 29 23:31:00.691055 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.691035 6029 scope.go:122] "RemoveContainer" containerID="fe55643ea926cd29f10da9d7b518418a185d7444ae318139e9183d4323f1127c" Oct 29 23:31:00.691339 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:31:00.691313 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe55643ea926cd29f10da9d7b518418a185d7444ae318139e9183d4323f1127c\": container with ID starting with fe55643ea926cd29f10da9d7b518418a185d7444ae318139e9183d4323f1127c not found: ID does not exist" containerID="fe55643ea926cd29f10da9d7b518418a185d7444ae318139e9183d4323f1127c" Oct 29 23:31:00.691417 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.691346 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe55643ea926cd29f10da9d7b518418a185d7444ae318139e9183d4323f1127c"} err="failed to get container status \"fe55643ea926cd29f10da9d7b518418a185d7444ae318139e9183d4323f1127c\": rpc error: code = NotFound desc = could not find container \"fe55643ea926cd29f10da9d7b518418a185d7444ae318139e9183d4323f1127c\": container with ID starting with fe55643ea926cd29f10da9d7b518418a185d7444ae318139e9183d4323f1127c not found: ID does not exist" Oct 29 23:31:00.691417 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.691364 6029 scope.go:122] "RemoveContainer" containerID="f4a307af5d26c5e0bb0e52a0319c88d3b7b2de411051d62ae52e656dfa6d7034" Oct 29 23:31:00.703109 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.703087 6029 scope.go:122] "RemoveContainer" containerID="f4a307af5d26c5e0bb0e52a0319c88d3b7b2de411051d62ae52e656dfa6d7034" Oct 29 23:31:00.703387 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:31:00.703367 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4a307af5d26c5e0bb0e52a0319c88d3b7b2de411051d62ae52e656dfa6d7034\": container with ID starting with f4a307af5d26c5e0bb0e52a0319c88d3b7b2de411051d62ae52e656dfa6d7034 not found: ID does not exist" containerID="f4a307af5d26c5e0bb0e52a0319c88d3b7b2de411051d62ae52e656dfa6d7034" Oct 29 23:31:00.703436 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.703394 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4a307af5d26c5e0bb0e52a0319c88d3b7b2de411051d62ae52e656dfa6d7034"} err="failed to get container status \"f4a307af5d26c5e0bb0e52a0319c88d3b7b2de411051d62ae52e656dfa6d7034\": rpc error: code = NotFound desc = could not find container \"f4a307af5d26c5e0bb0e52a0319c88d3b7b2de411051d62ae52e656dfa6d7034\": container with ID starting with f4a307af5d26c5e0bb0e52a0319c88d3b7b2de411051d62ae52e656dfa6d7034 not found: ID does not exist" Oct 29 23:31:00.703436 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.703410 6029 scope.go:122] "RemoveContainer" containerID="8013c9a5a776c5f092d536f3900dfdccc035216af7b3762e9acaa43ff06e429a" Oct 29 23:31:00.713362 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.713309 6029 scope.go:122] "RemoveContainer" containerID="8013c9a5a776c5f092d536f3900dfdccc035216af7b3762e9acaa43ff06e429a" Oct 29 23:31:00.713694 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:31:00.713669 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8013c9a5a776c5f092d536f3900dfdccc035216af7b3762e9acaa43ff06e429a\": container with ID starting with 8013c9a5a776c5f092d536f3900dfdccc035216af7b3762e9acaa43ff06e429a not found: ID does not exist" containerID="8013c9a5a776c5f092d536f3900dfdccc035216af7b3762e9acaa43ff06e429a" Oct 29 23:31:00.713771 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.713702 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8013c9a5a776c5f092d536f3900dfdccc035216af7b3762e9acaa43ff06e429a"} err="failed to get container status \"8013c9a5a776c5f092d536f3900dfdccc035216af7b3762e9acaa43ff06e429a\": rpc error: code = NotFound desc = could not find container \"8013c9a5a776c5f092d536f3900dfdccc035216af7b3762e9acaa43ff06e429a\": container with ID starting with 8013c9a5a776c5f092d536f3900dfdccc035216af7b3762e9acaa43ff06e429a not found: ID does not exist" Oct 29 23:31:00.713771 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.713723 6029 scope.go:122] "RemoveContainer" containerID="fe72fb8f1ebdd62e7ba69808ddcb488bfb199f2360991ddcbb3e70f96cb5a15d" Oct 29 23:31:00.722744 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.722714 6029 scope.go:122] "RemoveContainer" containerID="fe72fb8f1ebdd62e7ba69808ddcb488bfb199f2360991ddcbb3e70f96cb5a15d" Oct 29 23:31:00.723092 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:31:00.723075 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe72fb8f1ebdd62e7ba69808ddcb488bfb199f2360991ddcbb3e70f96cb5a15d\": container with ID starting with fe72fb8f1ebdd62e7ba69808ddcb488bfb199f2360991ddcbb3e70f96cb5a15d not found: ID does not exist" containerID="fe72fb8f1ebdd62e7ba69808ddcb488bfb199f2360991ddcbb3e70f96cb5a15d" Oct 29 23:31:00.723141 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.723097 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe72fb8f1ebdd62e7ba69808ddcb488bfb199f2360991ddcbb3e70f96cb5a15d"} err="failed to get container status \"fe72fb8f1ebdd62e7ba69808ddcb488bfb199f2360991ddcbb3e70f96cb5a15d\": rpc error: code = NotFound desc = could not find container \"fe72fb8f1ebdd62e7ba69808ddcb488bfb199f2360991ddcbb3e70f96cb5a15d\": container with ID starting with fe72fb8f1ebdd62e7ba69808ddcb488bfb199f2360991ddcbb3e70f96cb5a15d not found: ID does not exist" Oct 29 23:31:00.792288 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.792224 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5"] Oct 29 23:31:00.797936 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.797902 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-4xtt5"] Oct 29 23:31:00.836605 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.836571 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8"] Oct 29 23:31:00.840777 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.840752 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-bfhj8"] Oct 29 23:31:00.878532 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.878498 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx"] Oct 29 23:31:00.894359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.894325 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-xvnjx"] Oct 29 23:31:00.923358 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.923326 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs"] Oct 29 23:31:00.928435 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:00.928404 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-837245-openshift-default-67857c7775-szlfs"] Oct 29 23:31:01.390717 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:01.390681 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="11ac369f-a9a0-479c-b534-6227afec3635" path="/var/lib/kubelet/pods/11ac369f-a9a0-479c-b534-6227afec3635/volumes" Oct 29 23:31:01.391152 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:01.391138 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="245515db-5ab4-46a3-a45b-2bd8c4b1bade" path="/var/lib/kubelet/pods/245515db-5ab4-46a3-a45b-2bd8c4b1bade/volumes" Oct 29 23:31:01.391537 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:01.391525 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3cd04199-f906-4d0f-a0c6-4d45c20208bf" path="/var/lib/kubelet/pods/3cd04199-f906-4d0f-a0c6-4d45c20208bf/volumes" Oct 29 23:31:01.392317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:01.392283 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6a44ecac-10fb-4a00-9596-716b57cc8dfa" path="/var/lib/kubelet/pods/6a44ecac-10fb-4a00-9596-716b57cc8dfa/volumes" Oct 29 23:31:01.392740 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:01.392726 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c1768326-83dd-4203-a9ba-a855c88d5874" path="/var/lib/kubelet/pods/c1768326-83dd-4203-a9ba-a855c88d5874/volumes" Oct 29 23:31:01.393178 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:01.393164 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c26dda21-42b8-4789-8658-e91d387542e3" path="/var/lib/kubelet/pods/c26dda21-42b8-4789-8658-e91d387542e3/volumes" Oct 29 23:31:01.393824 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:01.393803 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ff2c3fee-90cf-4c17-bd87-5f76e8166517" path="/var/lib/kubelet/pods/ff2c3fee-90cf-4c17-bd87-5f76e8166517/volumes" Oct 29 23:31:08.922382 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:31:08.922344 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:31:11.502179 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:11.502142 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh"] Oct 29 23:31:11.535701 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:11.535653 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9"] Oct 29 23:31:16.511013 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:16.510927 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh" podUID="b58f9001-4e4a-4959-8d80-53b37221fd59" containerName="payload-processing" containerID="cri-o://a808582a639bde1c7f7381842f218acd29141b50e55a3f247c0ae09b798b6d5d" gracePeriod=25 Oct 29 23:31:16.536064 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:16.536022 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9" podUID="430db6a8-1f92-4f9d-95be-369032f16c8d" containerName="payload-pre-processing" containerID="cri-o://11a4106c2f8b7ac792c93055d35768ee583b3487ce474f09a5335084917600a1" gracePeriod=25 Oct 29 23:31:21.678573 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:21.678534 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh" podUID="b58f9001-4e4a-4959-8d80-53b37221fd59" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 29 23:31:21.679045 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:21.679009 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9" podUID="430db6a8-1f92-4f9d-95be-369032f16c8d" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 29 23:31:24.102766 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.102726 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g"] Oct 29 23:31:24.103501 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.102982 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" podUID="77a4bccb-b4aa-4cc5-a204-b7b8b14e228b" containerName="maas-api" containerID="cri-o://4b2f10d392bccdf2c9d2c234cbf3efcad1c1c472ca8a0efc0dabec64c5ae1af1" gracePeriod=30 Oct 29 23:31:24.698537 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.698508 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" Oct 29 23:31:24.838453 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.838414 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-metrics-certs\" (UniqueName: \"kubernetes.io/secret/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-metrics-certs\") pod \"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b\" (UID: \"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b\") " Oct 29 23:31:24.838641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.838526 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-openshift-service-ca\") pod \"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b\" (UID: \"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b\") " Oct 29 23:31:24.838641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.838551 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-kube-api-access-bgvtd\" (UniqueName: \"kubernetes.io/projected/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-kube-api-access-bgvtd\") pod \"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b\" (UID: \"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b\") " Oct 29 23:31:24.838641 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.838615 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-maas-api-tls\") pod \"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b\" (UID: \"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b\") " Oct 29 23:31:24.839008 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.838974 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-openshift-service-ca" pod "77a4bccb-b4aa-4cc5-a204-b7b8b14e228b" (UID: "77a4bccb-b4aa-4cc5-a204-b7b8b14e228b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:31:24.840736 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.840705 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-metrics-certs" pod "77a4bccb-b4aa-4cc5-a204-b7b8b14e228b" (UID: "77a4bccb-b4aa-4cc5-a204-b7b8b14e228b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:31:24.841227 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.841206 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-kube-api-access-bgvtd" pod "77a4bccb-b4aa-4cc5-a204-b7b8b14e228b" (UID: "77a4bccb-b4aa-4cc5-a204-b7b8b14e228b"). InnerVolumeSpecName "kube-api-access-bgvtd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:24.841292 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.841208 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-maas-api-tls" pod "77a4bccb-b4aa-4cc5-a204-b7b8b14e228b" (UID: "77a4bccb-b4aa-4cc5-a204-b7b8b14e228b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:31:24.866906 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.866877 6029 generic.go:356] "Generic (PLEG): container finished" podID="77a4bccb-b4aa-4cc5-a204-b7b8b14e228b" containerID="4b2f10d392bccdf2c9d2c234cbf3efcad1c1c472ca8a0efc0dabec64c5ae1af1" exitCode=0 Oct 29 23:31:24.867063 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.866924 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" event={"ID":"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b","Type":"ContainerDied","Data":"4b2f10d392bccdf2c9d2c234cbf3efcad1c1c472ca8a0efc0dabec64c5ae1af1"} Oct 29 23:31:24.867063 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.866942 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" Oct 29 23:31:24.867063 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.866991 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g" event={"ID":"77a4bccb-b4aa-4cc5-a204-b7b8b14e228b","Type":"ContainerDied","Data":"d82d75f40551ae9768f9f751a015c9e15d8e8022f3f9c1e7973bcd548165ecb4"} Oct 29 23:31:24.867063 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.867014 6029 scope.go:122] "RemoveContainer" containerID="4b2f10d392bccdf2c9d2c234cbf3efcad1c1c472ca8a0efc0dabec64c5ae1af1" Oct 29 23:31:24.879254 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.879221 6029 scope.go:122] "RemoveContainer" containerID="4b2f10d392bccdf2c9d2c234cbf3efcad1c1c472ca8a0efc0dabec64c5ae1af1" Oct 29 23:31:24.879907 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:31:24.879880 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b2f10d392bccdf2c9d2c234cbf3efcad1c1c472ca8a0efc0dabec64c5ae1af1\": container with ID starting with 4b2f10d392bccdf2c9d2c234cbf3efcad1c1c472ca8a0efc0dabec64c5ae1af1 not found: ID does not exist" containerID="4b2f10d392bccdf2c9d2c234cbf3efcad1c1c472ca8a0efc0dabec64c5ae1af1" Oct 29 23:31:24.880009 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.879917 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b2f10d392bccdf2c9d2c234cbf3efcad1c1c472ca8a0efc0dabec64c5ae1af1"} err="failed to get container status \"4b2f10d392bccdf2c9d2c234cbf3efcad1c1c472ca8a0efc0dabec64c5ae1af1\": rpc error: code = NotFound desc = could not find container \"4b2f10d392bccdf2c9d2c234cbf3efcad1c1c472ca8a0efc0dabec64c5ae1af1\": container with ID starting with 4b2f10d392bccdf2c9d2c234cbf3efcad1c1c472ca8a0efc0dabec64c5ae1af1 not found: ID does not exist" Oct 29 23:31:24.925240 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.925159 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g"] Oct 29 23:31:24.927957 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.927927 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-be8726-5785f4b4d6-mrn8g"] Oct 29 23:31:24.939696 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.939666 6029 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-metrics-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:24.939696 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.939692 6029 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-openshift-service-ca\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:24.939981 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.939703 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgvtd\" (UniqueName: \"kubernetes.io/projected/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-kube-api-access-bgvtd\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:24.939981 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:24.939713 6029 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b-maas-api-tls\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:25.390441 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:25.390406 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="77a4bccb-b4aa-4cc5-a204-b7b8b14e228b" path="/var/lib/kubelet/pods/77a4bccb-b4aa-4cc5-a204-b7b8b14e228b/volumes" Oct 29 23:31:31.678943 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:31.678901 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh" podUID="b58f9001-4e4a-4959-8d80-53b37221fd59" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 29 23:31:31.679365 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:31.679040 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9" podUID="430db6a8-1f92-4f9d-95be-369032f16c8d" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 29 23:31:32.181882 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:32.181794 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv"] Oct 29 23:31:32.182779 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:32.182448 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" podUID="6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" containerName="istio-proxy" containerID="cri-o://b112ba333d8d82bf0cc9e223b595cf9ed774c64ee2728bdbce4fcdeec152e4a5" gracePeriod=30 Oct 29 23:31:32.193667 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:32.193633 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn"] Oct 29 23:31:32.193939 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:32.193909 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" podUID="1060b6c4-b5ad-4297-98a2-c2a241ed9186" containerName="istio-proxy" containerID="cri-o://5ce41860106138b6dc6b331bc0ef0a71f2b704e6a00735bf46a07a363bf993c6" gracePeriod=30 Oct 29 23:31:32.197331 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:32.197301 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz"] Oct 29 23:31:32.197609 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:32.197575 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" podUID="d32e3f33-6877-4d39-924b-746ea13ab6c5" containerName="istio-proxy" containerID="cri-o://5df8c09a4c6523e118314923c7a05d61de19d8eef8d764618fde0afaa68acee8" gracePeriod=30 Oct 29 23:31:32.200444 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:32.200421 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj"] Oct 29 23:31:32.200769 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:32.200739 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" podUID="3860268b-8c6e-4826-831f-e6efd1a0faf6" containerName="istio-proxy" containerID="cri-o://ed8453f3b5d7f55062daa28e8943690a9c7522b8f4972b326e449cff3f219809" gracePeriod=30 Oct 29 23:31:32.463106 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:32.461516 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 29 23:31:32.463106 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:32.461607 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" podUID="6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 29 23:31:33.443557 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:33.443517 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 29 23:31:33.444044 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:33.443583 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" podUID="1060b6c4-b5ad-4297-98a2-c2a241ed9186" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 29 23:31:33.470606 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:33.470544 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 29 23:31:33.470606 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:33.470603 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" podUID="d32e3f33-6877-4d39-924b-746ea13ab6c5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 29 23:31:34.038159 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:34.038119 6029 patch_prober.go:29] interesting pod/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 29 23:31:34.038329 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:34.038185 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" podUID="3860268b-8c6e-4826-831f-e6efd1a0faf6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 29 23:31:36.817878 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.817850 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh" Oct 29 23:31:36.848153 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.848128 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9" Oct 29 23:31:36.907993 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.907959 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/430db6a8-1f92-4f9d-95be-369032f16c8d-kube-api-access-wzqnh\" (UniqueName: \"kubernetes.io/projected/430db6a8-1f92-4f9d-95be-369032f16c8d-kube-api-access-wzqnh\") pod \"430db6a8-1f92-4f9d-95be-369032f16c8d\" (UID: \"430db6a8-1f92-4f9d-95be-369032f16c8d\") " Oct 29 23:31:36.908180 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.908055 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b58f9001-4e4a-4959-8d80-53b37221fd59-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b58f9001-4e4a-4959-8d80-53b37221fd59-plugins-config-volume\") pod \"b58f9001-4e4a-4959-8d80-53b37221fd59\" (UID: \"b58f9001-4e4a-4959-8d80-53b37221fd59\") " Oct 29 23:31:36.908180 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.908103 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/430db6a8-1f92-4f9d-95be-369032f16c8d-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/430db6a8-1f92-4f9d-95be-369032f16c8d-plugins-config-volume\") pod \"430db6a8-1f92-4f9d-95be-369032f16c8d\" (UID: \"430db6a8-1f92-4f9d-95be-369032f16c8d\") " Oct 29 23:31:36.908308 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.908201 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b58f9001-4e4a-4959-8d80-53b37221fd59-kube-api-access-2hl9w\" (UniqueName: \"kubernetes.io/projected/b58f9001-4e4a-4959-8d80-53b37221fd59-kube-api-access-2hl9w\") pod \"b58f9001-4e4a-4959-8d80-53b37221fd59\" (UID: \"b58f9001-4e4a-4959-8d80-53b37221fd59\") " Oct 29 23:31:36.908837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.908767 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b58f9001-4e4a-4959-8d80-53b37221fd59-plugins-config-volume" pod "b58f9001-4e4a-4959-8d80-53b37221fd59" (UID: "b58f9001-4e4a-4959-8d80-53b37221fd59"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:31:36.908837 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.908772 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/430db6a8-1f92-4f9d-95be-369032f16c8d-plugins-config-volume" pod "430db6a8-1f92-4f9d-95be-369032f16c8d" (UID: "430db6a8-1f92-4f9d-95be-369032f16c8d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:31:36.910984 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.910955 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b58f9001-4e4a-4959-8d80-53b37221fd59-kube-api-access-2hl9w" pod "b58f9001-4e4a-4959-8d80-53b37221fd59" (UID: "b58f9001-4e4a-4959-8d80-53b37221fd59"). InnerVolumeSpecName "kube-api-access-2hl9w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:36.911120 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.911106 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/430db6a8-1f92-4f9d-95be-369032f16c8d-kube-api-access-wzqnh" pod "430db6a8-1f92-4f9d-95be-369032f16c8d" (UID: "430db6a8-1f92-4f9d-95be-369032f16c8d"). InnerVolumeSpecName "kube-api-access-wzqnh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:36.959278 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.959245 6029 generic.go:356] "Generic (PLEG): container finished" podID="b58f9001-4e4a-4959-8d80-53b37221fd59" containerID="a808582a639bde1c7f7381842f218acd29141b50e55a3f247c0ae09b798b6d5d" exitCode=0 Oct 29 23:31:36.959469 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.959288 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh" Oct 29 23:31:36.959469 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.959331 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh" event={"ID":"b58f9001-4e4a-4959-8d80-53b37221fd59","Type":"ContainerDied","Data":"a808582a639bde1c7f7381842f218acd29141b50e55a3f247c0ae09b798b6d5d"} Oct 29 23:31:36.959469 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.959393 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh" event={"ID":"b58f9001-4e4a-4959-8d80-53b37221fd59","Type":"ContainerDied","Data":"78d106229b3370c01a053ae407da57a7b44ebb5202028923832e44261b12d656"} Oct 29 23:31:36.959469 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.959426 6029 scope.go:122] "RemoveContainer" containerID="a808582a639bde1c7f7381842f218acd29141b50e55a3f247c0ae09b798b6d5d" Oct 29 23:31:36.960926 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.960890 6029 generic.go:356] "Generic (PLEG): container finished" podID="430db6a8-1f92-4f9d-95be-369032f16c8d" containerID="11a4106c2f8b7ac792c93055d35768ee583b3487ce474f09a5335084917600a1" exitCode=0 Oct 29 23:31:36.961051 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.960933 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9" Oct 29 23:31:36.961051 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.960979 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9" event={"ID":"430db6a8-1f92-4f9d-95be-369032f16c8d","Type":"ContainerDied","Data":"11a4106c2f8b7ac792c93055d35768ee583b3487ce474f09a5335084917600a1"} Oct 29 23:31:36.961051 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.961038 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9" event={"ID":"430db6a8-1f92-4f9d-95be-369032f16c8d","Type":"ContainerDied","Data":"88a10589a00f9271fea721080803b64268f8a4be4c6cb4d00be3dbcc5afec455"} Oct 29 23:31:36.971874 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.971855 6029 scope.go:122] "RemoveContainer" containerID="a808582a639bde1c7f7381842f218acd29141b50e55a3f247c0ae09b798b6d5d" Oct 29 23:31:36.972178 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:31:36.972159 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a808582a639bde1c7f7381842f218acd29141b50e55a3f247c0ae09b798b6d5d\": container with ID starting with a808582a639bde1c7f7381842f218acd29141b50e55a3f247c0ae09b798b6d5d not found: ID does not exist" containerID="a808582a639bde1c7f7381842f218acd29141b50e55a3f247c0ae09b798b6d5d" Oct 29 23:31:36.972256 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.972192 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a808582a639bde1c7f7381842f218acd29141b50e55a3f247c0ae09b798b6d5d"} err="failed to get container status \"a808582a639bde1c7f7381842f218acd29141b50e55a3f247c0ae09b798b6d5d\": rpc error: code = NotFound desc = could not find container \"a808582a639bde1c7f7381842f218acd29141b50e55a3f247c0ae09b798b6d5d\": container with ID starting with a808582a639bde1c7f7381842f218acd29141b50e55a3f247c0ae09b798b6d5d not found: ID does not exist" Oct 29 23:31:36.972256 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.972217 6029 scope.go:122] "RemoveContainer" containerID="11a4106c2f8b7ac792c93055d35768ee583b3487ce474f09a5335084917600a1" Oct 29 23:31:36.982009 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.981991 6029 scope.go:122] "RemoveContainer" containerID="11a4106c2f8b7ac792c93055d35768ee583b3487ce474f09a5335084917600a1" Oct 29 23:31:36.982416 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:31:36.982393 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11a4106c2f8b7ac792c93055d35768ee583b3487ce474f09a5335084917600a1\": container with ID starting with 11a4106c2f8b7ac792c93055d35768ee583b3487ce474f09a5335084917600a1 not found: ID does not exist" containerID="11a4106c2f8b7ac792c93055d35768ee583b3487ce474f09a5335084917600a1" Oct 29 23:31:36.982475 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:36.982428 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11a4106c2f8b7ac792c93055d35768ee583b3487ce474f09a5335084917600a1"} err="failed to get container status \"11a4106c2f8b7ac792c93055d35768ee583b3487ce474f09a5335084917600a1\": rpc error: code = NotFound desc = could not find container \"11a4106c2f8b7ac792c93055d35768ee583b3487ce474f09a5335084917600a1\": container with ID starting with 11a4106c2f8b7ac792c93055d35768ee583b3487ce474f09a5335084917600a1 not found: ID does not exist" Oct 29 23:31:37.009519 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.009491 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzqnh\" (UniqueName: \"kubernetes.io/projected/430db6a8-1f92-4f9d-95be-369032f16c8d-kube-api-access-wzqnh\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.009519 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.009518 6029 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b58f9001-4e4a-4959-8d80-53b37221fd59-plugins-config-volume\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.009686 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.009534 6029 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/430db6a8-1f92-4f9d-95be-369032f16c8d-plugins-config-volume\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.009686 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.009546 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hl9w\" (UniqueName: \"kubernetes.io/projected/b58f9001-4e4a-4959-8d80-53b37221fd59-kube-api-access-2hl9w\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.018790 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.018763 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh"] Oct 29 23:31:37.021230 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.021206 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-be8726-6555644df4-h2vsh"] Oct 29 23:31:37.059359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.059281 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9"] Oct 29 23:31:37.062763 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.062733 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-be8726-f56f5686c-d6gz9"] Oct 29 23:31:37.407428 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.407316 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="430db6a8-1f92-4f9d-95be-369032f16c8d" path="/var/lib/kubelet/pods/430db6a8-1f92-4f9d-95be-369032f16c8d/volumes" Oct 29 23:31:37.407900 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.407858 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b58f9001-4e4a-4959-8d80-53b37221fd59" path="/var/lib/kubelet/pods/b58f9001-4e4a-4959-8d80-53b37221fd59/volumes" Oct 29 23:31:37.489902 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.489872 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:31:37.591326 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.591300 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:31:37.593489 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.593462 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:31:37.595608 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.595565 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:31:37.615879 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.615849 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-credential-socket\") pod \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " Oct 29 23:31:37.616042 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.615892 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-token\" (UniqueName: \"kubernetes.io/projected/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-token\") pod \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " Oct 29 23:31:37.616042 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.615932 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-envoy\") pod \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " Oct 29 23:31:37.616042 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.615982 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1060b6c4-b5ad-4297-98a2-c2a241ed9186-kube-api-access-d47qt\" (UniqueName: \"kubernetes.io/projected/1060b6c4-b5ad-4297-98a2-c2a241ed9186-kube-api-access-d47qt\") pod \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " Oct 29 23:31:37.616797 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.616056 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-podinfo\") pod \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " Oct 29 23:31:37.616797 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.616179 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-credential-socket" pod "1060b6c4-b5ad-4297-98a2-c2a241ed9186" (UID: "1060b6c4-b5ad-4297-98a2-c2a241ed9186"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:37.616797 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.616217 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-workload-certs\") pod \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " Oct 29 23:31:37.616797 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.616277 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istiod-ca-cert\") pod \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " Oct 29 23:31:37.616797 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.616352 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-data\") pod \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " Oct 29 23:31:37.616797 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.616428 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-workload-socket\") pod \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\" (UID: \"1060b6c4-b5ad-4297-98a2-c2a241ed9186\") " Oct 29 23:31:37.616797 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.616518 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-workload-certs" pod "1060b6c4-b5ad-4297-98a2-c2a241ed9186" (UID: "1060b6c4-b5ad-4297-98a2-c2a241ed9186"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:37.618362 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.616869 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-data" pod "1060b6c4-b5ad-4297-98a2-c2a241ed9186" (UID: "1060b6c4-b5ad-4297-98a2-c2a241ed9186"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:37.618362 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.617100 6029 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-data\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.618362 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.617124 6029 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-credential-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.618362 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.617141 6029 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-workload-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.618362 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.617120 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-workload-socket" pod "1060b6c4-b5ad-4297-98a2-c2a241ed9186" (UID: "1060b6c4-b5ad-4297-98a2-c2a241ed9186"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:37.618362 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.617507 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istiod-ca-cert" pod "1060b6c4-b5ad-4297-98a2-c2a241ed9186" (UID: "1060b6c4-b5ad-4297-98a2-c2a241ed9186"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:31:37.621314 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.621284 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-envoy" pod "1060b6c4-b5ad-4297-98a2-c2a241ed9186" (UID: "1060b6c4-b5ad-4297-98a2-c2a241ed9186"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:37.621522 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.621500 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-podinfo" pod "1060b6c4-b5ad-4297-98a2-c2a241ed9186" (UID: "1060b6c4-b5ad-4297-98a2-c2a241ed9186"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:31:37.623019 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.622366 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1060b6c4-b5ad-4297-98a2-c2a241ed9186-kube-api-access-d47qt" pod "1060b6c4-b5ad-4297-98a2-c2a241ed9186" (UID: "1060b6c4-b5ad-4297-98a2-c2a241ed9186"). InnerVolumeSpecName "kube-api-access-d47qt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:37.629687 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.629655 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-token" pod "1060b6c4-b5ad-4297-98a2-c2a241ed9186" (UID: "1060b6c4-b5ad-4297-98a2-c2a241ed9186"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:37.717880 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.717845 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-envoy\") pod \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " Oct 29 23:31:37.718070 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.717891 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-credential-socket\") pod \"3860268b-8c6e-4826-831f-e6efd1a0faf6\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " Oct 29 23:31:37.718070 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.717918 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-token\" (UniqueName: \"kubernetes.io/projected/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-token\") pod \"d32e3f33-6877-4d39-924b-746ea13ab6c5\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " Oct 29 23:31:37.718070 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.717951 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-podinfo\") pod \"d32e3f33-6877-4d39-924b-746ea13ab6c5\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " Oct 29 23:31:37.718070 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.718031 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-workload-socket\") pod \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " Oct 29 23:31:37.718070 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.718067 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-data\") pod \"d32e3f33-6877-4d39-924b-746ea13ab6c5\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " Oct 29 23:31:37.718350 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.718108 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-token\" (UniqueName: \"kubernetes.io/projected/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-token\") pod \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " Oct 29 23:31:37.718350 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.718154 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-envoy\") pod \"3860268b-8c6e-4826-831f-e6efd1a0faf6\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " Oct 29 23:31:37.718350 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.718208 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3860268b-8c6e-4826-831f-e6efd1a0faf6-kube-api-access-krqwl\" (UniqueName: \"kubernetes.io/projected/3860268b-8c6e-4826-831f-e6efd1a0faf6-kube-api-access-krqwl\") pod \"3860268b-8c6e-4826-831f-e6efd1a0faf6\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " Oct 29 23:31:37.718350 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.718211 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-credential-socket" pod "3860268b-8c6e-4826-831f-e6efd1a0faf6" (UID: "3860268b-8c6e-4826-831f-e6efd1a0faf6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:37.718350 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.718241 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d32e3f33-6877-4d39-924b-746ea13ab6c5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d32e3f33-6877-4d39-924b-746ea13ab6c5-istiod-ca-cert\") pod \"d32e3f33-6877-4d39-924b-746ea13ab6c5\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " Oct 29 23:31:37.718350 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.718289 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-workload-socket" pod "6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" (UID: "6e114c59-0ecc-4eed-ad14-7e2c6ad38d78"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:37.718350 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.718331 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d32e3f33-6877-4d39-924b-746ea13ab6c5-kube-api-access-zdhzh\" (UniqueName: \"kubernetes.io/projected/d32e3f33-6877-4d39-924b-746ea13ab6c5-kube-api-access-zdhzh\") pod \"d32e3f33-6877-4d39-924b-746ea13ab6c5\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " Oct 29 23:31:37.718706 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.718378 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-podinfo\") pod \"3860268b-8c6e-4826-831f-e6efd1a0faf6\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " Oct 29 23:31:37.718706 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.718413 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istiod-ca-cert\") pod \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " Oct 29 23:31:37.718706 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.718475 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-credential-socket\") pod \"d32e3f33-6877-4d39-924b-746ea13ab6c5\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " Oct 29 23:31:37.718706 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.718517 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-token\" (UniqueName: \"kubernetes.io/projected/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-token\") pod \"3860268b-8c6e-4826-831f-e6efd1a0faf6\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " Oct 29 23:31:37.718706 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.718520 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d32e3f33-6877-4d39-924b-746ea13ab6c5-istiod-ca-cert" pod "d32e3f33-6877-4d39-924b-746ea13ab6c5" (UID: "d32e3f33-6877-4d39-924b-746ea13ab6c5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:31:37.718706 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.718572 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-data\") pod \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " Oct 29 23:31:37.718706 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.718598 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3860268b-8c6e-4826-831f-e6efd1a0faf6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3860268b-8c6e-4826-831f-e6efd1a0faf6-istiod-ca-cert\") pod \"3860268b-8c6e-4826-831f-e6efd1a0faf6\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " Oct 29 23:31:37.718706 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.718628 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-workload-socket\") pod \"3860268b-8c6e-4826-831f-e6efd1a0faf6\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " Oct 29 23:31:37.718706 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.718662 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-workload-certs\") pod \"3860268b-8c6e-4826-831f-e6efd1a0faf6\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " Oct 29 23:31:37.719525 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.718690 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-workload-socket\") pod \"d32e3f33-6877-4d39-924b-746ea13ab6c5\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " Oct 29 23:31:37.719525 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.719454 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-podinfo\") pod \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " Oct 29 23:31:37.719525 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.719509 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-workload-certs\") pod \"d32e3f33-6877-4d39-924b-746ea13ab6c5\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " Oct 29 23:31:37.720751 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.720719 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-data" pod "6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" (UID: "6e114c59-0ecc-4eed-ad14-7e2c6ad38d78"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:37.720751 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.720737 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istiod-ca-cert" pod "6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" (UID: "6e114c59-0ecc-4eed-ad14-7e2c6ad38d78"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:31:37.720938 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.720914 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-data" pod "d32e3f33-6877-4d39-924b-746ea13ab6c5" (UID: "d32e3f33-6877-4d39-924b-746ea13ab6c5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:37.722359 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.722327 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-envoy" pod "3860268b-8c6e-4826-831f-e6efd1a0faf6" (UID: "3860268b-8c6e-4826-831f-e6efd1a0faf6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:37.722554 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.722538 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-credential-socket" pod "d32e3f33-6877-4d39-924b-746ea13ab6c5" (UID: "d32e3f33-6877-4d39-924b-746ea13ab6c5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:37.723469 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.722968 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-workload-certs\") pod \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " Oct 29 23:31:37.723469 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.723023 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-credential-socket\") pod \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " Oct 29 23:31:37.723469 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.723088 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-kube-api-access-9lqv2\" (UniqueName: \"kubernetes.io/projected/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-kube-api-access-9lqv2\") pod \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\" (UID: \"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78\") " Oct 29 23:31:37.723469 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.723100 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3860268b-8c6e-4826-831f-e6efd1a0faf6-kube-api-access-krqwl" pod "3860268b-8c6e-4826-831f-e6efd1a0faf6" (UID: "3860268b-8c6e-4826-831f-e6efd1a0faf6"). InnerVolumeSpecName "kube-api-access-krqwl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:37.723469 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.723144 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-data\") pod \"3860268b-8c6e-4826-831f-e6efd1a0faf6\" (UID: \"3860268b-8c6e-4826-831f-e6efd1a0faf6\") " Oct 29 23:31:37.723469 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.723182 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-envoy\") pod \"d32e3f33-6877-4d39-924b-746ea13ab6c5\" (UID: \"d32e3f33-6877-4d39-924b-746ea13ab6c5\") " Oct 29 23:31:37.723469 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.723198 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-token" pod "d32e3f33-6877-4d39-924b-746ea13ab6c5" (UID: "d32e3f33-6877-4d39-924b-746ea13ab6c5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:37.723469 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.723265 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-podinfo" pod "d32e3f33-6877-4d39-924b-746ea13ab6c5" (UID: "d32e3f33-6877-4d39-924b-746ea13ab6c5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:31:37.723953 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.723651 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-workload-socket" pod "3860268b-8c6e-4826-831f-e6efd1a0faf6" (UID: "3860268b-8c6e-4826-831f-e6efd1a0faf6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:37.723953 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.723902 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-workload-certs" pod "3860268b-8c6e-4826-831f-e6efd1a0faf6" (UID: "3860268b-8c6e-4826-831f-e6efd1a0faf6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:37.724311 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.724099 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-credential-socket" pod "6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" (UID: "6e114c59-0ecc-4eed-ad14-7e2c6ad38d78"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:37.724396 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.724329 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-workload-certs" pod "6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" (UID: "6e114c59-0ecc-4eed-ad14-7e2c6ad38d78"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:37.724592 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.724549 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-token" pod "6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" (UID: "6e114c59-0ecc-4eed-ad14-7e2c6ad38d78"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:37.724777 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.724760 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-data" pod "3860268b-8c6e-4826-831f-e6efd1a0faf6" (UID: "3860268b-8c6e-4826-831f-e6efd1a0faf6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:37.724932 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.724907 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3860268b-8c6e-4826-831f-e6efd1a0faf6-istiod-ca-cert" pod "3860268b-8c6e-4826-831f-e6efd1a0faf6" (UID: "3860268b-8c6e-4826-831f-e6efd1a0faf6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:31:37.725218 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725194 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-workload-socket" pod "d32e3f33-6877-4d39-924b-746ea13ab6c5" (UID: "d32e3f33-6877-4d39-924b-746ea13ab6c5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:37.725424 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725352 6029 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-data\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.725424 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725379 6029 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-podinfo\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.725424 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725392 6029 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-credential-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.725424 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725413 6029 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.725659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725428 6029 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-podinfo\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.725659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725441 6029 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istiod-ca-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.725659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725454 6029 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-workload-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.725659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725473 6029 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-data\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.725659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725488 6029 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.725659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725503 6029 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-envoy\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.725659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725516 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krqwl\" (UniqueName: \"kubernetes.io/projected/3860268b-8c6e-4826-831f-e6efd1a0faf6-kube-api-access-krqwl\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.725659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725536 6029 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-workload-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.725659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725590 6029 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d32e3f33-6877-4d39-924b-746ea13ab6c5-istiod-ca-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.725659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725606 6029 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istiod-ca-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.725659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725625 6029 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.725659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725641 6029 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-credential-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.725659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725655 6029 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1060b6c4-b5ad-4297-98a2-c2a241ed9186-istio-envoy\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.726352 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725671 6029 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-data\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.726352 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725690 6029 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3860268b-8c6e-4826-831f-e6efd1a0faf6-istiod-ca-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.726352 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725704 6029 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-workload-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.726352 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725718 6029 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3860268b-8c6e-4826-831f-e6efd1a0faf6-workload-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.726352 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725733 6029 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-workload-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.726352 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725752 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d47qt\" (UniqueName: \"kubernetes.io/projected/1060b6c4-b5ad-4297-98a2-c2a241ed9186-kube-api-access-d47qt\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.726352 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725767 6029 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-workload-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.726352 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.725782 6029 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-credential-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.726352 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.726163 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-envoy" pod "6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" (UID: "6e114c59-0ecc-4eed-ad14-7e2c6ad38d78"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:37.727991 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.726522 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-workload-certs" pod "d32e3f33-6877-4d39-924b-746ea13ab6c5" (UID: "d32e3f33-6877-4d39-924b-746ea13ab6c5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:37.729194 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.729165 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-podinfo" pod "6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" (UID: "6e114c59-0ecc-4eed-ad14-7e2c6ad38d78"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:31:37.729298 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.729249 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-kube-api-access-9lqv2" pod "6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" (UID: "6e114c59-0ecc-4eed-ad14-7e2c6ad38d78"). InnerVolumeSpecName "kube-api-access-9lqv2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:37.732855 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.730940 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d32e3f33-6877-4d39-924b-746ea13ab6c5-kube-api-access-zdhzh" pod "d32e3f33-6877-4d39-924b-746ea13ab6c5" (UID: "d32e3f33-6877-4d39-924b-746ea13ab6c5"). InnerVolumeSpecName "kube-api-access-zdhzh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:37.735702 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.734098 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-envoy" pod "d32e3f33-6877-4d39-924b-746ea13ab6c5" (UID: "d32e3f33-6877-4d39-924b-746ea13ab6c5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:37.735702 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.734170 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-token" pod "3860268b-8c6e-4826-831f-e6efd1a0faf6" (UID: "3860268b-8c6e-4826-831f-e6efd1a0faf6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:37.735918 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.735896 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-podinfo" pod "3860268b-8c6e-4826-831f-e6efd1a0faf6" (UID: "3860268b-8c6e-4826-831f-e6efd1a0faf6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:31:37.826731 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.826641 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdhzh\" (UniqueName: \"kubernetes.io/projected/d32e3f33-6877-4d39-924b-746ea13ab6c5-kube-api-access-zdhzh\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.826731 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.826675 6029 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-podinfo\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.826731 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.826688 6029 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3860268b-8c6e-4826-831f-e6efd1a0faf6-istio-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.826731 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.826700 6029 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-podinfo\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.826731 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.826712 6029 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-workload-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.826731 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.826725 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lqv2\" (UniqueName: \"kubernetes.io/projected/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-kube-api-access-9lqv2\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.827260 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.826737 6029 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d32e3f33-6877-4d39-924b-746ea13ab6c5-istio-envoy\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.827260 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.826749 6029 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78-istio-envoy\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:37.970275 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.970236 6029 generic.go:356] "Generic (PLEG): container finished" podID="3860268b-8c6e-4826-831f-e6efd1a0faf6" containerID="ed8453f3b5d7f55062daa28e8943690a9c7522b8f4972b326e449cff3f219809" exitCode=0 Oct 29 23:31:37.970448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.970317 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" Oct 29 23:31:37.970448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.970315 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" event={"ID":"3860268b-8c6e-4826-831f-e6efd1a0faf6","Type":"ContainerDied","Data":"ed8453f3b5d7f55062daa28e8943690a9c7522b8f4972b326e449cff3f219809"} Oct 29 23:31:37.970573 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.970467 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj" event={"ID":"3860268b-8c6e-4826-831f-e6efd1a0faf6","Type":"ContainerDied","Data":"81a57d8d87538f40fe115051814108575ae28b7bdd9e69c68e8ca08e737b39d4"} Oct 29 23:31:37.970573 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.970496 6029 scope.go:122] "RemoveContainer" containerID="ed8453f3b5d7f55062daa28e8943690a9c7522b8f4972b326e449cff3f219809" Oct 29 23:31:37.971900 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.971875 6029 generic.go:356] "Generic (PLEG): container finished" podID="d32e3f33-6877-4d39-924b-746ea13ab6c5" containerID="5df8c09a4c6523e118314923c7a05d61de19d8eef8d764618fde0afaa68acee8" exitCode=0 Oct 29 23:31:37.971993 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.971944 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" Oct 29 23:31:37.971993 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.971951 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" event={"ID":"d32e3f33-6877-4d39-924b-746ea13ab6c5","Type":"ContainerDied","Data":"5df8c09a4c6523e118314923c7a05d61de19d8eef8d764618fde0afaa68acee8"} Oct 29 23:31:37.972113 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.972020 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz" event={"ID":"d32e3f33-6877-4d39-924b-746ea13ab6c5","Type":"ContainerDied","Data":"52b254cb903be7fe364ad45aca5f57c4b15c3054b20cfc250e6625124c57864c"} Oct 29 23:31:37.973567 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.973545 6029 generic.go:356] "Generic (PLEG): container finished" podID="6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" containerID="b112ba333d8d82bf0cc9e223b595cf9ed774c64ee2728bdbce4fcdeec152e4a5" exitCode=0 Oct 29 23:31:37.973686 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.973596 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" Oct 29 23:31:37.973686 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.973631 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" event={"ID":"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78","Type":"ContainerDied","Data":"b112ba333d8d82bf0cc9e223b595cf9ed774c64ee2728bdbce4fcdeec152e4a5"} Oct 29 23:31:37.973686 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.973683 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv" event={"ID":"6e114c59-0ecc-4eed-ad14-7e2c6ad38d78","Type":"ContainerDied","Data":"2d23c336cfa813364651de10682227831f2b0567bbf5068f5008781627063838"} Oct 29 23:31:37.975241 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.975218 6029 generic.go:356] "Generic (PLEG): container finished" podID="1060b6c4-b5ad-4297-98a2-c2a241ed9186" containerID="5ce41860106138b6dc6b331bc0ef0a71f2b704e6a00735bf46a07a363bf993c6" exitCode=0 Oct 29 23:31:37.975352 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.975273 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" event={"ID":"1060b6c4-b5ad-4297-98a2-c2a241ed9186","Type":"ContainerDied","Data":"5ce41860106138b6dc6b331bc0ef0a71f2b704e6a00735bf46a07a363bf993c6"} Oct 29 23:31:37.975352 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.975310 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" event={"ID":"1060b6c4-b5ad-4297-98a2-c2a241ed9186","Type":"ContainerDied","Data":"2e1704a82f04b258d8c7992869b2741795b0fa4f2b9b2c8f68295de75e67ed78"} Oct 29 23:31:37.975352 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.975316 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn" Oct 29 23:31:37.981756 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.981734 6029 scope.go:122] "RemoveContainer" containerID="ed8453f3b5d7f55062daa28e8943690a9c7522b8f4972b326e449cff3f219809" Oct 29 23:31:37.982107 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:31:37.982078 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed8453f3b5d7f55062daa28e8943690a9c7522b8f4972b326e449cff3f219809\": container with ID starting with ed8453f3b5d7f55062daa28e8943690a9c7522b8f4972b326e449cff3f219809 not found: ID does not exist" containerID="ed8453f3b5d7f55062daa28e8943690a9c7522b8f4972b326e449cff3f219809" Oct 29 23:31:37.982244 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.982118 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed8453f3b5d7f55062daa28e8943690a9c7522b8f4972b326e449cff3f219809"} err="failed to get container status \"ed8453f3b5d7f55062daa28e8943690a9c7522b8f4972b326e449cff3f219809\": rpc error: code = NotFound desc = could not find container \"ed8453f3b5d7f55062daa28e8943690a9c7522b8f4972b326e449cff3f219809\": container with ID starting with ed8453f3b5d7f55062daa28e8943690a9c7522b8f4972b326e449cff3f219809 not found: ID does not exist" Oct 29 23:31:37.982244 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.982143 6029 scope.go:122] "RemoveContainer" containerID="5df8c09a4c6523e118314923c7a05d61de19d8eef8d764618fde0afaa68acee8" Oct 29 23:31:37.993925 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.993905 6029 scope.go:122] "RemoveContainer" containerID="5df8c09a4c6523e118314923c7a05d61de19d8eef8d764618fde0afaa68acee8" Oct 29 23:31:37.994248 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:31:37.994230 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5df8c09a4c6523e118314923c7a05d61de19d8eef8d764618fde0afaa68acee8\": container with ID starting with 5df8c09a4c6523e118314923c7a05d61de19d8eef8d764618fde0afaa68acee8 not found: ID does not exist" containerID="5df8c09a4c6523e118314923c7a05d61de19d8eef8d764618fde0afaa68acee8" Oct 29 23:31:37.994291 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.994256 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5df8c09a4c6523e118314923c7a05d61de19d8eef8d764618fde0afaa68acee8"} err="failed to get container status \"5df8c09a4c6523e118314923c7a05d61de19d8eef8d764618fde0afaa68acee8\": rpc error: code = NotFound desc = could not find container \"5df8c09a4c6523e118314923c7a05d61de19d8eef8d764618fde0afaa68acee8\": container with ID starting with 5df8c09a4c6523e118314923c7a05d61de19d8eef8d764618fde0afaa68acee8 not found: ID does not exist" Oct 29 23:31:37.994291 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:37.994272 6029 scope.go:122] "RemoveContainer" containerID="b112ba333d8d82bf0cc9e223b595cf9ed774c64ee2728bdbce4fcdeec152e4a5" Oct 29 23:31:38.003216 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:38.003200 6029 scope.go:122] "RemoveContainer" containerID="b112ba333d8d82bf0cc9e223b595cf9ed774c64ee2728bdbce4fcdeec152e4a5" Oct 29 23:31:38.003530 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:31:38.003510 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b112ba333d8d82bf0cc9e223b595cf9ed774c64ee2728bdbce4fcdeec152e4a5\": container with ID starting with b112ba333d8d82bf0cc9e223b595cf9ed774c64ee2728bdbce4fcdeec152e4a5 not found: ID does not exist" containerID="b112ba333d8d82bf0cc9e223b595cf9ed774c64ee2728bdbce4fcdeec152e4a5" Oct 29 23:31:38.003574 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:38.003538 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b112ba333d8d82bf0cc9e223b595cf9ed774c64ee2728bdbce4fcdeec152e4a5"} err="failed to get container status \"b112ba333d8d82bf0cc9e223b595cf9ed774c64ee2728bdbce4fcdeec152e4a5\": rpc error: code = NotFound desc = could not find container \"b112ba333d8d82bf0cc9e223b595cf9ed774c64ee2728bdbce4fcdeec152e4a5\": container with ID starting with b112ba333d8d82bf0cc9e223b595cf9ed774c64ee2728bdbce4fcdeec152e4a5 not found: ID does not exist" Oct 29 23:31:38.003574 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:38.003554 6029 scope.go:122] "RemoveContainer" containerID="5ce41860106138b6dc6b331bc0ef0a71f2b704e6a00735bf46a07a363bf993c6" Oct 29 23:31:38.013165 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:38.013141 6029 scope.go:122] "RemoveContainer" containerID="5ce41860106138b6dc6b331bc0ef0a71f2b704e6a00735bf46a07a363bf993c6" Oct 29 23:31:38.013520 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:31:38.013499 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ce41860106138b6dc6b331bc0ef0a71f2b704e6a00735bf46a07a363bf993c6\": container with ID starting with 5ce41860106138b6dc6b331bc0ef0a71f2b704e6a00735bf46a07a363bf993c6 not found: ID does not exist" containerID="5ce41860106138b6dc6b331bc0ef0a71f2b704e6a00735bf46a07a363bf993c6" Oct 29 23:31:38.013596 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:38.013532 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ce41860106138b6dc6b331bc0ef0a71f2b704e6a00735bf46a07a363bf993c6"} err="failed to get container status \"5ce41860106138b6dc6b331bc0ef0a71f2b704e6a00735bf46a07a363bf993c6\": rpc error: code = NotFound desc = could not find container \"5ce41860106138b6dc6b331bc0ef0a71f2b704e6a00735bf46a07a363bf993c6\": container with ID starting with 5ce41860106138b6dc6b331bc0ef0a71f2b704e6a00735bf46a07a363bf993c6 not found: ID does not exist" Oct 29 23:31:38.060525 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:38.060459 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz"] Oct 29 23:31:38.074244 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:38.074215 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-2t4kz"] Oct 29 23:31:38.111032 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:38.110945 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj"] Oct 29 23:31:38.115095 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:38.115064 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-6hdkj"] Oct 29 23:31:38.151580 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:38.151548 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv"] Oct 29 23:31:38.155681 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:38.155651 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-c4nbv"] Oct 29 23:31:38.193176 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:38.193146 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn"] Oct 29 23:31:38.195505 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:38.195483 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-be8726-openshift-default-55dcd5768f-mw9pn"] Oct 29 23:31:38.922553 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:31:38.922471 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:31:39.389190 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:39.389157 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1060b6c4-b5ad-4297-98a2-c2a241ed9186" path="/var/lib/kubelet/pods/1060b6c4-b5ad-4297-98a2-c2a241ed9186/volumes" Oct 29 23:31:39.389619 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:39.389606 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3860268b-8c6e-4826-831f-e6efd1a0faf6" path="/var/lib/kubelet/pods/3860268b-8c6e-4826-831f-e6efd1a0faf6/volumes" Oct 29 23:31:39.390013 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:39.389999 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" path="/var/lib/kubelet/pods/6e114c59-0ecc-4eed-ad14-7e2c6ad38d78/volumes" Oct 29 23:31:39.390702 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:39.390688 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d32e3f33-6877-4d39-924b-746ea13ab6c5" path="/var/lib/kubelet/pods/d32e3f33-6877-4d39-924b-746ea13ab6c5/volumes" Oct 29 23:31:46.135354 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:46.135308 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2"] Oct 29 23:31:46.135856 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:46.135565 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" podUID="b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb" containerName="maas-api" containerID="cri-o://27e966501973201c4dface7cabd7506d079a2e0aeb3973ecb1f9e54f3fbc9145" gracePeriod=30 Oct 29 23:31:46.408780 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:46.408749 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" Oct 29 23:31:46.525430 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:46.525379 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-maas-api-tls\") pod \"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb\" (UID: \"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb\") " Oct 29 23:31:46.525628 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:46.525521 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-kube-api-access-mbv28\" (UniqueName: \"kubernetes.io/projected/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-kube-api-access-mbv28\") pod \"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb\" (UID: \"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb\") " Oct 29 23:31:46.525628 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:46.525591 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-openshift-service-ca\") pod \"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb\" (UID: \"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb\") " Oct 29 23:31:46.525799 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:46.525772 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-metrics-certs\") pod \"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb\" (UID: \"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb\") " Oct 29 23:31:46.529839 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:46.527394 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-openshift-service-ca" pod "b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb" (UID: "b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:31:46.533195 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:46.532690 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-metrics-certs" pod "b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb" (UID: "b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:31:46.547778 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:46.547734 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-kube-api-access-mbv28" pod "b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb" (UID: "b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb"). InnerVolumeSpecName "kube-api-access-mbv28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:46.549725 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:46.549677 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-maas-api-tls" pod "b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb" (UID: "b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:31:46.627609 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:46.627568 6029 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-metrics-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:46.627609 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:46.627606 6029 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-maas-api-tls\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:46.627931 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:46.627648 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbv28\" (UniqueName: \"kubernetes.io/projected/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-kube-api-access-mbv28\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:46.627931 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:46.627664 6029 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb-openshift-service-ca\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:47.055206 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:47.055164 6029 generic.go:356] "Generic (PLEG): container finished" podID="b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb" containerID="27e966501973201c4dface7cabd7506d079a2e0aeb3973ecb1f9e54f3fbc9145" exitCode=0 Oct 29 23:31:47.055523 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:47.055498 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" event={"ID":"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb","Type":"ContainerDied","Data":"27e966501973201c4dface7cabd7506d079a2e0aeb3973ecb1f9e54f3fbc9145"} Oct 29 23:31:47.055721 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:47.055703 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" event={"ID":"b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb","Type":"ContainerDied","Data":"f9cdc4380c83464711d029c8c3ba05e2f51ce75f678a0d5bb772e23d2982b598"} Oct 29 23:31:47.055902 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:47.055885 6029 scope.go:122] "RemoveContainer" containerID="27e966501973201c4dface7cabd7506d079a2e0aeb3973ecb1f9e54f3fbc9145" Oct 29 23:31:47.056242 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:47.056221 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2" Oct 29 23:31:47.092638 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:47.092509 6029 scope.go:122] "RemoveContainer" containerID="27e966501973201c4dface7cabd7506d079a2e0aeb3973ecb1f9e54f3fbc9145" Oct 29 23:31:47.093082 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:31:47.092970 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27e966501973201c4dface7cabd7506d079a2e0aeb3973ecb1f9e54f3fbc9145\": container with ID starting with 27e966501973201c4dface7cabd7506d079a2e0aeb3973ecb1f9e54f3fbc9145 not found: ID does not exist" containerID="27e966501973201c4dface7cabd7506d079a2e0aeb3973ecb1f9e54f3fbc9145" Oct 29 23:31:47.093082 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:47.093012 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27e966501973201c4dface7cabd7506d079a2e0aeb3973ecb1f9e54f3fbc9145"} err="failed to get container status \"27e966501973201c4dface7cabd7506d079a2e0aeb3973ecb1f9e54f3fbc9145\": rpc error: code = NotFound desc = could not find container \"27e966501973201c4dface7cabd7506d079a2e0aeb3973ecb1f9e54f3fbc9145\": container with ID starting with 27e966501973201c4dface7cabd7506d079a2e0aeb3973ecb1f9e54f3fbc9145 not found: ID does not exist" Oct 29 23:31:47.119924 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:47.119891 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2"] Oct 29 23:31:47.144838 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:47.143869 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-9280e4-5f5d898f7-ghwt2"] Oct 29 23:31:47.394466 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:47.394390 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb" path="/var/lib/kubelet/pods/b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb/volumes" Oct 29 23:31:53.986062 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:53.986016 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd"] Oct 29 23:31:53.986507 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:53.986281 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" podUID="2f9ba1bd-dab9-48e9-aa0c-90c781da120f" containerName="istio-proxy" containerID="cri-o://635f0416e1109beff877ae9d9ce2715cb5abacf8bf1520439acce399191ecb88" gracePeriod=30 Oct 29 23:31:54.005668 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:54.005631 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7"] Oct 29 23:31:54.005968 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:54.005917 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" podUID="717e543a-a22e-4966-8c30-e245cd6005b4" containerName="istio-proxy" containerID="cri-o://b7e7314f06342c731f1cd2b8802f903cf71d600c859bb26eb6460ca781336f23" gracePeriod=30 Oct 29 23:31:59.140591 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.140557 6029 generic.go:356] "Generic (PLEG): container finished" podID="717e543a-a22e-4966-8c30-e245cd6005b4" containerID="b7e7314f06342c731f1cd2b8802f903cf71d600c859bb26eb6460ca781336f23" exitCode=0 Oct 29 23:31:59.141027 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.140629 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" event={"ID":"717e543a-a22e-4966-8c30-e245cd6005b4","Type":"ContainerDied","Data":"b7e7314f06342c731f1cd2b8802f903cf71d600c859bb26eb6460ca781336f23"} Oct 29 23:31:59.142381 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.142356 6029 generic.go:356] "Generic (PLEG): container finished" podID="2f9ba1bd-dab9-48e9-aa0c-90c781da120f" containerID="635f0416e1109beff877ae9d9ce2715cb5abacf8bf1520439acce399191ecb88" exitCode=0 Oct 29 23:31:59.142518 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.142390 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" event={"ID":"2f9ba1bd-dab9-48e9-aa0c-90c781da120f","Type":"ContainerDied","Data":"635f0416e1109beff877ae9d9ce2715cb5abacf8bf1520439acce399191ecb88"} Oct 29 23:31:59.274768 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.274739 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:31:59.309542 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.309509 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:31:59.401875 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.401809 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/717e543a-a22e-4966-8c30-e245cd6005b4-istio-token\" (UniqueName: \"kubernetes.io/projected/717e543a-a22e-4966-8c30-e245cd6005b4-istio-token\") pod \"717e543a-a22e-4966-8c30-e245cd6005b4\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " Oct 29 23:31:59.402060 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.401907 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-podinfo\") pod \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " Oct 29 23:31:59.402060 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.401943 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-workload-certs\") pod \"717e543a-a22e-4966-8c30-e245cd6005b4\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " Oct 29 23:31:59.402060 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.401987 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-istio-envoy\") pod \"717e543a-a22e-4966-8c30-e245cd6005b4\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " Oct 29 23:31:59.402060 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.402020 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-credential-socket\") pod \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " Oct 29 23:31:59.402060 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.402050 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istiod-ca-cert\") pod \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " Oct 29 23:31:59.402351 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.402096 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-istio-data\") pod \"717e543a-a22e-4966-8c30-e245cd6005b4\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " Oct 29 23:31:59.402351 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.402123 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-data\") pod \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " Oct 29 23:31:59.402351 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.402149 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/717e543a-a22e-4966-8c30-e245cd6005b4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/717e543a-a22e-4966-8c30-e245cd6005b4-istio-podinfo\") pod \"717e543a-a22e-4966-8c30-e245cd6005b4\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " Oct 29 23:31:59.402351 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.402205 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-workload-socket\") pod \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " Oct 29 23:31:59.402351 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.402302 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-token\" (UniqueName: \"kubernetes.io/projected/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-token\") pod \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " Oct 29 23:31:59.402597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.402361 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-credential-socket\") pod \"717e543a-a22e-4966-8c30-e245cd6005b4\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " Oct 29 23:31:59.402597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.402396 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/717e543a-a22e-4966-8c30-e245cd6005b4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/717e543a-a22e-4966-8c30-e245cd6005b4-istiod-ca-cert\") pod \"717e543a-a22e-4966-8c30-e245cd6005b4\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " Oct 29 23:31:59.402597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.402425 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-workload-socket\") pod \"717e543a-a22e-4966-8c30-e245cd6005b4\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " Oct 29 23:31:59.402597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.402470 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/717e543a-a22e-4966-8c30-e245cd6005b4-kube-api-access-47lrz\" (UniqueName: \"kubernetes.io/projected/717e543a-a22e-4966-8c30-e245cd6005b4-kube-api-access-47lrz\") pod \"717e543a-a22e-4966-8c30-e245cd6005b4\" (UID: \"717e543a-a22e-4966-8c30-e245cd6005b4\") " Oct 29 23:31:59.402597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.402503 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-workload-certs\") pod \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " Oct 29 23:31:59.402597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.402550 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-kube-api-access-6lm5f\" (UniqueName: \"kubernetes.io/projected/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-kube-api-access-6lm5f\") pod \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " Oct 29 23:31:59.402597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.402532 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-istio-data" pod "717e543a-a22e-4966-8c30-e245cd6005b4" (UID: "717e543a-a22e-4966-8c30-e245cd6005b4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:59.402970 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.402612 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-data" pod "2f9ba1bd-dab9-48e9-aa0c-90c781da120f" (UID: "2f9ba1bd-dab9-48e9-aa0c-90c781da120f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:59.402970 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.402649 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-envoy\") pod \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\" (UID: \"2f9ba1bd-dab9-48e9-aa0c-90c781da120f\") " Oct 29 23:31:59.402970 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.402727 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istiod-ca-cert" pod "2f9ba1bd-dab9-48e9-aa0c-90c781da120f" (UID: "2f9ba1bd-dab9-48e9-aa0c-90c781da120f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:31:59.402970 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.402866 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-credential-socket" pod "717e543a-a22e-4966-8c30-e245cd6005b4" (UID: "717e543a-a22e-4966-8c30-e245cd6005b4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:59.403178 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.403063 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-workload-certs" pod "717e543a-a22e-4966-8c30-e245cd6005b4" (UID: "717e543a-a22e-4966-8c30-e245cd6005b4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:59.403262 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.403241 6029 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-credential-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:59.403329 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.403266 6029 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-workload-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:59.403329 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.403281 6029 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istiod-ca-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:59.403329 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.403295 6029 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-istio-data\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:59.403329 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.403306 6029 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-data\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:59.405190 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.405146 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-credential-socket" pod "2f9ba1bd-dab9-48e9-aa0c-90c781da120f" (UID: "2f9ba1bd-dab9-48e9-aa0c-90c781da120f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:59.405337 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.405203 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-kube-api-access-6lm5f" pod "2f9ba1bd-dab9-48e9-aa0c-90c781da120f" (UID: "2f9ba1bd-dab9-48e9-aa0c-90c781da120f"). InnerVolumeSpecName "kube-api-access-6lm5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:59.405401 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.405360 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-workload-socket" pod "2f9ba1bd-dab9-48e9-aa0c-90c781da120f" (UID: "2f9ba1bd-dab9-48e9-aa0c-90c781da120f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:59.405582 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.405560 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/717e543a-a22e-4966-8c30-e245cd6005b4-istiod-ca-cert" pod "717e543a-a22e-4966-8c30-e245cd6005b4" (UID: "717e543a-a22e-4966-8c30-e245cd6005b4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:31:59.405848 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.405828 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-workload-certs" pod "2f9ba1bd-dab9-48e9-aa0c-90c781da120f" (UID: "2f9ba1bd-dab9-48e9-aa0c-90c781da120f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:59.406507 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.406454 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-workload-socket" pod "717e543a-a22e-4966-8c30-e245cd6005b4" (UID: "717e543a-a22e-4966-8c30-e245cd6005b4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:59.406961 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.406928 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-istio-envoy" pod "717e543a-a22e-4966-8c30-e245cd6005b4" (UID: "717e543a-a22e-4966-8c30-e245cd6005b4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:59.407994 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.407971 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-envoy" pod "2f9ba1bd-dab9-48e9-aa0c-90c781da120f" (UID: "2f9ba1bd-dab9-48e9-aa0c-90c781da120f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:31:59.411507 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.411465 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-podinfo" pod "2f9ba1bd-dab9-48e9-aa0c-90c781da120f" (UID: "2f9ba1bd-dab9-48e9-aa0c-90c781da120f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:31:59.411597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.411544 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/717e543a-a22e-4966-8c30-e245cd6005b4-istio-token" pod "717e543a-a22e-4966-8c30-e245cd6005b4" (UID: "717e543a-a22e-4966-8c30-e245cd6005b4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:59.411664 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.411629 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/717e543a-a22e-4966-8c30-e245cd6005b4-kube-api-access-47lrz" pod "717e543a-a22e-4966-8c30-e245cd6005b4" (UID: "717e543a-a22e-4966-8c30-e245cd6005b4"). InnerVolumeSpecName "kube-api-access-47lrz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:59.413246 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.413223 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-token" pod "2f9ba1bd-dab9-48e9-aa0c-90c781da120f" (UID: "2f9ba1bd-dab9-48e9-aa0c-90c781da120f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:31:59.413801 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.413776 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/717e543a-a22e-4966-8c30-e245cd6005b4-istio-podinfo" pod "717e543a-a22e-4966-8c30-e245cd6005b4" (UID: "717e543a-a22e-4966-8c30-e245cd6005b4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:31:59.504878 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.504781 6029 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-envoy\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:59.504878 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.504805 6029 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/717e543a-a22e-4966-8c30-e245cd6005b4-istio-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:59.504878 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.504846 6029 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-podinfo\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:59.504878 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.504855 6029 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-istio-envoy\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:59.504878 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.504864 6029 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-credential-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:59.504878 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.504873 6029 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/717e543a-a22e-4966-8c30-e245cd6005b4-istio-podinfo\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:59.504878 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.504881 6029 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-workload-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:59.505212 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.504892 6029 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-istio-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:59.505212 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.504901 6029 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/717e543a-a22e-4966-8c30-e245cd6005b4-istiod-ca-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:59.505212 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.504911 6029 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/717e543a-a22e-4966-8c30-e245cd6005b4-workload-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:59.505212 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.504920 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47lrz\" (UniqueName: \"kubernetes.io/projected/717e543a-a22e-4966-8c30-e245cd6005b4-kube-api-access-47lrz\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:59.505212 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.504928 6029 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-workload-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:31:59.505212 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:31:59.504936 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lm5f\" (UniqueName: \"kubernetes.io/projected/2f9ba1bd-dab9-48e9-aa0c-90c781da120f-kube-api-access-6lm5f\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:32:00.151553 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:00.151514 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" Oct 29 23:32:00.151553 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:00.151546 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd" event={"ID":"2f9ba1bd-dab9-48e9-aa0c-90c781da120f","Type":"ContainerDied","Data":"2bf228d66be75cdf437958fb21f11a9c9c509477a21ad71e893a8fce75c01d18"} Oct 29 23:32:00.152136 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:00.151614 6029 scope.go:122] "RemoveContainer" containerID="635f0416e1109beff877ae9d9ce2715cb5abacf8bf1520439acce399191ecb88" Oct 29 23:32:00.153893 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:00.153855 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" event={"ID":"717e543a-a22e-4966-8c30-e245cd6005b4","Type":"ContainerDied","Data":"2d7b8f2c45b6baf6fa67929ee1fc215423f4e2bbbae79e1cf7365c50567fdfe9"} Oct 29 23:32:00.154040 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:00.153946 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7" Oct 29 23:32:00.164415 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:00.164393 6029 scope.go:122] "RemoveContainer" containerID="b7e7314f06342c731f1cd2b8802f903cf71d600c859bb26eb6460ca781336f23" Oct 29 23:32:00.224323 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:00.224288 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7"] Oct 29 23:32:00.237657 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:00.237626 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-zx6t7"] Oct 29 23:32:00.292521 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:00.292437 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd"] Oct 29 23:32:00.301653 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:00.301623 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-9280e4-openshift-default-6c769b66b7-26ckd"] Oct 29 23:32:01.388500 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:01.388461 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2f9ba1bd-dab9-48e9-aa0c-90c781da120f" path="/var/lib/kubelet/pods/2f9ba1bd-dab9-48e9-aa0c-90c781da120f/volumes" Oct 29 23:32:01.389004 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:01.388937 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="717e543a-a22e-4966-8c30-e245cd6005b4" path="/var/lib/kubelet/pods/717e543a-a22e-4966-8c30-e245cd6005b4/volumes" Oct 29 23:32:03.409947 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:03.409912 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8"] Oct 29 23:32:03.410447 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:03.410167 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" podUID="7f788db3-8b57-4936-bb05-466bbf4acd61" containerName="maas-api" containerID="cri-o://4e6173d75826b69238deb8b370f663990d3370ac26a065af1e1584d3f8574512" gracePeriod=30 Oct 29 23:32:03.894632 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:03.894604 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" Oct 29 23:32:04.059235 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:04.059198 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7f788db3-8b57-4936-bb05-466bbf4acd61-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f788db3-8b57-4936-bb05-466bbf4acd61-maas-api-tls\") pod \"7f788db3-8b57-4936-bb05-466bbf4acd61\" (UID: \"7f788db3-8b57-4936-bb05-466bbf4acd61\") " Oct 29 23:32:04.059448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:04.059253 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7f788db3-8b57-4936-bb05-466bbf4acd61-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f788db3-8b57-4936-bb05-466bbf4acd61-metrics-certs\") pod \"7f788db3-8b57-4936-bb05-466bbf4acd61\" (UID: \"7f788db3-8b57-4936-bb05-466bbf4acd61\") " Oct 29 23:32:04.059448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:04.059349 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7f788db3-8b57-4936-bb05-466bbf4acd61-kube-api-access-qsc5f\" (UniqueName: \"kubernetes.io/projected/7f788db3-8b57-4936-bb05-466bbf4acd61-kube-api-access-qsc5f\") pod \"7f788db3-8b57-4936-bb05-466bbf4acd61\" (UID: \"7f788db3-8b57-4936-bb05-466bbf4acd61\") " Oct 29 23:32:04.059448 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:04.059389 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7f788db3-8b57-4936-bb05-466bbf4acd61-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f788db3-8b57-4936-bb05-466bbf4acd61-openshift-service-ca\") pod \"7f788db3-8b57-4936-bb05-466bbf4acd61\" (UID: \"7f788db3-8b57-4936-bb05-466bbf4acd61\") " Oct 29 23:32:04.059848 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:04.059800 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f788db3-8b57-4936-bb05-466bbf4acd61-openshift-service-ca" pod "7f788db3-8b57-4936-bb05-466bbf4acd61" (UID: "7f788db3-8b57-4936-bb05-466bbf4acd61"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:32:04.061736 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:04.061692 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f788db3-8b57-4936-bb05-466bbf4acd61-kube-api-access-qsc5f" pod "7f788db3-8b57-4936-bb05-466bbf4acd61" (UID: "7f788db3-8b57-4936-bb05-466bbf4acd61"). InnerVolumeSpecName "kube-api-access-qsc5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:32:04.062611 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:04.062581 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f788db3-8b57-4936-bb05-466bbf4acd61-maas-api-tls" pod "7f788db3-8b57-4936-bb05-466bbf4acd61" (UID: "7f788db3-8b57-4936-bb05-466bbf4acd61"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:32:04.062704 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:04.062591 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f788db3-8b57-4936-bb05-466bbf4acd61-metrics-certs" pod "7f788db3-8b57-4936-bb05-466bbf4acd61" (UID: "7f788db3-8b57-4936-bb05-466bbf4acd61"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:32:04.161333 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:04.161296 6029 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f788db3-8b57-4936-bb05-466bbf4acd61-maas-api-tls\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:32:04.161333 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:04.161332 6029 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f788db3-8b57-4936-bb05-466bbf4acd61-metrics-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:32:04.161544 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:04.161346 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsc5f\" (UniqueName: \"kubernetes.io/projected/7f788db3-8b57-4936-bb05-466bbf4acd61-kube-api-access-qsc5f\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:32:04.161544 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:04.161360 6029 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f788db3-8b57-4936-bb05-466bbf4acd61-openshift-service-ca\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:32:04.197566 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:04.197534 6029 generic.go:356] "Generic (PLEG): container finished" podID="7f788db3-8b57-4936-bb05-466bbf4acd61" containerID="4e6173d75826b69238deb8b370f663990d3370ac26a065af1e1584d3f8574512" exitCode=0 Oct 29 23:32:04.197726 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:04.197577 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" Oct 29 23:32:04.197726 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:04.197611 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" event={"ID":"7f788db3-8b57-4936-bb05-466bbf4acd61","Type":"ContainerDied","Data":"4e6173d75826b69238deb8b370f663990d3370ac26a065af1e1584d3f8574512"} Oct 29 23:32:04.197726 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:04.197674 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" event={"ID":"7f788db3-8b57-4936-bb05-466bbf4acd61","Type":"ContainerDied","Data":"12a2d70770a220fd06785a9c3e2ebaac4774f595fa25809a2f0bc9376fdf44d5"} Oct 29 23:32:04.197726 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:04.197703 6029 scope.go:122] "RemoveContainer" containerID="4e6173d75826b69238deb8b370f663990d3370ac26a065af1e1584d3f8574512" Oct 29 23:32:04.208368 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:04.208347 6029 scope.go:122] "RemoveContainer" containerID="4e6173d75826b69238deb8b370f663990d3370ac26a065af1e1584d3f8574512" Oct 29 23:32:04.208647 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:32:04.208626 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e6173d75826b69238deb8b370f663990d3370ac26a065af1e1584d3f8574512\": container with ID starting with 4e6173d75826b69238deb8b370f663990d3370ac26a065af1e1584d3f8574512 not found: ID does not exist" containerID="4e6173d75826b69238deb8b370f663990d3370ac26a065af1e1584d3f8574512" Oct 29 23:32:04.208688 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:04.208658 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e6173d75826b69238deb8b370f663990d3370ac26a065af1e1584d3f8574512"} err="failed to get container status \"4e6173d75826b69238deb8b370f663990d3370ac26a065af1e1584d3f8574512\": rpc error: code = NotFound desc = could not find container \"4e6173d75826b69238deb8b370f663990d3370ac26a065af1e1584d3f8574512\": container with ID starting with 4e6173d75826b69238deb8b370f663990d3370ac26a065af1e1584d3f8574512 not found: ID does not exist" Oct 29 23:32:04.256714 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:04.256685 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8"] Oct 29 23:32:04.258762 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:04.258739 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8"] Oct 29 23:32:05.394984 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:05.394953 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7f788db3-8b57-4936-bb05-466bbf4acd61" path="/var/lib/kubelet/pods/7f788db3-8b57-4936-bb05-466bbf4acd61/volumes" Oct 29 23:32:06.820942 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:06.820888 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-0b2ae9-f86fbcd76-s59t8" podUID="7f788db3-8b57-4936-bb05-466bbf4acd61" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.68:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 29 23:32:08.921730 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:32:08.921689 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:32:11.109149 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:11.109103 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs"] Oct 29 23:32:11.112890 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:11.109435 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" podUID="b39e7c06-e062-4b42-ae3e-eb1d72e058bb" containerName="istio-proxy" containerID="cri-o://ef8baecd07eb2245c078d58c2ef0bd63e25fd136fa9cb8b3e508654320af3889" gracePeriod=30 Oct 29 23:32:13.731179 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:13.731145 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-765946bc59-clx6k"] Oct 29 23:32:13.731608 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:13.731338 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-765946bc59-clx6k" podUID="5cfb2b9f-51fd-4d78-a876-323986a1e6b2" containerName="manager" containerID="cri-o://45d58ea08c826f832a40f1368d31f153863d92c7156afab2b5a5f339584f2d23" gracePeriod=30 Oct 29 23:32:13.991740 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:13.991664 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765946bc59-clx6k" Oct 29 23:32:14.061699 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:14.061660 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5cfb2b9f-51fd-4d78-a876-323986a1e6b2-kube-api-access-l2wzc\" (UniqueName: \"kubernetes.io/projected/5cfb2b9f-51fd-4d78-a876-323986a1e6b2-kube-api-access-l2wzc\") pod \"5cfb2b9f-51fd-4d78-a876-323986a1e6b2\" (UID: \"5cfb2b9f-51fd-4d78-a876-323986a1e6b2\") " Oct 29 23:32:14.061904 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:14.061730 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5cfb2b9f-51fd-4d78-a876-323986a1e6b2-webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cfb2b9f-51fd-4d78-a876-323986a1e6b2-webhook-cert\") pod \"5cfb2b9f-51fd-4d78-a876-323986a1e6b2\" (UID: \"5cfb2b9f-51fd-4d78-a876-323986a1e6b2\") " Oct 29 23:32:14.061904 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:14.061779 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5cfb2b9f-51fd-4d78-a876-323986a1e6b2-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cfb2b9f-51fd-4d78-a876-323986a1e6b2-metrics-certs\") pod \"5cfb2b9f-51fd-4d78-a876-323986a1e6b2\" (UID: \"5cfb2b9f-51fd-4d78-a876-323986a1e6b2\") " Oct 29 23:32:14.064007 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:14.063975 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cfb2b9f-51fd-4d78-a876-323986a1e6b2-metrics-certs" pod "5cfb2b9f-51fd-4d78-a876-323986a1e6b2" (UID: "5cfb2b9f-51fd-4d78-a876-323986a1e6b2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:32:14.064007 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:14.063992 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cfb2b9f-51fd-4d78-a876-323986a1e6b2-kube-api-access-l2wzc" pod "5cfb2b9f-51fd-4d78-a876-323986a1e6b2" (UID: "5cfb2b9f-51fd-4d78-a876-323986a1e6b2"). InnerVolumeSpecName "kube-api-access-l2wzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:32:14.064007 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:14.064000 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cfb2b9f-51fd-4d78-a876-323986a1e6b2-webhook-cert" pod "5cfb2b9f-51fd-4d78-a876-323986a1e6b2" (UID: "5cfb2b9f-51fd-4d78-a876-323986a1e6b2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:32:14.163145 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:14.163116 6029 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cfb2b9f-51fd-4d78-a876-323986a1e6b2-webhook-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:32:14.163145 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:14.163141 6029 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cfb2b9f-51fd-4d78-a876-323986a1e6b2-metrics-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:32:14.163145 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:14.163151 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2wzc\" (UniqueName: \"kubernetes.io/projected/5cfb2b9f-51fd-4d78-a876-323986a1e6b2-kube-api-access-l2wzc\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:32:14.264293 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:14.264259 6029 generic.go:356] "Generic (PLEG): container finished" podID="5cfb2b9f-51fd-4d78-a876-323986a1e6b2" containerID="45d58ea08c826f832a40f1368d31f153863d92c7156afab2b5a5f339584f2d23" exitCode=0 Oct 29 23:32:14.264293 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:14.264305 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-765946bc59-clx6k" Oct 29 23:32:14.264559 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:14.264340 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765946bc59-clx6k" event={"ID":"5cfb2b9f-51fd-4d78-a876-323986a1e6b2","Type":"ContainerDied","Data":"45d58ea08c826f832a40f1368d31f153863d92c7156afab2b5a5f339584f2d23"} Oct 29 23:32:14.264559 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:14.264404 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-765946bc59-clx6k" event={"ID":"5cfb2b9f-51fd-4d78-a876-323986a1e6b2","Type":"ContainerDied","Data":"08294f30d345bde1f34d9f37208d97bcaacb0b776469f1dbff4efb0fbfff3e0e"} Oct 29 23:32:14.264559 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:14.264434 6029 scope.go:122] "RemoveContainer" containerID="45d58ea08c826f832a40f1368d31f153863d92c7156afab2b5a5f339584f2d23" Oct 29 23:32:14.275327 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:14.275309 6029 scope.go:122] "RemoveContainer" containerID="45d58ea08c826f832a40f1368d31f153863d92c7156afab2b5a5f339584f2d23" Oct 29 23:32:14.275596 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:32:14.275578 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45d58ea08c826f832a40f1368d31f153863d92c7156afab2b5a5f339584f2d23\": container with ID starting with 45d58ea08c826f832a40f1368d31f153863d92c7156afab2b5a5f339584f2d23 not found: ID does not exist" containerID="45d58ea08c826f832a40f1368d31f153863d92c7156afab2b5a5f339584f2d23" Oct 29 23:32:14.275649 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:14.275605 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45d58ea08c826f832a40f1368d31f153863d92c7156afab2b5a5f339584f2d23"} err="failed to get container status \"45d58ea08c826f832a40f1368d31f153863d92c7156afab2b5a5f339584f2d23\": rpc error: code = NotFound desc = could not find container \"45d58ea08c826f832a40f1368d31f153863d92c7156afab2b5a5f339584f2d23\": container with ID starting with 45d58ea08c826f832a40f1368d31f153863d92c7156afab2b5a5f339584f2d23 not found: ID does not exist" Oct 29 23:32:14.320830 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:14.320787 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-765946bc59-clx6k"] Oct 29 23:32:14.334791 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:14.334761 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-765946bc59-clx6k"] Oct 29 23:32:15.388164 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:15.388126 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5cfb2b9f-51fd-4d78-a876-323986a1e6b2" path="/var/lib/kubelet/pods/5cfb2b9f-51fd-4d78-a876-323986a1e6b2/volumes" Oct 29 23:32:16.305980 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.305650 6029 generic.go:356] "Generic (PLEG): container finished" podID="b39e7c06-e062-4b42-ae3e-eb1d72e058bb" containerID="ef8baecd07eb2245c078d58c2ef0bd63e25fd136fa9cb8b3e508654320af3889" exitCode=0 Oct 29 23:32:16.306751 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.306379 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" event={"ID":"b39e7c06-e062-4b42-ae3e-eb1d72e058bb","Type":"ContainerDied","Data":"ef8baecd07eb2245c078d58c2ef0bd63e25fd136fa9cb8b3e508654320af3889"} Oct 29 23:32:16.306751 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.306634 6029 scope.go:122] "RemoveContainer" containerID="7809944bc6f0e41ce4beb612525169038f2de93dfb46d2db09cfdcc42c4f8cab" Oct 29 23:32:16.470869 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.470836 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:32:16.588229 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.588192 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-credential-socket\") pod \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " Oct 29 23:32:16.588440 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.588238 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-kube-api-access-54zgh\" (UniqueName: \"kubernetes.io/projected/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-kube-api-access-54zgh\") pod \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " Oct 29 23:32:16.588440 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.588299 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-token\" (UniqueName: \"kubernetes.io/projected/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-token\") pod \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " Oct 29 23:32:16.588440 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.588332 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-envoy\") pod \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " Oct 29 23:32:16.588440 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.588384 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istiod-ca-cert\") pod \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " Oct 29 23:32:16.588440 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.588412 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-podinfo\") pod \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " Oct 29 23:32:16.588723 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.588477 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-data\") pod \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " Oct 29 23:32:16.588723 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.588586 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-workload-socket\") pod \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " Oct 29 23:32:16.588723 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.588619 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-workload-certs\") pod \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\" (UID: \"b39e7c06-e062-4b42-ae3e-eb1d72e058bb\") " Oct 29 23:32:16.589503 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.589378 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-workload-certs" pod "b39e7c06-e062-4b42-ae3e-eb1d72e058bb" (UID: "b39e7c06-e062-4b42-ae3e-eb1d72e058bb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:32:16.589503 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.589400 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-workload-socket" pod "b39e7c06-e062-4b42-ae3e-eb1d72e058bb" (UID: "b39e7c06-e062-4b42-ae3e-eb1d72e058bb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:32:16.589503 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.589410 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istiod-ca-cert" pod "b39e7c06-e062-4b42-ae3e-eb1d72e058bb" (UID: "b39e7c06-e062-4b42-ae3e-eb1d72e058bb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:32:16.589503 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.589476 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-data" pod "b39e7c06-e062-4b42-ae3e-eb1d72e058bb" (UID: "b39e7c06-e062-4b42-ae3e-eb1d72e058bb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:32:16.589921 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.589620 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-credential-socket" pod "b39e7c06-e062-4b42-ae3e-eb1d72e058bb" (UID: "b39e7c06-e062-4b42-ae3e-eb1d72e058bb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:32:16.591278 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.591257 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-token" pod "b39e7c06-e062-4b42-ae3e-eb1d72e058bb" (UID: "b39e7c06-e062-4b42-ae3e-eb1d72e058bb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:32:16.591917 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.591886 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-podinfo" pod "b39e7c06-e062-4b42-ae3e-eb1d72e058bb" (UID: "b39e7c06-e062-4b42-ae3e-eb1d72e058bb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:32:16.592264 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.592246 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-envoy" pod "b39e7c06-e062-4b42-ae3e-eb1d72e058bb" (UID: "b39e7c06-e062-4b42-ae3e-eb1d72e058bb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:32:16.597056 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.597022 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-kube-api-access-54zgh" pod "b39e7c06-e062-4b42-ae3e-eb1d72e058bb" (UID: "b39e7c06-e062-4b42-ae3e-eb1d72e058bb"). InnerVolumeSpecName "kube-api-access-54zgh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:32:16.694848 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.694680 6029 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-workload-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:32:16.694848 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.694722 6029 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-workload-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:32:16.694848 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.694738 6029 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-credential-socket\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:32:16.695389 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.695258 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54zgh\" (UniqueName: \"kubernetes.io/projected/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-kube-api-access-54zgh\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:32:16.695389 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.695293 6029 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:32:16.695389 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.695310 6029 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-envoy\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:32:16.695389 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.695323 6029 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istiod-ca-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:32:16.695389 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.695336 6029 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-podinfo\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:32:16.695389 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:16.695349 6029 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b39e7c06-e062-4b42-ae3e-eb1d72e058bb-istio-data\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:32:17.314426 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:17.314391 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" event={"ID":"b39e7c06-e062-4b42-ae3e-eb1d72e058bb","Type":"ContainerDied","Data":"f3c9a1ec5e18881535f76b27a307970aaf6dc4b1447c5a7e3b46769ecd63133a"} Oct 29 23:32:17.314426 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:17.314426 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs" Oct 29 23:32:17.314806 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:17.314456 6029 scope.go:122] "RemoveContainer" containerID="ef8baecd07eb2245c078d58c2ef0bd63e25fd136fa9cb8b3e508654320af3889" Oct 29 23:32:17.404923 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:17.404889 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs"] Oct 29 23:32:17.412297 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:17.412266 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-0b2ae9-openshift-default-767d4d54bf-75krs"] Oct 29 23:32:19.388629 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:32:19.388593 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b39e7c06-e062-4b42-ae3e-eb1d72e058bb" path="/var/lib/kubelet/pods/b39e7c06-e062-4b42-ae3e-eb1d72e058bb/volumes" Oct 29 23:32:38.923030 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:32:38.922987 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:33:08.920520 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:33:08.920483 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:33:38.922747 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:33:38.922702 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:34:08.921000 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:34:08.920963 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:34:38.921936 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:34:38.921897 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:35:08.920464 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:35:08.920379 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:35:39.014134 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:35:39.014087 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:36:08.922242 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:36:08.922203 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:36:23.999575 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:23.999521 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c"] Oct 29 23:36:24.000284 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:23.999844 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" podUID="48468ed7-2a06-4bb8-b71d-874f36e6c2e6" containerName="discovery" containerID="cri-o://45734eb8ca5183a35a4f4aa0a9bbdf1c6e8b39ade4b4928df643902389247212" gracePeriod=30 Oct 29 23:36:24.291023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.290987 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:36:24.355342 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.355311 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-csr-ca-configmap\") pod \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " Oct 29 23:36:24.355546 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.355385 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-kubeconfig\") pod \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " Oct 29 23:36:24.355546 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.355426 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-cacerts\" (UniqueName: \"kubernetes.io/secret/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-cacerts\") pod \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " Oct 29 23:36:24.355546 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.355477 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-token\" (UniqueName: \"kubernetes.io/projected/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-token\") pod \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " Oct 29 23:36:24.355546 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.355501 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-local-certs\") pod \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " Oct 29 23:36:24.355546 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.355531 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-kube-api-access-r7tmm\" (UniqueName: \"kubernetes.io/projected/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-kube-api-access-r7tmm\") pod \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " Oct 29 23:36:24.355863 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.355566 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-csr-dns-cert\") pod \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\" (UID: \"48468ed7-2a06-4bb8-b71d-874f36e6c2e6\") " Oct 29 23:36:24.356357 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.356214 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-csr-ca-configmap" pod "48468ed7-2a06-4bb8-b71d-874f36e6c2e6" (UID: "48468ed7-2a06-4bb8-b71d-874f36e6c2e6"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:36:24.360419 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.360377 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-cacerts" pod "48468ed7-2a06-4bb8-b71d-874f36e6c2e6" (UID: "48468ed7-2a06-4bb8-b71d-874f36e6c2e6"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:36:24.362143 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.362102 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-kubeconfig" pod "48468ed7-2a06-4bb8-b71d-874f36e6c2e6" (UID: "48468ed7-2a06-4bb8-b71d-874f36e6c2e6"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:36:24.362143 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.362128 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-local-certs" pod "48468ed7-2a06-4bb8-b71d-874f36e6c2e6" (UID: "48468ed7-2a06-4bb8-b71d-874f36e6c2e6"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:36:24.362308 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.362250 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-token" pod "48468ed7-2a06-4bb8-b71d-874f36e6c2e6" (UID: "48468ed7-2a06-4bb8-b71d-874f36e6c2e6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:36:24.362372 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.362304 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-csr-dns-cert" pod "48468ed7-2a06-4bb8-b71d-874f36e6c2e6" (UID: "48468ed7-2a06-4bb8-b71d-874f36e6c2e6"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:36:24.363653 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.363620 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-kube-api-access-r7tmm" pod "48468ed7-2a06-4bb8-b71d-874f36e6c2e6" (UID: "48468ed7-2a06-4bb8-b71d-874f36e6c2e6"). InnerVolumeSpecName "kube-api-access-r7tmm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:36:24.456978 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.456801 6029 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-local-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:36:24.456978 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.456874 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7tmm\" (UniqueName: \"kubernetes.io/projected/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-kube-api-access-r7tmm\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:36:24.456978 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.456891 6029 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-csr-dns-cert\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:36:24.456978 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.456905 6029 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-csr-ca-configmap\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:36:24.456978 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.456921 6029 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-kubeconfig\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:36:24.456978 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.456934 6029 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-cacerts\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:36:24.456978 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.456949 6029 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48468ed7-2a06-4bb8-b71d-874f36e6c2e6-istio-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:36:24.882840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.869057 6029 generic.go:356] "Generic (PLEG): container finished" podID="48468ed7-2a06-4bb8-b71d-874f36e6c2e6" containerID="45734eb8ca5183a35a4f4aa0a9bbdf1c6e8b39ade4b4928df643902389247212" exitCode=0 Oct 29 23:36:24.882840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.869202 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" event={"ID":"48468ed7-2a06-4bb8-b71d-874f36e6c2e6","Type":"ContainerDied","Data":"45734eb8ca5183a35a4f4aa0a9bbdf1c6e8b39ade4b4928df643902389247212"} Oct 29 23:36:24.882840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.869274 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" event={"ID":"48468ed7-2a06-4bb8-b71d-874f36e6c2e6","Type":"ContainerDied","Data":"f160ed72bb2d64ba726ef0c56f5fa83bc7694f2023bdf491670d33240ba6a2aa"} Oct 29 23:36:24.882840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.869322 6029 scope.go:122] "RemoveContainer" containerID="45734eb8ca5183a35a4f4aa0a9bbdf1c6e8b39ade4b4928df643902389247212" Oct 29 23:36:24.882840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.869528 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c" Oct 29 23:36:24.906527 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.906503 6029 scope.go:122] "RemoveContainer" containerID="45734eb8ca5183a35a4f4aa0a9bbdf1c6e8b39ade4b4928df643902389247212" Oct 29 23:36:24.906957 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:36:24.906929 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45734eb8ca5183a35a4f4aa0a9bbdf1c6e8b39ade4b4928df643902389247212\": container with ID starting with 45734eb8ca5183a35a4f4aa0a9bbdf1c6e8b39ade4b4928df643902389247212 not found: ID does not exist" containerID="45734eb8ca5183a35a4f4aa0a9bbdf1c6e8b39ade4b4928df643902389247212" Oct 29 23:36:24.907081 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.906961 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45734eb8ca5183a35a4f4aa0a9bbdf1c6e8b39ade4b4928df643902389247212"} err="failed to get container status \"45734eb8ca5183a35a4f4aa0a9bbdf1c6e8b39ade4b4928df643902389247212\": rpc error: code = NotFound desc = could not find container \"45734eb8ca5183a35a4f4aa0a9bbdf1c6e8b39ade4b4928df643902389247212\": container with ID starting with 45734eb8ca5183a35a4f4aa0a9bbdf1c6e8b39ade4b4928df643902389247212 not found: ID does not exist" Oct 29 23:36:24.971838 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.971467 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c"] Oct 29 23:36:24.994838 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:24.992847 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-jb86c"] Oct 29 23:36:25.399477 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:36:25.398904 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="48468ed7-2a06-4bb8-b71d-874f36e6c2e6" path="/var/lib/kubelet/pods/48468ed7-2a06-4bb8-b71d-874f36e6c2e6/volumes" Oct 29 23:36:38.920980 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:36:38.920932 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:37:08.920745 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:37:08.920702 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:37:12.245348 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245318 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw"] Oct 29 23:37:12.245772 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245758 6029 cpu_manager.go:414] "containerMap: removing container" podUID="7add77b8-8cb6-48a6-8e3d-dd223f76402a" containerName="istio-proxy" Oct 29 23:37:12.245834 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245773 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7add77b8-8cb6-48a6-8e3d-dd223f76402a" containerName="istio-proxy" Oct 29 23:37:12.245834 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245789 6029 cpu_manager.go:414] "containerMap: removing container" podUID="ff2c3fee-90cf-4c17-bd87-5f76e8166517" containerName="istio-proxy" Oct 29 23:37:12.245834 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245794 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ff2c3fee-90cf-4c17-bd87-5f76e8166517" containerName="istio-proxy" Oct 29 23:37:12.245834 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245805 6029 cpu_manager.go:414] "containerMap: removing container" podUID="6a44ecac-10fb-4a00-9596-716b57cc8dfa" containerName="istio-proxy" Oct 29 23:37:12.245834 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245810 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6a44ecac-10fb-4a00-9596-716b57cc8dfa" containerName="istio-proxy" Oct 29 23:37:12.245834 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245831 6029 cpu_manager.go:414] "containerMap: removing container" podUID="3860268b-8c6e-4826-831f-e6efd1a0faf6" containerName="istio-proxy" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245837 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3860268b-8c6e-4826-831f-e6efd1a0faf6" containerName="istio-proxy" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245843 6029 cpu_manager.go:414] "containerMap: removing container" podUID="48468ed7-2a06-4bb8-b71d-874f36e6c2e6" containerName="discovery" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245848 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="48468ed7-2a06-4bb8-b71d-874f36e6c2e6" containerName="discovery" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245856 6029 cpu_manager.go:414] "containerMap: removing container" podUID="717e543a-a22e-4966-8c30-e245cd6005b4" containerName="istio-proxy" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245861 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="717e543a-a22e-4966-8c30-e245cd6005b4" containerName="istio-proxy" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245866 6029 cpu_manager.go:414] "containerMap: removing container" podUID="245515db-5ab4-46a3-a45b-2bd8c4b1bade" containerName="istio-proxy" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245871 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="245515db-5ab4-46a3-a45b-2bd8c4b1bade" containerName="istio-proxy" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245878 6029 cpu_manager.go:414] "containerMap: removing container" podUID="7f788db3-8b57-4936-bb05-466bbf4acd61" containerName="maas-api" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245883 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7f788db3-8b57-4936-bb05-466bbf4acd61" containerName="maas-api" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245891 6029 cpu_manager.go:414] "containerMap: removing container" podUID="b39e7c06-e062-4b42-ae3e-eb1d72e058bb" containerName="istio-proxy" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245898 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b39e7c06-e062-4b42-ae3e-eb1d72e058bb" containerName="istio-proxy" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245910 6029 cpu_manager.go:414] "containerMap: removing container" podUID="6300192f-3f51-49b3-8889-e52171fa3e8e" containerName="maas-api" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245915 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6300192f-3f51-49b3-8889-e52171fa3e8e" containerName="maas-api" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245921 6029 cpu_manager.go:414] "containerMap: removing container" podUID="1060b6c4-b5ad-4297-98a2-c2a241ed9186" containerName="istio-proxy" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245925 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1060b6c4-b5ad-4297-98a2-c2a241ed9186" containerName="istio-proxy" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245931 6029 cpu_manager.go:414] "containerMap: removing container" podUID="d32e3f33-6877-4d39-924b-746ea13ab6c5" containerName="istio-proxy" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245936 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d32e3f33-6877-4d39-924b-746ea13ab6c5" containerName="istio-proxy" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245942 6029 cpu_manager.go:414] "containerMap: removing container" podUID="a8e651dc-428f-4cb0-95b2-513a6f325880" containerName="istio-proxy" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245946 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a8e651dc-428f-4cb0-95b2-513a6f325880" containerName="istio-proxy" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245951 6029 cpu_manager.go:414] "containerMap: removing container" podUID="6bafc705-c3f4-4532-a67a-77e1536256d1" containerName="istio-proxy" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245955 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6bafc705-c3f4-4532-a67a-77e1536256d1" containerName="istio-proxy" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245963 6029 cpu_manager.go:414] "containerMap: removing container" podUID="11ac369f-a9a0-479c-b534-6227afec3635" containerName="istio-proxy" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245967 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="11ac369f-a9a0-479c-b534-6227afec3635" containerName="istio-proxy" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245980 6029 cpu_manager.go:414] "containerMap: removing container" podUID="d0cd24af-80e1-4336-8f97-cdedd3e1ef0e" containerName="maas-api" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245986 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0cd24af-80e1-4336-8f97-cdedd3e1ef0e" containerName="maas-api" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245992 6029 cpu_manager.go:414] "containerMap: removing container" podUID="d5e267ab-8b18-469a-a986-78beb7b635fa" containerName="main" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.245996 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d5e267ab-8b18-469a-a986-78beb7b635fa" containerName="main" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246005 6029 cpu_manager.go:414] "containerMap: removing container" podUID="a5a87768-faea-4bd4-a252-c518bb2b809c" containerName="maas-api" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246009 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a5a87768-faea-4bd4-a252-c518bb2b809c" containerName="maas-api" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246017 6029 cpu_manager.go:414] "containerMap: removing container" podUID="b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb" containerName="maas-api" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246021 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb" containerName="maas-api" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246028 6029 cpu_manager.go:414] "containerMap: removing container" podUID="77a4bccb-b4aa-4cc5-a204-b7b8b14e228b" containerName="maas-api" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246032 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="77a4bccb-b4aa-4cc5-a204-b7b8b14e228b" containerName="maas-api" Oct 29 23:37:12.246024 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246038 6029 cpu_manager.go:414] "containerMap: removing container" podUID="ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246043 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246052 6029 cpu_manager.go:414] "containerMap: removing container" podUID="6bafc705-c3f4-4532-a67a-77e1536256d1" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246059 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6bafc705-c3f4-4532-a67a-77e1536256d1" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246065 6029 cpu_manager.go:414] "containerMap: removing container" podUID="6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246069 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246076 6029 cpu_manager.go:414] "containerMap: removing container" podUID="219edfce-514c-4adc-aed0-c331515e9467" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246081 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="219edfce-514c-4adc-aed0-c331515e9467" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246087 6029 cpu_manager.go:414] "containerMap: removing container" podUID="c1768326-83dd-4203-a9ba-a855c88d5874" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246091 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c1768326-83dd-4203-a9ba-a855c88d5874" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246103 6029 cpu_manager.go:414] "containerMap: removing container" podUID="c26dda21-42b8-4789-8658-e91d387542e3" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246107 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c26dda21-42b8-4789-8658-e91d387542e3" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246113 6029 cpu_manager.go:414] "containerMap: removing container" podUID="b58f9001-4e4a-4959-8d80-53b37221fd59" containerName="payload-processing" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246117 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b58f9001-4e4a-4959-8d80-53b37221fd59" containerName="payload-processing" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246122 6029 cpu_manager.go:414] "containerMap: removing container" podUID="55084dd3-2a7c-4cc3-a302-67f9eb258336" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246129 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="55084dd3-2a7c-4cc3-a302-67f9eb258336" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246141 6029 cpu_manager.go:414] "containerMap: removing container" podUID="8e026a2b-f88b-43eb-845a-d97e66bb8656" containerName="maas-api" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246145 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8e026a2b-f88b-43eb-845a-d97e66bb8656" containerName="maas-api" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246151 6029 cpu_manager.go:414] "containerMap: removing container" podUID="430db6a8-1f92-4f9d-95be-369032f16c8d" containerName="payload-pre-processing" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246156 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="430db6a8-1f92-4f9d-95be-369032f16c8d" containerName="payload-pre-processing" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246163 6029 cpu_manager.go:414] "containerMap: removing container" podUID="3cd04199-f906-4d0f-a0c6-4d45c20208bf" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246169 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3cd04199-f906-4d0f-a0c6-4d45c20208bf" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246175 6029 cpu_manager.go:414] "containerMap: removing container" podUID="5cfb2b9f-51fd-4d78-a876-323986a1e6b2" containerName="manager" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246179 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5cfb2b9f-51fd-4d78-a876-323986a1e6b2" containerName="manager" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246185 6029 cpu_manager.go:414] "containerMap: removing container" podUID="b39e7c06-e062-4b42-ae3e-eb1d72e058bb" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246189 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b39e7c06-e062-4b42-ae3e-eb1d72e058bb" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246194 6029 cpu_manager.go:414] "containerMap: removing container" podUID="ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246198 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246207 6029 cpu_manager.go:414] "containerMap: removing container" podUID="adf4cd4e-959b-4d9b-983d-19dcc6122050" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246214 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="adf4cd4e-959b-4d9b-983d-19dcc6122050" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246220 6029 cpu_manager.go:414] "containerMap: removing container" podUID="2f9ba1bd-dab9-48e9-aa0c-90c781da120f" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246224 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f9ba1bd-dab9-48e9-aa0c-90c781da120f" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246292 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="6a44ecac-10fb-4a00-9596-716b57cc8dfa" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246300 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="3860268b-8c6e-4826-831f-e6efd1a0faf6" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246307 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="48468ed7-2a06-4bb8-b71d-874f36e6c2e6" containerName="discovery" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246313 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="717e543a-a22e-4966-8c30-e245cd6005b4" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246320 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="245515db-5ab4-46a3-a45b-2bd8c4b1bade" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246326 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="7f788db3-8b57-4936-bb05-466bbf4acd61" containerName="maas-api" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246331 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="b39e7c06-e062-4b42-ae3e-eb1d72e058bb" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246337 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="6300192f-3f51-49b3-8889-e52171fa3e8e" containerName="maas-api" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246342 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="1060b6c4-b5ad-4297-98a2-c2a241ed9186" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246347 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="d32e3f33-6877-4d39-924b-746ea13ab6c5" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246353 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="a8e651dc-428f-4cb0-95b2-513a6f325880" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246363 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="6bafc705-c3f4-4532-a67a-77e1536256d1" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246370 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="11ac369f-a9a0-479c-b534-6227afec3635" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246374 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="d0cd24af-80e1-4336-8f97-cdedd3e1ef0e" containerName="maas-api" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246379 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="d5e267ab-8b18-469a-a986-78beb7b635fa" containerName="main" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246383 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="a5a87768-faea-4bd4-a252-c518bb2b809c" containerName="maas-api" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246389 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="b316cf54-d2d5-49fe-bb6a-c4e6af8b39fb" containerName="maas-api" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246394 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="77a4bccb-b4aa-4cc5-a204-b7b8b14e228b" containerName="maas-api" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246398 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246402 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="6bafc705-c3f4-4532-a67a-77e1536256d1" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246406 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="6e114c59-0ecc-4eed-ad14-7e2c6ad38d78" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246412 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="219edfce-514c-4adc-aed0-c331515e9467" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246419 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="c1768326-83dd-4203-a9ba-a855c88d5874" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246426 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="c26dda21-42b8-4789-8658-e91d387542e3" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246434 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="b58f9001-4e4a-4959-8d80-53b37221fd59" containerName="payload-processing" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246442 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="55084dd3-2a7c-4cc3-a302-67f9eb258336" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246448 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="8e026a2b-f88b-43eb-845a-d97e66bb8656" containerName="maas-api" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246454 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="430db6a8-1f92-4f9d-95be-369032f16c8d" containerName="payload-pre-processing" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246459 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="3cd04199-f906-4d0f-a0c6-4d45c20208bf" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246464 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="5cfb2b9f-51fd-4d78-a876-323986a1e6b2" containerName="manager" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246469 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee5b3e7f-2efc-4ac7-b00e-8426ea94c250" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246475 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="adf4cd4e-959b-4d9b-983d-19dcc6122050" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246480 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="7add77b8-8cb6-48a6-8e3d-dd223f76402a" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246484 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="2f9ba1bd-dab9-48e9-aa0c-90c781da120f" containerName="istio-proxy" Oct 29 23:37:12.247023 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.246490 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="ff2c3fee-90cf-4c17-bd87-5f76e8166517" containerName="istio-proxy" Oct 29 23:37:12.249733 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.249712 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" Oct 29 23:37:12.265256 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.265226 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f337a617-6823-45f4-9022-4a0d056587c1-metrics-certs\") pod \"maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw\" (UID: \"f337a617-6823-45f4-9022-4a0d056587c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" Oct 29 23:37:12.265373 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.265282 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f337a617-6823-45f4-9022-4a0d056587c1-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw\" (UID: \"f337a617-6823-45f4-9022-4a0d056587c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" Oct 29 23:37:12.265414 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.265373 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f337a617-6823-45f4-9022-4a0d056587c1-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw\" (UID: \"f337a617-6823-45f4-9022-4a0d056587c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" Oct 29 23:37:12.265414 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.265398 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjbqj\" (UniqueName: \"kubernetes.io/projected/f337a617-6823-45f4-9022-4a0d056587c1-kube-api-access-mjbqj\") pod \"maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw\" (UID: \"f337a617-6823-45f4-9022-4a0d056587c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" Oct 29 23:37:12.266999 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.266984 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-71f7db-serving-cert\"" Oct 29 23:37:12.284453 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.284422 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw"] Oct 29 23:37:12.366520 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.366482 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f337a617-6823-45f4-9022-4a0d056587c1-metrics-certs\") pod \"maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw\" (UID: \"f337a617-6823-45f4-9022-4a0d056587c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" Oct 29 23:37:12.366731 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.366531 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f337a617-6823-45f4-9022-4a0d056587c1-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw\" (UID: \"f337a617-6823-45f4-9022-4a0d056587c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" Oct 29 23:37:12.366731 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.366578 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f337a617-6823-45f4-9022-4a0d056587c1-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw\" (UID: \"f337a617-6823-45f4-9022-4a0d056587c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" Oct 29 23:37:12.366731 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.366596 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjbqj\" (UniqueName: \"kubernetes.io/projected/f337a617-6823-45f4-9022-4a0d056587c1-kube-api-access-mjbqj\") pod \"maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw\" (UID: \"f337a617-6823-45f4-9022-4a0d056587c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" Oct 29 23:37:12.366731 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:37:12.366698 6029 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-serving-cert: secret "maas-api-e2e-worker-single-main-71f7db-serving-cert" not found Oct 29 23:37:12.367048 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:37:12.366783 6029 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f337a617-6823-45f4-9022-4a0d056587c1-maas-api-tls podName:f337a617-6823-45f4-9022-4a0d056587c1 nodeName:}" failed. No retries permitted until 2026-10-29 23:37:12.866766579 +0000 UTC m=+1399.593017258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f337a617-6823-45f4-9022-4a0d056587c1-maas-api-tls") pod "maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" (UID: "f337a617-6823-45f4-9022-4a0d056587c1") : secret "maas-api-e2e-worker-single-main-71f7db-serving-cert" not found Oct 29 23:37:12.367360 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.367340 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f337a617-6823-45f4-9022-4a0d056587c1-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw\" (UID: \"f337a617-6823-45f4-9022-4a0d056587c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" Oct 29 23:37:12.369050 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.369030 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f337a617-6823-45f4-9022-4a0d056587c1-metrics-certs\") pod \"maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw\" (UID: \"f337a617-6823-45f4-9022-4a0d056587c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" Oct 29 23:37:12.389971 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.389948 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjbqj\" (UniqueName: \"kubernetes.io/projected/f337a617-6823-45f4-9022-4a0d056587c1-kube-api-access-mjbqj\") pod \"maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw\" (UID: \"f337a617-6823-45f4-9022-4a0d056587c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" Oct 29 23:37:12.870137 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.870102 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f337a617-6823-45f4-9022-4a0d056587c1-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw\" (UID: \"f337a617-6823-45f4-9022-4a0d056587c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" Oct 29 23:37:12.872648 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:12.872618 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f337a617-6823-45f4-9022-4a0d056587c1-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw\" (UID: \"f337a617-6823-45f4-9022-4a0d056587c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" Oct 29 23:37:13.167111 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:13.167015 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" Oct 29 23:37:13.469970 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:37:13.469943 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf337a617_6823_45f4_9022_4a0d056587c1.slice/crio-e03c267c30fbe93ad88a36caf83bc93b9e247de914664f393998510d7fe4db0c WatchSource:0}: Error finding container e03c267c30fbe93ad88a36caf83bc93b9e247de914664f393998510d7fe4db0c: Status 404 returned error can't find the container with id e03c267c30fbe93ad88a36caf83bc93b9e247de914664f393998510d7fe4db0c Oct 29 23:37:13.470299 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:13.469994 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw"] Oct 29 23:37:13.471434 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:13.471419 6029 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 29 23:37:14.169306 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:14.169265 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" event={"ID":"f337a617-6823-45f4-9022-4a0d056587c1","Type":"ContainerStarted","Data":"aac1b728b593e513c1b83e3141ce22fe54c520c912b1640980354575d2c8019c"} Oct 29 23:37:14.169506 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:14.169327 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" event={"ID":"f337a617-6823-45f4-9022-4a0d056587c1","Type":"ContainerStarted","Data":"e03c267c30fbe93ad88a36caf83bc93b9e247de914664f393998510d7fe4db0c"} Oct 29 23:37:14.169506 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:14.169357 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" Oct 29 23:37:14.213362 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:14.213304 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" podStartSLOduration=1.712435545 podStartE2EDuration="2.213289253s" totalImagesPullingTime="500.853708ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:37:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:37:14.212271226 +0000 UTC m=+1400.938521818" watchObservedRunningTime="2026-10-29 23:37:14.213289253 +0000 UTC m=+1400.939539844" Oct 29 23:37:20.180086 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:37:20.180052 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" Oct 29 23:37:38.920694 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:37:38.920656 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:38:08.922193 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:38:08.922100 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:38:14.182991 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:14.182957 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw"] Oct 29 23:38:14.183596 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:14.183146 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" podUID="f337a617-6823-45f4-9022-4a0d056587c1" containerName="maas-api" containerID="cri-o://aac1b728b593e513c1b83e3141ce22fe54c520c912b1640980354575d2c8019c" gracePeriod=30 Oct 29 23:38:14.518408 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:14.518379 6029 generic.go:356] "Generic (PLEG): container finished" podID="f337a617-6823-45f4-9022-4a0d056587c1" containerID="aac1b728b593e513c1b83e3141ce22fe54c520c912b1640980354575d2c8019c" exitCode=0 Oct 29 23:38:14.518570 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:14.518446 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" event={"ID":"f337a617-6823-45f4-9022-4a0d056587c1","Type":"ContainerDied","Data":"aac1b728b593e513c1b83e3141ce22fe54c520c912b1640980354575d2c8019c"} Oct 29 23:38:14.651975 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:14.651944 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" Oct 29 23:38:14.803368 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:14.803331 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f337a617-6823-45f4-9022-4a0d056587c1-kube-api-access-mjbqj\" (UniqueName: \"kubernetes.io/projected/f337a617-6823-45f4-9022-4a0d056587c1-kube-api-access-mjbqj\") pod \"f337a617-6823-45f4-9022-4a0d056587c1\" (UID: \"f337a617-6823-45f4-9022-4a0d056587c1\") " Oct 29 23:38:14.803577 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:14.803415 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f337a617-6823-45f4-9022-4a0d056587c1-metrics-certs\" (UniqueName: \"kubernetes.io/secret/f337a617-6823-45f4-9022-4a0d056587c1-metrics-certs\") pod \"f337a617-6823-45f4-9022-4a0d056587c1\" (UID: \"f337a617-6823-45f4-9022-4a0d056587c1\") " Oct 29 23:38:14.803657 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:14.803588 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f337a617-6823-45f4-9022-4a0d056587c1-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f337a617-6823-45f4-9022-4a0d056587c1-maas-api-tls\") pod \"f337a617-6823-45f4-9022-4a0d056587c1\" (UID: \"f337a617-6823-45f4-9022-4a0d056587c1\") " Oct 29 23:38:14.803713 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:14.803699 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f337a617-6823-45f4-9022-4a0d056587c1-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f337a617-6823-45f4-9022-4a0d056587c1-openshift-service-ca\") pod \"f337a617-6823-45f4-9022-4a0d056587c1\" (UID: \"f337a617-6823-45f4-9022-4a0d056587c1\") " Oct 29 23:38:14.804135 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:14.804094 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f337a617-6823-45f4-9022-4a0d056587c1-openshift-service-ca" pod "f337a617-6823-45f4-9022-4a0d056587c1" (UID: "f337a617-6823-45f4-9022-4a0d056587c1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:38:14.805621 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:14.805591 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f337a617-6823-45f4-9022-4a0d056587c1-maas-api-tls" pod "f337a617-6823-45f4-9022-4a0d056587c1" (UID: "f337a617-6823-45f4-9022-4a0d056587c1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:38:14.805736 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:14.805637 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f337a617-6823-45f4-9022-4a0d056587c1-kube-api-access-mjbqj" pod "f337a617-6823-45f4-9022-4a0d056587c1" (UID: "f337a617-6823-45f4-9022-4a0d056587c1"). InnerVolumeSpecName "kube-api-access-mjbqj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:38:14.805736 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:14.805710 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f337a617-6823-45f4-9022-4a0d056587c1-metrics-certs" pod "f337a617-6823-45f4-9022-4a0d056587c1" (UID: "f337a617-6823-45f4-9022-4a0d056587c1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:38:14.904788 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:14.904749 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjbqj\" (UniqueName: \"kubernetes.io/projected/f337a617-6823-45f4-9022-4a0d056587c1-kube-api-access-mjbqj\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:38:14.904788 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:14.904786 6029 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f337a617-6823-45f4-9022-4a0d056587c1-metrics-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:38:14.905032 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:14.904800 6029 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f337a617-6823-45f4-9022-4a0d056587c1-maas-api-tls\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:38:14.905032 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:14.904827 6029 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f337a617-6823-45f4-9022-4a0d056587c1-openshift-service-ca\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:38:15.524910 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:15.524879 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" Oct 29 23:38:15.524910 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:15.524894 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw" event={"ID":"f337a617-6823-45f4-9022-4a0d056587c1","Type":"ContainerDied","Data":"e03c267c30fbe93ad88a36caf83bc93b9e247de914664f393998510d7fe4db0c"} Oct 29 23:38:15.525475 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:15.524960 6029 scope.go:122] "RemoveContainer" containerID="aac1b728b593e513c1b83e3141ce22fe54c520c912b1640980354575d2c8019c" Oct 29 23:38:15.578762 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:15.578675 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw"] Oct 29 23:38:15.592523 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:15.592487 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-71f7db-7d47dd44b4-9gwjw"] Oct 29 23:38:17.388789 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:17.388759 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f337a617-6823-45f4-9022-4a0d056587c1" path="/var/lib/kubelet/pods/f337a617-6823-45f4-9022-4a0d056587c1/volumes" Oct 29 23:38:38.920972 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:38:38.920930 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:38:41.243685 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:41.243646 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx"] Oct 29 23:38:41.244231 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:41.243910 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx" podUID="6386da02-f1c3-4158-81f9-675f84da4261" containerName="manager" containerID="cri-o://2e68494d7f12d8f5dbd41c089aad63f131c6cfeacef0c76432f5f0e9e80fb5cd" gracePeriod=10 Oct 29 23:38:41.506866 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:41.506839 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx" Oct 29 23:38:41.578334 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:41.578299 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6386da02-f1c3-4158-81f9-675f84da4261-kube-api-access-mtj7z\" (UniqueName: \"kubernetes.io/projected/6386da02-f1c3-4158-81f9-675f84da4261-kube-api-access-mtj7z\") pod \"6386da02-f1c3-4158-81f9-675f84da4261\" (UID: \"6386da02-f1c3-4158-81f9-675f84da4261\") " Oct 29 23:38:41.578490 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:41.578398 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6386da02-f1c3-4158-81f9-675f84da4261-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6386da02-f1c3-4158-81f9-675f84da4261-extensions-socket-volume\") pod \"6386da02-f1c3-4158-81f9-675f84da4261\" (UID: \"6386da02-f1c3-4158-81f9-675f84da4261\") " Oct 29 23:38:41.578799 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:41.578762 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6386da02-f1c3-4158-81f9-675f84da4261-extensions-socket-volume" pod "6386da02-f1c3-4158-81f9-675f84da4261" (UID: "6386da02-f1c3-4158-81f9-675f84da4261"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:38:41.580504 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:41.580474 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6386da02-f1c3-4158-81f9-675f84da4261-kube-api-access-mtj7z" pod "6386da02-f1c3-4158-81f9-675f84da4261" (UID: "6386da02-f1c3-4158-81f9-675f84da4261"). InnerVolumeSpecName "kube-api-access-mtj7z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:38:41.679628 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:41.679598 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtj7z\" (UniqueName: \"kubernetes.io/projected/6386da02-f1c3-4158-81f9-675f84da4261-kube-api-access-mtj7z\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:38:41.679628 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:41.679623 6029 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6386da02-f1c3-4158-81f9-675f84da4261-extensions-socket-volume\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:38:41.681955 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:41.681930 6029 generic.go:356] "Generic (PLEG): container finished" podID="6386da02-f1c3-4158-81f9-675f84da4261" containerID="2e68494d7f12d8f5dbd41c089aad63f131c6cfeacef0c76432f5f0e9e80fb5cd" exitCode=0 Oct 29 23:38:41.682086 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:41.681981 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx" Oct 29 23:38:41.682086 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:41.682022 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx" event={"ID":"6386da02-f1c3-4158-81f9-675f84da4261","Type":"ContainerDied","Data":"2e68494d7f12d8f5dbd41c089aad63f131c6cfeacef0c76432f5f0e9e80fb5cd"} Oct 29 23:38:41.682086 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:41.682071 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx" event={"ID":"6386da02-f1c3-4158-81f9-675f84da4261","Type":"ContainerDied","Data":"36ffaab7995318580f11a36bab4eb216a7c3888b8f4fbbab538240be9ccf9dcb"} Oct 29 23:38:41.682196 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:41.682099 6029 scope.go:122] "RemoveContainer" containerID="2e68494d7f12d8f5dbd41c089aad63f131c6cfeacef0c76432f5f0e9e80fb5cd" Oct 29 23:38:41.692461 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:41.692443 6029 scope.go:122] "RemoveContainer" containerID="2e68494d7f12d8f5dbd41c089aad63f131c6cfeacef0c76432f5f0e9e80fb5cd" Oct 29 23:38:41.692719 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:38:41.692699 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e68494d7f12d8f5dbd41c089aad63f131c6cfeacef0c76432f5f0e9e80fb5cd\": container with ID starting with 2e68494d7f12d8f5dbd41c089aad63f131c6cfeacef0c76432f5f0e9e80fb5cd not found: ID does not exist" containerID="2e68494d7f12d8f5dbd41c089aad63f131c6cfeacef0c76432f5f0e9e80fb5cd" Oct 29 23:38:41.692763 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:41.692729 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e68494d7f12d8f5dbd41c089aad63f131c6cfeacef0c76432f5f0e9e80fb5cd"} err="failed to get container status \"2e68494d7f12d8f5dbd41c089aad63f131c6cfeacef0c76432f5f0e9e80fb5cd\": rpc error: code = NotFound desc = could not find container \"2e68494d7f12d8f5dbd41c089aad63f131c6cfeacef0c76432f5f0e9e80fb5cd\": container with ID starting with 2e68494d7f12d8f5dbd41c089aad63f131c6cfeacef0c76432f5f0e9e80fb5cd not found: ID does not exist" Oct 29 23:38:41.738106 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:41.738075 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx"] Oct 29 23:38:41.742256 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:41.742226 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-rw8fx"] Oct 29 23:38:43.388030 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:38:43.387999 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6386da02-f1c3-4158-81f9-675f84da4261" path="/var/lib/kubelet/pods/6386da02-f1c3-4158-81f9-675f84da4261/volumes" Oct 29 23:39:08.920481 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:39:08.920441 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:39:38.921209 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:39:38.921169 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:39:44.415938 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:44.415900 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-q65w9"] Oct 29 23:39:44.416354 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:44.416312 6029 cpu_manager.go:414] "containerMap: removing container" podUID="6386da02-f1c3-4158-81f9-675f84da4261" containerName="manager" Oct 29 23:39:44.416354 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:44.416323 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6386da02-f1c3-4158-81f9-675f84da4261" containerName="manager" Oct 29 23:39:44.416443 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:44.416361 6029 cpu_manager.go:414] "containerMap: removing container" podUID="f337a617-6823-45f4-9022-4a0d056587c1" containerName="maas-api" Oct 29 23:39:44.416443 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:44.416367 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f337a617-6823-45f4-9022-4a0d056587c1" containerName="maas-api" Oct 29 23:39:44.416443 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:44.416426 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="b39e7c06-e062-4b42-ae3e-eb1d72e058bb" containerName="istio-proxy" Oct 29 23:39:44.416443 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:44.416438 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="f337a617-6823-45f4-9022-4a0d056587c1" containerName="maas-api" Oct 29 23:39:44.416443 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:44.416445 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="6386da02-f1c3-4158-81f9-675f84da4261" containerName="manager" Oct 29 23:39:44.419560 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:44.419540 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-q65w9" Oct 29 23:39:44.435284 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:44.435256 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-q65w9"] Oct 29 23:39:44.446569 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:44.446550 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bldxg\"" Oct 29 23:39:44.498092 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:44.498052 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c79518e7-0e58-4045-a809-48918e0e2e5f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-q65w9\" (UID: \"c79518e7-0e58-4045-a809-48918e0e2e5f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-q65w9" Oct 29 23:39:44.498241 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:44.498105 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gztvb\" (UniqueName: \"kubernetes.io/projected/c79518e7-0e58-4045-a809-48918e0e2e5f-kube-api-access-gztvb\") pod \"kuadrant-operator-controller-manager-57bb9bfff-q65w9\" (UID: \"c79518e7-0e58-4045-a809-48918e0e2e5f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-q65w9" Oct 29 23:39:44.599032 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:44.598999 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gztvb\" (UniqueName: \"kubernetes.io/projected/c79518e7-0e58-4045-a809-48918e0e2e5f-kube-api-access-gztvb\") pod \"kuadrant-operator-controller-manager-57bb9bfff-q65w9\" (UID: \"c79518e7-0e58-4045-a809-48918e0e2e5f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-q65w9" Oct 29 23:39:44.599233 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:44.599117 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c79518e7-0e58-4045-a809-48918e0e2e5f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-q65w9\" (UID: \"c79518e7-0e58-4045-a809-48918e0e2e5f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-q65w9" Oct 29 23:39:44.599469 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:44.599452 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c79518e7-0e58-4045-a809-48918e0e2e5f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-q65w9\" (UID: \"c79518e7-0e58-4045-a809-48918e0e2e5f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-q65w9" Oct 29 23:39:44.620941 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:44.620915 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gztvb\" (UniqueName: \"kubernetes.io/projected/c79518e7-0e58-4045-a809-48918e0e2e5f-kube-api-access-gztvb\") pod \"kuadrant-operator-controller-manager-57bb9bfff-q65w9\" (UID: \"c79518e7-0e58-4045-a809-48918e0e2e5f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-q65w9" Oct 29 23:39:44.732572 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:44.732480 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-q65w9" Oct 29 23:39:45.054884 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:45.054851 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-q65w9"] Oct 29 23:39:45.055345 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:39:45.055318 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc79518e7_0e58_4045_a809_48918e0e2e5f.slice/crio-1a997500b4321ede9cd9cd6a5fd0a4815c360bd3dbb937e07b3e9022ee4a78e0 WatchSource:0}: Error finding container 1a997500b4321ede9cd9cd6a5fd0a4815c360bd3dbb937e07b3e9022ee4a78e0: Status 404 returned error can't find the container with id 1a997500b4321ede9cd9cd6a5fd0a4815c360bd3dbb937e07b3e9022ee4a78e0 Oct 29 23:39:46.021693 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:46.021656 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-q65w9" event={"ID":"c79518e7-0e58-4045-a809-48918e0e2e5f","Type":"ContainerStarted","Data":"070c6574464222940e46cbeb317a1d055fc70a4d5f3ef3d0391211f803b0515c"} Oct 29 23:39:46.022239 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:46.021710 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-q65w9" event={"ID":"c79518e7-0e58-4045-a809-48918e0e2e5f","Type":"ContainerStarted","Data":"1a997500b4321ede9cd9cd6a5fd0a4815c360bd3dbb937e07b3e9022ee4a78e0"} Oct 29 23:39:46.022239 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:46.021730 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-q65w9" Oct 29 23:39:46.095924 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:46.095868 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-q65w9" podStartSLOduration=2.095852681 podStartE2EDuration="2.095852681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:39:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:39:46.080285901 +0000 UTC m=+1552.806536516" watchObservedRunningTime="2026-10-29 23:39:46.095852681 +0000 UTC m=+1552.822103274" Oct 29 23:39:57.030067 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:39:57.030038 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-q65w9" Oct 29 23:40:06.908840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:06.907939 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-zrhxv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 29 23:40:06.908840 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:06.908025 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" podUID="78822c5b-2a93-412c-8fef-e7673ce74a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 29 23:40:08.920964 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:40:08.920855 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:40:38.921791 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:40:38.921753 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:40:42.498102 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:42.498067 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb"] Oct 29 23:40:42.501951 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:42.501926 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" Oct 29 23:40:42.534990 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:42.534958 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-e165bd-serving-cert\"" Oct 29 23:40:42.537029 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:42.537002 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb"] Oct 29 23:40:42.598563 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:42.598518 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-254z4\" (UniqueName: \"kubernetes.io/projected/3a0f7950-7e7c-4060-a333-5ea694f840c1-kube-api-access-254z4\") pod \"maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb\" (UID: \"3a0f7950-7e7c-4060-a333-5ea694f840c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" Oct 29 23:40:42.598748 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:42.598570 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a0f7950-7e7c-4060-a333-5ea694f840c1-metrics-certs\") pod \"maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb\" (UID: \"3a0f7950-7e7c-4060-a333-5ea694f840c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" Oct 29 23:40:42.598748 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:42.598650 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a0f7950-7e7c-4060-a333-5ea694f840c1-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb\" (UID: \"3a0f7950-7e7c-4060-a333-5ea694f840c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" Oct 29 23:40:42.598748 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:42.598697 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a0f7950-7e7c-4060-a333-5ea694f840c1-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb\" (UID: \"3a0f7950-7e7c-4060-a333-5ea694f840c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" Oct 29 23:40:42.699659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:42.699617 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-254z4\" (UniqueName: \"kubernetes.io/projected/3a0f7950-7e7c-4060-a333-5ea694f840c1-kube-api-access-254z4\") pod \"maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb\" (UID: \"3a0f7950-7e7c-4060-a333-5ea694f840c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" Oct 29 23:40:42.699659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:42.699665 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a0f7950-7e7c-4060-a333-5ea694f840c1-metrics-certs\") pod \"maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb\" (UID: \"3a0f7950-7e7c-4060-a333-5ea694f840c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" Oct 29 23:40:42.699939 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:42.699684 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a0f7950-7e7c-4060-a333-5ea694f840c1-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb\" (UID: \"3a0f7950-7e7c-4060-a333-5ea694f840c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" Oct 29 23:40:42.699939 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:42.699753 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a0f7950-7e7c-4060-a333-5ea694f840c1-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb\" (UID: \"3a0f7950-7e7c-4060-a333-5ea694f840c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" Oct 29 23:40:42.699939 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:40:42.699862 6029 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-serving-cert: secret "maas-api-e2e-worker-single-main-e165bd-serving-cert" not found Oct 29 23:40:42.700114 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:40:42.699947 6029 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a0f7950-7e7c-4060-a333-5ea694f840c1-maas-api-tls podName:3a0f7950-7e7c-4060-a333-5ea694f840c1 nodeName:}" failed. No retries permitted until 2026-10-29 23:40:43.19992815 +0000 UTC m=+1609.926178738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3a0f7950-7e7c-4060-a333-5ea694f840c1-maas-api-tls") pod "maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" (UID: "3a0f7950-7e7c-4060-a333-5ea694f840c1") : secret "maas-api-e2e-worker-single-main-e165bd-serving-cert" not found Oct 29 23:40:42.700338 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:42.700321 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a0f7950-7e7c-4060-a333-5ea694f840c1-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb\" (UID: \"3a0f7950-7e7c-4060-a333-5ea694f840c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" Oct 29 23:40:42.702315 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:42.702293 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a0f7950-7e7c-4060-a333-5ea694f840c1-metrics-certs\") pod \"maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb\" (UID: \"3a0f7950-7e7c-4060-a333-5ea694f840c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" Oct 29 23:40:42.723491 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:42.723460 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-254z4\" (UniqueName: \"kubernetes.io/projected/3a0f7950-7e7c-4060-a333-5ea694f840c1-kube-api-access-254z4\") pod \"maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb\" (UID: \"3a0f7950-7e7c-4060-a333-5ea694f840c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" Oct 29 23:40:43.205668 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:43.205629 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a0f7950-7e7c-4060-a333-5ea694f840c1-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb\" (UID: \"3a0f7950-7e7c-4060-a333-5ea694f840c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" Oct 29 23:40:43.208129 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:43.208088 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a0f7950-7e7c-4060-a333-5ea694f840c1-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb\" (UID: \"3a0f7950-7e7c-4060-a333-5ea694f840c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" Oct 29 23:40:43.415233 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:43.415192 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" Oct 29 23:40:43.720304 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:43.720261 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb"] Oct 29 23:40:43.721172 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:40:43.721147 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a0f7950_7e7c_4060_a333_5ea694f840c1.slice/crio-29013f951f9faedfe6e08f4e9b53c0179d50b487622240a553a762d3fdda1f23 WatchSource:0}: Error finding container 29013f951f9faedfe6e08f4e9b53c0179d50b487622240a553a762d3fdda1f23: Status 404 returned error can't find the container with id 29013f951f9faedfe6e08f4e9b53c0179d50b487622240a553a762d3fdda1f23 Oct 29 23:40:44.429193 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:44.429158 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" event={"ID":"3a0f7950-7e7c-4060-a333-5ea694f840c1","Type":"ContainerStarted","Data":"92e53cc823a0ac3ef31de62d69d693f03665fac513f1054ae34150ed06a94998"} Oct 29 23:40:44.429397 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:44.429211 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" event={"ID":"3a0f7950-7e7c-4060-a333-5ea694f840c1","Type":"ContainerStarted","Data":"29013f951f9faedfe6e08f4e9b53c0179d50b487622240a553a762d3fdda1f23"} Oct 29 23:40:44.429397 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:44.429234 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" Oct 29 23:40:44.473511 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:44.473460 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" podStartSLOduration=1.920958899 podStartE2EDuration="2.473446084s" totalImagesPullingTime="552.487185ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:40:44.472009495 +0000 UTC m=+1611.198260088" watchObservedRunningTime="2026-10-29 23:40:44.473446084 +0000 UTC m=+1611.199696673" Oct 29 23:40:50.440956 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:40:50.440924 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" Oct 29 23:41:08.922752 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:41:08.922673 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:41:38.925134 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:41:38.925094 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:41:41.952455 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:41.952421 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb"] Oct 29 23:41:41.952895 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:41.952616 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" podUID="3a0f7950-7e7c-4060-a333-5ea694f840c1" containerName="maas-api" containerID="cri-o://92e53cc823a0ac3ef31de62d69d693f03665fac513f1054ae34150ed06a94998" gracePeriod=30 Oct 29 23:41:42.417838 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:42.417784 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" Oct 29 23:41:42.520961 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:42.520931 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3a0f7950-7e7c-4060-a333-5ea694f840c1-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a0f7950-7e7c-4060-a333-5ea694f840c1-maas-api-tls\") pod \"3a0f7950-7e7c-4060-a333-5ea694f840c1\" (UID: \"3a0f7950-7e7c-4060-a333-5ea694f840c1\") " Oct 29 23:41:42.521172 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:42.521088 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3a0f7950-7e7c-4060-a333-5ea694f840c1-kube-api-access-254z4\" (UniqueName: \"kubernetes.io/projected/3a0f7950-7e7c-4060-a333-5ea694f840c1-kube-api-access-254z4\") pod \"3a0f7950-7e7c-4060-a333-5ea694f840c1\" (UID: \"3a0f7950-7e7c-4060-a333-5ea694f840c1\") " Oct 29 23:41:42.521250 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:42.521207 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3a0f7950-7e7c-4060-a333-5ea694f840c1-metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a0f7950-7e7c-4060-a333-5ea694f840c1-metrics-certs\") pod \"3a0f7950-7e7c-4060-a333-5ea694f840c1\" (UID: \"3a0f7950-7e7c-4060-a333-5ea694f840c1\") " Oct 29 23:41:42.521309 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:42.521258 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3a0f7950-7e7c-4060-a333-5ea694f840c1-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a0f7950-7e7c-4060-a333-5ea694f840c1-openshift-service-ca\") pod \"3a0f7950-7e7c-4060-a333-5ea694f840c1\" (UID: \"3a0f7950-7e7c-4060-a333-5ea694f840c1\") " Oct 29 23:41:42.521666 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:42.521637 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a0f7950-7e7c-4060-a333-5ea694f840c1-openshift-service-ca" pod "3a0f7950-7e7c-4060-a333-5ea694f840c1" (UID: "3a0f7950-7e7c-4060-a333-5ea694f840c1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:41:42.523163 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:42.523137 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a0f7950-7e7c-4060-a333-5ea694f840c1-maas-api-tls" pod "3a0f7950-7e7c-4060-a333-5ea694f840c1" (UID: "3a0f7950-7e7c-4060-a333-5ea694f840c1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:41:42.523324 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:42.523295 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a0f7950-7e7c-4060-a333-5ea694f840c1-metrics-certs" pod "3a0f7950-7e7c-4060-a333-5ea694f840c1" (UID: "3a0f7950-7e7c-4060-a333-5ea694f840c1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:41:42.523453 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:42.523439 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a0f7950-7e7c-4060-a333-5ea694f840c1-kube-api-access-254z4" pod "3a0f7950-7e7c-4060-a333-5ea694f840c1" (UID: "3a0f7950-7e7c-4060-a333-5ea694f840c1"). InnerVolumeSpecName "kube-api-access-254z4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:41:42.623075 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:42.623040 6029 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a0f7950-7e7c-4060-a333-5ea694f840c1-maas-api-tls\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:41:42.623075 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:42.623069 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-254z4\" (UniqueName: \"kubernetes.io/projected/3a0f7950-7e7c-4060-a333-5ea694f840c1-kube-api-access-254z4\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:41:42.623075 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:42.623081 6029 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a0f7950-7e7c-4060-a333-5ea694f840c1-metrics-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:41:42.623317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:42.623090 6029 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a0f7950-7e7c-4060-a333-5ea694f840c1-openshift-service-ca\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:41:42.741454 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:42.741419 6029 generic.go:356] "Generic (PLEG): container finished" podID="3a0f7950-7e7c-4060-a333-5ea694f840c1" containerID="92e53cc823a0ac3ef31de62d69d693f03665fac513f1054ae34150ed06a94998" exitCode=0 Oct 29 23:41:42.741653 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:42.741479 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" event={"ID":"3a0f7950-7e7c-4060-a333-5ea694f840c1","Type":"ContainerDied","Data":"92e53cc823a0ac3ef31de62d69d693f03665fac513f1054ae34150ed06a94998"} Oct 29 23:41:42.741653 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:42.741520 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" event={"ID":"3a0f7950-7e7c-4060-a333-5ea694f840c1","Type":"ContainerDied","Data":"29013f951f9faedfe6e08f4e9b53c0179d50b487622240a553a762d3fdda1f23"} Oct 29 23:41:42.741653 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:42.741542 6029 scope.go:122] "RemoveContainer" containerID="92e53cc823a0ac3ef31de62d69d693f03665fac513f1054ae34150ed06a94998" Oct 29 23:41:42.741653 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:42.741478 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb" Oct 29 23:41:42.751179 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:42.751163 6029 scope.go:122] "RemoveContainer" containerID="92e53cc823a0ac3ef31de62d69d693f03665fac513f1054ae34150ed06a94998" Oct 29 23:41:42.751470 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:41:42.751450 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92e53cc823a0ac3ef31de62d69d693f03665fac513f1054ae34150ed06a94998\": container with ID starting with 92e53cc823a0ac3ef31de62d69d693f03665fac513f1054ae34150ed06a94998 not found: ID does not exist" containerID="92e53cc823a0ac3ef31de62d69d693f03665fac513f1054ae34150ed06a94998" Oct 29 23:41:42.751557 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:42.751477 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92e53cc823a0ac3ef31de62d69d693f03665fac513f1054ae34150ed06a94998"} err="failed to get container status \"92e53cc823a0ac3ef31de62d69d693f03665fac513f1054ae34150ed06a94998\": rpc error: code = NotFound desc = could not find container \"92e53cc823a0ac3ef31de62d69d693f03665fac513f1054ae34150ed06a94998\": container with ID starting with 92e53cc823a0ac3ef31de62d69d693f03665fac513f1054ae34150ed06a94998 not found: ID does not exist" Oct 29 23:41:42.797423 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:42.797300 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb"] Oct 29 23:41:42.799842 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:42.799800 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e165bd-6b45d77db4-vq8pb"] Oct 29 23:41:43.388490 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:41:43.388455 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3a0f7950-7e7c-4060-a333-5ea694f840c1" path="/var/lib/kubelet/pods/3a0f7950-7e7c-4060-a333-5ea694f840c1/volumes" Oct 29 23:42:08.922515 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:42:08.922478 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:42:38.921369 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:42:38.921332 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:42:51.899065 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:42:51.899021 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-zrhxv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 29 23:42:51.899796 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:42:51.899759 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" podUID="78822c5b-2a93-412c-8fef-e7673ce74a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 29 23:43:06.902033 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:06.901986 6029 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-746ff8f49f-zrhxv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 29 23:43:06.902557 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:06.902080 6029 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-746ff8f49f-zrhxv" podUID="78822c5b-2a93-412c-8fef-e7673ce74a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 29 23:43:08.923875 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:43:08.923838 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:43:26.377584 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:26.377549 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-595cc648c-b6rbf"] Oct 29 23:43:26.378109 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:26.378028 6029 cpu_manager.go:414] "containerMap: removing container" podUID="3a0f7950-7e7c-4060-a333-5ea694f840c1" containerName="maas-api" Oct 29 23:43:26.378109 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:26.378041 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3a0f7950-7e7c-4060-a333-5ea694f840c1" containerName="maas-api" Oct 29 23:43:26.378187 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:26.378111 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="3a0f7950-7e7c-4060-a333-5ea694f840c1" containerName="maas-api" Oct 29 23:43:26.381211 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:26.381195 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-595cc648c-b6rbf" Oct 29 23:43:26.416456 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:26.416424 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-595cc648c-b6rbf"] Oct 29 23:43:26.465173 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:26.465130 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pztp\" (UniqueName: \"kubernetes.io/projected/558de6a3-f574-4133-a6d4-10851ee0ebee-kube-api-access-9pztp\") pod \"maas-api-595cc648c-b6rbf\" (UID: \"558de6a3-f574-4133-a6d4-10851ee0ebee\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-b6rbf" Oct 29 23:43:26.465516 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:26.465492 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/558de6a3-f574-4133-a6d4-10851ee0ebee-metrics-certs\") pod \"maas-api-595cc648c-b6rbf\" (UID: \"558de6a3-f574-4133-a6d4-10851ee0ebee\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-b6rbf" Oct 29 23:43:26.465655 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:26.465532 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/558de6a3-f574-4133-a6d4-10851ee0ebee-maas-api-tls\") pod \"maas-api-595cc648c-b6rbf\" (UID: \"558de6a3-f574-4133-a6d4-10851ee0ebee\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-b6rbf" Oct 29 23:43:26.465725 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:26.465671 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/558de6a3-f574-4133-a6d4-10851ee0ebee-openshift-service-ca\") pod \"maas-api-595cc648c-b6rbf\" (UID: \"558de6a3-f574-4133-a6d4-10851ee0ebee\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-b6rbf" Oct 29 23:43:26.566311 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:26.566272 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/558de6a3-f574-4133-a6d4-10851ee0ebee-metrics-certs\") pod \"maas-api-595cc648c-b6rbf\" (UID: \"558de6a3-f574-4133-a6d4-10851ee0ebee\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-b6rbf" Oct 29 23:43:26.566311 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:26.566319 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/558de6a3-f574-4133-a6d4-10851ee0ebee-maas-api-tls\") pod \"maas-api-595cc648c-b6rbf\" (UID: \"558de6a3-f574-4133-a6d4-10851ee0ebee\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-b6rbf" Oct 29 23:43:26.566597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:26.566369 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/558de6a3-f574-4133-a6d4-10851ee0ebee-openshift-service-ca\") pod \"maas-api-595cc648c-b6rbf\" (UID: \"558de6a3-f574-4133-a6d4-10851ee0ebee\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-b6rbf" Oct 29 23:43:26.566597 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:26.566456 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pztp\" (UniqueName: \"kubernetes.io/projected/558de6a3-f574-4133-a6d4-10851ee0ebee-kube-api-access-9pztp\") pod \"maas-api-595cc648c-b6rbf\" (UID: \"558de6a3-f574-4133-a6d4-10851ee0ebee\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-b6rbf" Oct 29 23:43:26.567224 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:26.567197 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/558de6a3-f574-4133-a6d4-10851ee0ebee-openshift-service-ca\") pod \"maas-api-595cc648c-b6rbf\" (UID: \"558de6a3-f574-4133-a6d4-10851ee0ebee\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-b6rbf" Oct 29 23:43:26.569021 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:26.568999 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/558de6a3-f574-4133-a6d4-10851ee0ebee-maas-api-tls\") pod \"maas-api-595cc648c-b6rbf\" (UID: \"558de6a3-f574-4133-a6d4-10851ee0ebee\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-b6rbf" Oct 29 23:43:26.569416 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:26.569397 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/558de6a3-f574-4133-a6d4-10851ee0ebee-metrics-certs\") pod \"maas-api-595cc648c-b6rbf\" (UID: \"558de6a3-f574-4133-a6d4-10851ee0ebee\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-b6rbf" Oct 29 23:43:26.587026 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:26.586995 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pztp\" (UniqueName: \"kubernetes.io/projected/558de6a3-f574-4133-a6d4-10851ee0ebee-kube-api-access-9pztp\") pod \"maas-api-595cc648c-b6rbf\" (UID: \"558de6a3-f574-4133-a6d4-10851ee0ebee\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-b6rbf" Oct 29 23:43:26.695688 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:26.695605 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-595cc648c-b6rbf" Oct 29 23:43:26.997724 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:26.997690 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-595cc648c-b6rbf"] Oct 29 23:43:26.998715 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:43:26.998684 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod558de6a3_f574_4133_a6d4_10851ee0ebee.slice/crio-3010b4f6e9fdfc3fd7fbd59b6d0fb7ee87a997799c564a5df703aeeb59f01419 WatchSource:0}: Error finding container 3010b4f6e9fdfc3fd7fbd59b6d0fb7ee87a997799c564a5df703aeeb59f01419: Status 404 returned error can't find the container with id 3010b4f6e9fdfc3fd7fbd59b6d0fb7ee87a997799c564a5df703aeeb59f01419 Oct 29 23:43:27.000460 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:27.000444 6029 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 29 23:43:27.477677 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:27.477641 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-595cc648c-b6rbf" event={"ID":"558de6a3-f574-4133-a6d4-10851ee0ebee","Type":"ContainerStarted","Data":"00ed6c6a562a0c09177829138652620b1cca0e2ab71df6990ba333f8c8ea0cf7"} Oct 29 23:43:27.478076 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:27.477700 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-595cc648c-b6rbf" event={"ID":"558de6a3-f574-4133-a6d4-10851ee0ebee","Type":"ContainerStarted","Data":"3010b4f6e9fdfc3fd7fbd59b6d0fb7ee87a997799c564a5df703aeeb59f01419"} Oct 29 23:43:27.478076 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:27.477730 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-595cc648c-b6rbf" Oct 29 23:43:27.519959 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:27.519905 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-595cc648c-b6rbf" podStartSLOduration=1.165603225 podStartE2EDuration="1.519890689s" totalImagesPullingTime="354.287464ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:43:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:43:27.519567726 +0000 UTC m=+1774.245818319" watchObservedRunningTime="2026-10-29 23:43:27.519890689 +0000 UTC m=+1774.246141281" Oct 29 23:43:33.489323 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:33.489294 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-595cc648c-b6rbf" Oct 29 23:43:38.919884 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:43:38.919848 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:43:41.063222 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:41.063178 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4"] Oct 29 23:43:41.063659 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:41.063523 6029 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" podUID="9ab51783-0a1c-48ef-97b1-335e83373f75" containerName="maas-api" containerID="cri-o://720ea62ab5cb55c9ba6498910b9bbe71d466af69c9153154bef4abd581ffb5a6" gracePeriod=30 Oct 29 23:43:42.318466 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:42.318438 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" Oct 29 23:43:42.449594 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:42.449499 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9ab51783-0a1c-48ef-97b1-335e83373f75-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ab51783-0a1c-48ef-97b1-335e83373f75-openshift-service-ca\") pod \"9ab51783-0a1c-48ef-97b1-335e83373f75\" (UID: \"9ab51783-0a1c-48ef-97b1-335e83373f75\") " Oct 29 23:43:42.449594 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:42.449556 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ab51783-0a1c-48ef-97b1-335e83373f75-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ab51783-0a1c-48ef-97b1-335e83373f75-maas-api-tls\") pod \"9ab51783-0a1c-48ef-97b1-335e83373f75\" (UID: \"9ab51783-0a1c-48ef-97b1-335e83373f75\") " Oct 29 23:43:42.449850 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:42.449656 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ab51783-0a1c-48ef-97b1-335e83373f75-kube-api-access-zp49j\" (UniqueName: \"kubernetes.io/projected/9ab51783-0a1c-48ef-97b1-335e83373f75-kube-api-access-zp49j\") pod \"9ab51783-0a1c-48ef-97b1-335e83373f75\" (UID: \"9ab51783-0a1c-48ef-97b1-335e83373f75\") " Oct 29 23:43:42.449850 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:42.449721 6029 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ab51783-0a1c-48ef-97b1-335e83373f75-metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ab51783-0a1c-48ef-97b1-335e83373f75-metrics-certs\") pod \"9ab51783-0a1c-48ef-97b1-335e83373f75\" (UID: \"9ab51783-0a1c-48ef-97b1-335e83373f75\") " Oct 29 23:43:42.449957 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:42.449886 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ab51783-0a1c-48ef-97b1-335e83373f75-openshift-service-ca" pod "9ab51783-0a1c-48ef-97b1-335e83373f75" (UID: "9ab51783-0a1c-48ef-97b1-335e83373f75"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:43:42.450112 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:42.450094 6029 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ab51783-0a1c-48ef-97b1-335e83373f75-openshift-service-ca\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:43:42.451891 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:42.451863 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ab51783-0a1c-48ef-97b1-335e83373f75-kube-api-access-zp49j" pod "9ab51783-0a1c-48ef-97b1-335e83373f75" (UID: "9ab51783-0a1c-48ef-97b1-335e83373f75"). InnerVolumeSpecName "kube-api-access-zp49j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:43:42.451891 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:42.451874 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ab51783-0a1c-48ef-97b1-335e83373f75-metrics-certs" pod "9ab51783-0a1c-48ef-97b1-335e83373f75" (UID: "9ab51783-0a1c-48ef-97b1-335e83373f75"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:43:42.452055 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:42.452039 6029 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ab51783-0a1c-48ef-97b1-335e83373f75-maas-api-tls" pod "9ab51783-0a1c-48ef-97b1-335e83373f75" (UID: "9ab51783-0a1c-48ef-97b1-335e83373f75"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:43:42.551027 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:42.550989 6029 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zp49j\" (UniqueName: \"kubernetes.io/projected/9ab51783-0a1c-48ef-97b1-335e83373f75-kube-api-access-zp49j\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:43:42.551027 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:42.551023 6029 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ab51783-0a1c-48ef-97b1-335e83373f75-metrics-certs\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:43:42.551027 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:42.551032 6029 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ab51783-0a1c-48ef-97b1-335e83373f75-maas-api-tls\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Oct 29 23:43:42.586502 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:42.586470 6029 generic.go:356] "Generic (PLEG): container finished" podID="9ab51783-0a1c-48ef-97b1-335e83373f75" containerID="720ea62ab5cb55c9ba6498910b9bbe71d466af69c9153154bef4abd581ffb5a6" exitCode=0 Oct 29 23:43:42.586669 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:42.586517 6029 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" Oct 29 23:43:42.586669 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:42.586542 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" event={"ID":"9ab51783-0a1c-48ef-97b1-335e83373f75","Type":"ContainerDied","Data":"720ea62ab5cb55c9ba6498910b9bbe71d466af69c9153154bef4abd581ffb5a6"} Oct 29 23:43:42.586669 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:42.586583 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4" event={"ID":"9ab51783-0a1c-48ef-97b1-335e83373f75","Type":"ContainerDied","Data":"9cc1eec10ead914aa4ee87fc9adf6f1ca43b5e7c41587e7d24201b79c075d3af"} Oct 29 23:43:42.586669 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:42.586605 6029 scope.go:122] "RemoveContainer" containerID="720ea62ab5cb55c9ba6498910b9bbe71d466af69c9153154bef4abd581ffb5a6" Oct 29 23:43:42.598800 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:42.598776 6029 scope.go:122] "RemoveContainer" containerID="720ea62ab5cb55c9ba6498910b9bbe71d466af69c9153154bef4abd581ffb5a6" Oct 29 23:43:42.599411 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:43:42.599389 6029 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"720ea62ab5cb55c9ba6498910b9bbe71d466af69c9153154bef4abd581ffb5a6\": container with ID starting with 720ea62ab5cb55c9ba6498910b9bbe71d466af69c9153154bef4abd581ffb5a6 not found: ID does not exist" containerID="720ea62ab5cb55c9ba6498910b9bbe71d466af69c9153154bef4abd581ffb5a6" Oct 29 23:43:42.599485 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:42.599424 6029 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"720ea62ab5cb55c9ba6498910b9bbe71d466af69c9153154bef4abd581ffb5a6"} err="failed to get container status \"720ea62ab5cb55c9ba6498910b9bbe71d466af69c9153154bef4abd581ffb5a6\": rpc error: code = NotFound desc = could not find container \"720ea62ab5cb55c9ba6498910b9bbe71d466af69c9153154bef4abd581ffb5a6\": container with ID starting with 720ea62ab5cb55c9ba6498910b9bbe71d466af69c9153154bef4abd581ffb5a6 not found: ID does not exist" Oct 29 23:43:42.640876 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:42.640841 6029 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4"] Oct 29 23:43:42.654731 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:42.654696 6029 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-sdfq4"] Oct 29 23:43:43.389384 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:43:43.389354 6029 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9ab51783-0a1c-48ef-97b1-335e83373f75" path="/var/lib/kubelet/pods/9ab51783-0a1c-48ef-97b1-335e83373f75/volumes" Oct 29 23:44:08.922302 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:44:08.922218 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:44:26.619042 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:44:26.619002 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76c4776574-7jpnh_90af7b4e-6275-411a-b500-350eb13a9fcf/authorino/0.log" Oct 29 23:44:38.921256 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:44:38.921218 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:44:39.536912 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:44:39.536882 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb7fb9d97-gn689_a4b1ce04-621e-4d74-83ca-d81f95cca923/copy-manifests/0.log" Oct 29 23:44:39.565218 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:44:39.565185 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb7fb9d97-gn689_a4b1ce04-621e-4d74-83ca-d81f95cca923/manager/0.log" Oct 29 23:44:40.004615 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:44:40.004587 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-7d94f55f4b-bk27h_a89e0a87-6c32-487d-a28e-efa597f92c09/proxy/0.log" Oct 29 23:44:40.827231 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:44:40.827200 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-595cc648c-b6rbf_558de6a3-f574-4133-a6d4-10851ee0ebee/maas-api/0.log" Oct 29 23:44:42.948196 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:44:42.948162 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-88hwr_7c1cdf4b-97ef-4c4e-a94d-e45a64dc08c8/postgres/0.log" Oct 29 23:44:44.506476 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:44:44.506442 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76c4776574-7jpnh_90af7b4e-6275-411a-b500-350eb13a9fcf/authorino/0.log" Oct 29 23:44:45.160246 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:44:45.160217 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-jt4xc_447608da-ac32-4cbc-9e92-1c9a24eddd8a/kuadrant-console-plugin/0.log" Oct 29 23:44:45.410026 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:44:45.409991 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-57bb9bfff-q65w9_c79518e7-0e58-4045-a809-48918e0e2e5f/manager/0.log" Oct 29 23:44:48.690439 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:44:48.690405 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-746ff8f49f-wv9ch_e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5/istio-proxy/0.log" Oct 29 23:44:48.898757 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:44:48.898722 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-746ff8f49f-xhg5s_ca770a17-0292-4428-8044-8a413b388227/istio-proxy/0.log" Oct 29 23:44:49.328269 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:44:49.328241 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-746ff8f49f-zrhxv_78822c5b-2a93-412c-8fef-e7673ce74a94/istio-proxy/0.log" Oct 29 23:44:49.524140 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:44:49.524108 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-cs4j7_ea0ed84a-fd93-4954-b7a3-90954be9f4b6/payload-pre-processing/0.log" Oct 29 23:44:49.697079 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:44:49.697003 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-ct2m8_e9dc9c76-648c-4dde-8a9c-823f0722c909/payload-processing/0.log" Oct 29 23:44:50.871001 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:44:50.870965 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc_6a0196c9-4399-4c90-98cd-fd8068e05436/main/0.log" Oct 29 23:44:51.282442 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:44:51.282413 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-5hwq6_84d55858-cdd3-4272-856b-d487fc5a815c/main/0.log" Oct 29 23:44:51.475979 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:44:51.475941 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-h5w72_a21a2cb5-2aac-4e11-9405-7d42222f4d1e/main/0.log" Oct 29 23:44:51.864182 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:44:51.864145 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx_6e20961c-72a4-4050-a8d2-69e02be47432/main/0.log" Oct 29 23:44:52.985157 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:44:52.985128 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76c4776574-7jpnh_90af7b4e-6275-411a-b500-350eb13a9fcf/authorino/0.log" Oct 29 23:45:04.271502 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:45:04.271474 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb7fb9d97-gn689_a4b1ce04-621e-4d74-83ca-d81f95cca923/copy-manifests/0.log" Oct 29 23:45:04.303197 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:45:04.303163 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb7fb9d97-gn689_a4b1ce04-621e-4d74-83ca-d81f95cca923/manager/0.log" Oct 29 23:45:04.757690 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:45:04.757658 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-7d94f55f4b-bk27h_a89e0a87-6c32-487d-a28e-efa597f92c09/proxy/0.log" Oct 29 23:45:05.270898 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:45:05.270867 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-595cc648c-b6rbf_558de6a3-f574-4133-a6d4-10851ee0ebee/maas-api/0.log" Oct 29 23:45:07.539260 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:45:07.539232 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-88hwr_7c1cdf4b-97ef-4c4e-a94d-e45a64dc08c8/postgres/0.log" Oct 29 23:45:08.686258 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:45:08.686228 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76c4776574-7jpnh_90af7b4e-6275-411a-b500-350eb13a9fcf/authorino/0.log" Oct 29 23:45:08.921467 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:45:08.921364 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:45:09.337992 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:45:09.337962 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-jt4xc_447608da-ac32-4cbc-9e92-1c9a24eddd8a/kuadrant-console-plugin/0.log" Oct 29 23:45:09.548580 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:45:09.548547 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-57bb9bfff-q65w9_c79518e7-0e58-4045-a809-48918e0e2e5f/manager/0.log" Oct 29 23:45:12.562607 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:45:12.562576 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-746ff8f49f-wv9ch_e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5/istio-proxy/0.log" Oct 29 23:45:12.785881 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:45:12.785846 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-746ff8f49f-xhg5s_ca770a17-0292-4428-8044-8a413b388227/istio-proxy/0.log" Oct 29 23:45:13.214339 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:45:13.214310 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-746ff8f49f-zrhxv_78822c5b-2a93-412c-8fef-e7673ce74a94/istio-proxy/0.log" Oct 29 23:45:13.407832 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:45:13.407801 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-cs4j7_ea0ed84a-fd93-4954-b7a3-90954be9f4b6/payload-pre-processing/0.log" Oct 29 23:45:13.588781 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:45:13.588752 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-ct2m8_e9dc9c76-648c-4dde-8a9c-823f0722c909/payload-processing/0.log" Oct 29 23:45:14.346427 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:45:14.346397 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-6lmrc_6a0196c9-4399-4c90-98cd-fd8068e05436/main/0.log" Oct 29 23:45:14.752042 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:45:14.752013 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-5hwq6_84d55858-cdd3-4272-856b-d487fc5a815c/main/0.log" Oct 29 23:45:14.952971 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:45:14.952936 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-h5w72_a21a2cb5-2aac-4e11-9405-7d42222f4d1e/main/0.log" Oct 29 23:45:15.389014 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:45:15.388986 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-cgtfx_6e20961c-72a4-4050-a8d2-69e02be47432/main/0.log" Oct 29 23:45:38.921356 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:45:38.921308 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:45:54.305808 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:45:54.305780 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-ct2m8_e9dc9c76-648c-4dde-8a9c-823f0722c909/payload-processing/0.log" Oct 29 23:45:54.493091 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:45:54.493061 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-ct2m8_e9dc9c76-648c-4dde-8a9c-823f0722c909/payload-processing/0.log" Oct 29 23:46:08.921542 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:46:08.921502 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:46:38.920881 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:46:38.920844 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:46:42.021341 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:42.021288 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-ct2m8_e9dc9c76-648c-4dde-8a9c-823f0722c909/payload-processing/0.log" Oct 29 23:46:42.215357 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:42.215322 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-ct2m8_e9dc9c76-648c-4dde-8a9c-823f0722c909/payload-processing/0.log" Oct 29 23:46:42.552412 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:42.552378 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gbnpg/must-gather-q5fdb"] Oct 29 23:46:42.552801 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:42.552789 6029 cpu_manager.go:414] "containerMap: removing container" podUID="9ab51783-0a1c-48ef-97b1-335e83373f75" containerName="maas-api" Oct 29 23:46:42.552875 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:42.552803 6029 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ab51783-0a1c-48ef-97b1-335e83373f75" containerName="maas-api" Oct 29 23:46:42.552912 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:42.552902 6029 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ab51783-0a1c-48ef-97b1-335e83373f75" containerName="maas-api" Oct 29 23:46:42.556204 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:42.556185 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gbnpg/must-gather-q5fdb" Oct 29 23:46:42.573514 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:42.573488 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gbnpg\"/\"openshift-service-ca.crt\"" Oct 29 23:46:42.587653 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:42.587622 6029 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gbnpg\"/\"kube-root-ca.crt\"" Oct 29 23:46:42.587854 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:42.587696 6029 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gbnpg\"/\"default-dockercfg-kv5q7\"" Oct 29 23:46:42.589706 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:42.589679 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gbnpg/must-gather-q5fdb"] Oct 29 23:46:42.642646 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:42.642609 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcqnj\" (UniqueName: \"kubernetes.io/projected/bbb1daf0-a85c-4c0b-9804-5f0d3c2280cd-kube-api-access-xcqnj\") pod \"must-gather-q5fdb\" (UID: \"bbb1daf0-a85c-4c0b-9804-5f0d3c2280cd\") " pod="openshift-must-gather-gbnpg/must-gather-q5fdb" Oct 29 23:46:42.642852 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:42.642660 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bbb1daf0-a85c-4c0b-9804-5f0d3c2280cd-must-gather-output\") pod \"must-gather-q5fdb\" (UID: \"bbb1daf0-a85c-4c0b-9804-5f0d3c2280cd\") " pod="openshift-must-gather-gbnpg/must-gather-q5fdb" Oct 29 23:46:42.743892 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:42.743854 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcqnj\" (UniqueName: \"kubernetes.io/projected/bbb1daf0-a85c-4c0b-9804-5f0d3c2280cd-kube-api-access-xcqnj\") pod \"must-gather-q5fdb\" (UID: \"bbb1daf0-a85c-4c0b-9804-5f0d3c2280cd\") " pod="openshift-must-gather-gbnpg/must-gather-q5fdb" Oct 29 23:46:42.744076 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:42.743926 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bbb1daf0-a85c-4c0b-9804-5f0d3c2280cd-must-gather-output\") pod \"must-gather-q5fdb\" (UID: \"bbb1daf0-a85c-4c0b-9804-5f0d3c2280cd\") " pod="openshift-must-gather-gbnpg/must-gather-q5fdb" Oct 29 23:46:42.744304 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:42.744285 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bbb1daf0-a85c-4c0b-9804-5f0d3c2280cd-must-gather-output\") pod \"must-gather-q5fdb\" (UID: \"bbb1daf0-a85c-4c0b-9804-5f0d3c2280cd\") " pod="openshift-must-gather-gbnpg/must-gather-q5fdb" Oct 29 23:46:42.765271 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:42.765239 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcqnj\" (UniqueName: \"kubernetes.io/projected/bbb1daf0-a85c-4c0b-9804-5f0d3c2280cd-kube-api-access-xcqnj\") pod \"must-gather-q5fdb\" (UID: \"bbb1daf0-a85c-4c0b-9804-5f0d3c2280cd\") " pod="openshift-must-gather-gbnpg/must-gather-q5fdb" Oct 29 23:46:42.870583 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:42.870494 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gbnpg/must-gather-q5fdb" Oct 29 23:46:43.180075 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:43.180048 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gbnpg/must-gather-q5fdb"] Oct 29 23:46:43.180624 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:46:43.180596 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbb1daf0_a85c_4c0b_9804_5f0d3c2280cd.slice/crio-56be651305d3e54c9eda64d4e5ece781603b21bc3a642ad41697dad553b20681 WatchSource:0}: Error finding container 56be651305d3e54c9eda64d4e5ece781603b21bc3a642ad41697dad553b20681: Status 404 returned error can't find the container with id 56be651305d3e54c9eda64d4e5ece781603b21bc3a642ad41697dad553b20681 Oct 29 23:46:43.604413 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:43.604379 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbnpg/must-gather-q5fdb" event={"ID":"bbb1daf0-a85c-4c0b-9804-5f0d3c2280cd","Type":"ContainerStarted","Data":"56be651305d3e54c9eda64d4e5ece781603b21bc3a642ad41697dad553b20681"} Oct 29 23:46:44.631978 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:44.631933 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbnpg/must-gather-q5fdb" event={"ID":"bbb1daf0-a85c-4c0b-9804-5f0d3c2280cd","Type":"ContainerStarted","Data":"b88c8402ad9e831bcbd9e5bc789087e23744ddaf23a0734482f79e0c650323a9"} Oct 29 23:46:44.632513 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:44.631992 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbnpg/must-gather-q5fdb" event={"ID":"bbb1daf0-a85c-4c0b-9804-5f0d3c2280cd","Type":"ContainerStarted","Data":"0b1e070d2518d398a129c018628d3df55a67d3f3343bd7fd57692a41d4285a4b"} Oct 29 23:46:44.675150 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:44.675099 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-gbnpg/must-gather-q5fdb" podStartSLOduration=1.914027075 podStartE2EDuration="2.675084825s" totalImagesPullingTime="761.05775ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:46:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:46:44.674040972 +0000 UTC m=+1971.400291565" watchObservedRunningTime="2026-10-29 23:46:44.675084825 +0000 UTC m=+1971.401335418" Oct 29 23:46:46.966053 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:46.966014 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4ctmg_f7add189-cde4-470f-a543-4dc4a91be859/global-pull-secret-syncer/0.log" Oct 29 23:46:48.061782 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:48.061749 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vnmw9_7138ba89-e1c9-4c07-a833-3ba8f9a54445/konnectivity-agent/0.log" Oct 29 23:46:48.296457 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:48.290684 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-163.ec2.internal_d854221abd6c4396f6ea6f6c004dea85/haproxy/0.log" Oct 29 23:46:55.253834 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:55.252847 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76c4776574-7jpnh_90af7b4e-6275-411a-b500-350eb13a9fcf/authorino/0.log" Oct 29 23:46:55.601341 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:55.601264 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-jt4xc_447608da-ac32-4cbc-9e92-1c9a24eddd8a/kuadrant-console-plugin/0.log" Oct 29 23:46:55.766410 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:55.766378 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-57bb9bfff-q65w9_c79518e7-0e58-4045-a809-48918e0e2e5f/manager/0.log" Oct 29 23:46:56.958114 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:56.956502 6029 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx"] Oct 29 23:46:56.964069 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:56.964039 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx" Oct 29 23:46:56.985558 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:56.985523 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx"] Oct 29 23:46:57.080612 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.080572 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4beccffa-7479-48a3-abb5-385bafc0bfe1-sys\") pod \"perf-node-gather-daemonset-szqtx\" (UID: \"4beccffa-7479-48a3-abb5-385bafc0bfe1\") " pod="openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx" Oct 29 23:46:57.080777 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.080632 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4beccffa-7479-48a3-abb5-385bafc0bfe1-lib-modules\") pod \"perf-node-gather-daemonset-szqtx\" (UID: \"4beccffa-7479-48a3-abb5-385bafc0bfe1\") " pod="openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx" Oct 29 23:46:57.080777 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.080724 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc76w\" (UniqueName: \"kubernetes.io/projected/4beccffa-7479-48a3-abb5-385bafc0bfe1-kube-api-access-mc76w\") pod \"perf-node-gather-daemonset-szqtx\" (UID: \"4beccffa-7479-48a3-abb5-385bafc0bfe1\") " pod="openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx" Oct 29 23:46:57.080777 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.080754 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4beccffa-7479-48a3-abb5-385bafc0bfe1-podres\") pod \"perf-node-gather-daemonset-szqtx\" (UID: \"4beccffa-7479-48a3-abb5-385bafc0bfe1\") " pod="openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx" Oct 29 23:46:57.080995 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.080978 6029 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4beccffa-7479-48a3-abb5-385bafc0bfe1-proc\") pod \"perf-node-gather-daemonset-szqtx\" (UID: \"4beccffa-7479-48a3-abb5-385bafc0bfe1\") " pod="openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx" Oct 29 23:46:57.182282 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.182246 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4beccffa-7479-48a3-abb5-385bafc0bfe1-sys\") pod \"perf-node-gather-daemonset-szqtx\" (UID: \"4beccffa-7479-48a3-abb5-385bafc0bfe1\") " pod="openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx" Oct 29 23:46:57.182468 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.182298 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4beccffa-7479-48a3-abb5-385bafc0bfe1-lib-modules\") pod \"perf-node-gather-daemonset-szqtx\" (UID: \"4beccffa-7479-48a3-abb5-385bafc0bfe1\") " pod="openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx" Oct 29 23:46:57.182468 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.182338 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc76w\" (UniqueName: \"kubernetes.io/projected/4beccffa-7479-48a3-abb5-385bafc0bfe1-kube-api-access-mc76w\") pod \"perf-node-gather-daemonset-szqtx\" (UID: \"4beccffa-7479-48a3-abb5-385bafc0bfe1\") " pod="openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx" Oct 29 23:46:57.182468 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.182363 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4beccffa-7479-48a3-abb5-385bafc0bfe1-podres\") pod \"perf-node-gather-daemonset-szqtx\" (UID: \"4beccffa-7479-48a3-abb5-385bafc0bfe1\") " pod="openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx" Oct 29 23:46:57.182624 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.182486 6029 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4beccffa-7479-48a3-abb5-385bafc0bfe1-proc\") pod \"perf-node-gather-daemonset-szqtx\" (UID: \"4beccffa-7479-48a3-abb5-385bafc0bfe1\") " pod="openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx" Oct 29 23:46:57.182683 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.182638 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4beccffa-7479-48a3-abb5-385bafc0bfe1-proc\") pod \"perf-node-gather-daemonset-szqtx\" (UID: \"4beccffa-7479-48a3-abb5-385bafc0bfe1\") " pod="openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx" Oct 29 23:46:57.182735 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.182697 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4beccffa-7479-48a3-abb5-385bafc0bfe1-sys\") pod \"perf-node-gather-daemonset-szqtx\" (UID: \"4beccffa-7479-48a3-abb5-385bafc0bfe1\") " pod="openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx" Oct 29 23:46:57.182792 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.182758 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4beccffa-7479-48a3-abb5-385bafc0bfe1-lib-modules\") pod \"perf-node-gather-daemonset-szqtx\" (UID: \"4beccffa-7479-48a3-abb5-385bafc0bfe1\") " pod="openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx" Oct 29 23:46:57.183108 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.183086 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4beccffa-7479-48a3-abb5-385bafc0bfe1-podres\") pod \"perf-node-gather-daemonset-szqtx\" (UID: \"4beccffa-7479-48a3-abb5-385bafc0bfe1\") " pod="openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx" Oct 29 23:46:57.203651 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.203618 6029 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc76w\" (UniqueName: \"kubernetes.io/projected/4beccffa-7479-48a3-abb5-385bafc0bfe1-kube-api-access-mc76w\") pod \"perf-node-gather-daemonset-szqtx\" (UID: \"4beccffa-7479-48a3-abb5-385bafc0bfe1\") " pod="openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx" Oct 29 23:46:57.285151 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.285119 6029 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx" Oct 29 23:46:57.565693 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.565568 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1af73798-70be-4b5a-ae99-96a2b4d9727c/alertmanager/0.log" Oct 29 23:46:57.618850 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.618804 6029 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx"] Oct 29 23:46:57.619712 ip-10-0-138-163 kubenswrapper[6029]: W1029 23:46:57.619677 6029 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4beccffa_7479_48a3_abb5_385bafc0bfe1.slice/crio-970c503c1509679bf72c7ab195f576041ffa489a51ee9552b3871b451314da1e WatchSource:0}: Error finding container 970c503c1509679bf72c7ab195f576041ffa489a51ee9552b3871b451314da1e: Status 404 returned error can't find the container with id 970c503c1509679bf72c7ab195f576041ffa489a51ee9552b3871b451314da1e Oct 29 23:46:57.675670 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.675646 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1af73798-70be-4b5a-ae99-96a2b4d9727c/config-reloader/0.log" Oct 29 23:46:57.783633 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.783605 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1af73798-70be-4b5a-ae99-96a2b4d9727c/kube-rbac-proxy-web/0.log" Oct 29 23:46:57.822887 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.818096 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx" event={"ID":"4beccffa-7479-48a3-abb5-385bafc0bfe1","Type":"ContainerStarted","Data":"ecd5f944ffe390437e4774c9b3460345e9fd8e6a4be983c56cecd1f90269bb11"} Oct 29 23:46:57.822887 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.818168 6029 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx" event={"ID":"4beccffa-7479-48a3-abb5-385bafc0bfe1","Type":"ContainerStarted","Data":"970c503c1509679bf72c7ab195f576041ffa489a51ee9552b3871b451314da1e"} Oct 29 23:46:57.822887 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.819078 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx" Oct 29 23:46:57.860848 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.860777 6029 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx" podStartSLOduration=1.860762574 podStartE2EDuration="1.860762574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:46:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:46:57.859615223 +0000 UTC m=+1984.585865816" watchObservedRunningTime="2026-10-29 23:46:57.860762574 +0000 UTC m=+1984.587013166" Oct 29 23:46:57.891772 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:57.891741 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1af73798-70be-4b5a-ae99-96a2b4d9727c/kube-rbac-proxy/0.log" Oct 29 23:46:58.000064 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:58.000039 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1af73798-70be-4b5a-ae99-96a2b4d9727c/kube-rbac-proxy-metric/0.log" Oct 29 23:46:58.110930 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:58.110861 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1af73798-70be-4b5a-ae99-96a2b4d9727c/prom-label-proxy/0.log" Oct 29 23:46:58.230714 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:58.230565 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1af73798-70be-4b5a-ae99-96a2b4d9727c/init-config-reloader/0.log" Oct 29 23:46:58.826150 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:58.826116 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-67998684c5-whnlb_5a425c1c-3f2d-46ef-895e-0e19f7795633/metrics-server/0.log" Oct 29 23:46:58.940754 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:58.940728 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-rpk9s_0234d968-7137-4520-8bd1-b26ee1f08885/monitoring-plugin/0.log" Oct 29 23:46:59.737530 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:59.737495 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pz649_56b29c9c-9fc1-44be-834e-76724afbb2a6/node-exporter/0.log" Oct 29 23:46:59.844182 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:59.844156 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pz649_56b29c9c-9fc1-44be-834e-76724afbb2a6/kube-rbac-proxy/0.log" Oct 29 23:46:59.952861 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:46:59.952832 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pz649_56b29c9c-9fc1-44be-834e-76724afbb2a6/init-textfile/0.log" Oct 29 23:47:01.300355 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:47:01.300319 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-m47cv_78f5b80d-524a-4d8a-8290-8a6fd7d1faa5/prometheus-operator/0.log" Oct 29 23:47:01.408761 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:47:01.408734 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-m47cv_78f5b80d-524a-4d8a-8290-8a6fd7d1faa5/kube-rbac-proxy/0.log" Oct 29 23:47:01.638317 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:47:01.638232 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-775f4c9db-dqrhs_d33591ce-f459-4bb1-8fa0-87c608b9616c/telemeter-client/0.log" Oct 29 23:47:01.748096 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:47:01.748069 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-775f4c9db-dqrhs_d33591ce-f459-4bb1-8fa0-87c608b9616c/reload/0.log" Oct 29 23:47:01.856030 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:47:01.855990 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-775f4c9db-dqrhs_d33591ce-f459-4bb1-8fa0-87c608b9616c/kube-rbac-proxy/0.log" Oct 29 23:47:01.970743 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:47:01.970664 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cdc79c9f7-2lxzb_b2187059-1391-4124-9981-0a203dfe8628/thanos-query/0.log" Oct 29 23:47:02.082830 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:47:02.082794 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cdc79c9f7-2lxzb_b2187059-1391-4124-9981-0a203dfe8628/kube-rbac-proxy-web/0.log" Oct 29 23:47:02.190953 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:47:02.190925 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cdc79c9f7-2lxzb_b2187059-1391-4124-9981-0a203dfe8628/kube-rbac-proxy/0.log" Oct 29 23:47:02.301576 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:47:02.301545 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cdc79c9f7-2lxzb_b2187059-1391-4124-9981-0a203dfe8628/prom-label-proxy/0.log" Oct 29 23:47:02.409044 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:47:02.409011 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cdc79c9f7-2lxzb_b2187059-1391-4124-9981-0a203dfe8628/kube-rbac-proxy-rules/0.log" Oct 29 23:47:02.516088 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:47:02.516058 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cdc79c9f7-2lxzb_b2187059-1391-4124-9981-0a203dfe8628/kube-rbac-proxy-metrics/0.log" Oct 29 23:47:04.843258 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:47:04.843180 6029 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gbnpg/perf-node-gather-daemonset-szqtx" Oct 29 23:47:05.882867 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:47:05.882839 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b7677896b-lsd4m_5040504a-5fef-4715-986f-dcee46b75258/console/0.log" Oct 29 23:47:08.936026 ip-10-0-138-163 kubenswrapper[6029]: E1029 23:47:08.935983 6029 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-smjz7" containerName="extractor" Oct 29 23:47:09.909984 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:47:09.909954 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sxpxx_0fc5618f-b30f-45ce-b070-beed0ecbbbd9/dns/0.log" Oct 29 23:47:10.016645 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:47:10.016616 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sxpxx_0fc5618f-b30f-45ce-b070-beed0ecbbbd9/kube-rbac-proxy/0.log" Oct 29 23:47:10.363037 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:47:10.363005 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k9bgk_c7491f84-75c3-4286-90f9-ec4314ac5bf9/dns-node-resolver/0.log" Oct 29 23:47:11.349267 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:47:11.349235 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-746ff8f49f-wv9ch_e64fdf06-8afe-4176-8c09-dc0bf9c9e7f5/istio-proxy/0.log" Oct 29 23:47:11.412500 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:47:11.412468 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-746ff8f49f-xhg5s_ca770a17-0292-4428-8044-8a413b388227/istio-proxy/0.log" Oct 29 23:47:11.532865 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:47:11.532835 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-746ff8f49f-zrhxv_78822c5b-2a93-412c-8fef-e7673ce74a94/istio-proxy/0.log" Oct 29 23:47:11.583153 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:47:11.583124 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l59n4_ec3af7c3-d20a-499e-9cf7-c743da6b8ed1/node-ca/0.log" Oct 29 23:47:11.586583 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:47:11.586554 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-cs4j7_ea0ed84a-fd93-4954-b7a3-90954be9f4b6/payload-pre-processing/0.log" Oct 29 23:47:11.642632 ip-10-0-138-163 kubenswrapper[6029]: I1029 23:47:11.642562 6029 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-ct2m8_e9dc9c76-648c-4dde-8a9c-823f0722c909/payload-processing/0.log"